Initial support for the Adreno A5XX
Subsystems (6)
Here is the first blast of patches for support for the fine family of Adreno A5XX GPUs. These are designed to work against Rob's version of the Linaro target tree with some additional 8996 clock stuff added in:
https://github.com/freedreno/kernel-msm/tree/a5xx
In addition, you will also need these SCM changes for the last three patches to work:
https://patchwork.kernel.org/patch/9291593/ arm64: kernel: Add SMC Session ID to results
https://patchwork.kernel.org/patch/9291595/ firmware: qcom: scm: Fix interrupted SCM calls
https://patchwork.kernel.org/patch/9353735/ firmware: qcom: scm: Fix interrupted SCM calls fully
https://patchwork.codeaurora.org/patch/109673/ dt-bindings: firmware: scm: Add MSM8996 DT bindings
https://patchwork.codeaurora.org/patch/109675/ firmware: qcom: scm: Remove core, iface and bus clocks dependency
https://patchwork.codeaurora.org/patch/109671/ firmware: qcom: scm: Return PTR_ERR when devm_clk_get fails
And you also need a updated copy of the register header files by way of the rnndb database with this change on top of it:
https://patchwork.codeaurora.org/patch/110423/ rnndb: a5xx: Update/enhance registers
if you do all these things, apply these patches and copy in the right firmware files on the db820c you should be able to start doing useful things. And there was much rejoicing.
This is a RFC so please tear into all of these with glee. I'll try to explain myself as best as I can. There are a few that might generate a bit of discussion but I'm hoping that together we can find the right solutions.
Very best regards,
Jordan
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
A message that is not in the archive (sent off-list or not yet received): 1478299497-9729-1-git-send-email-jcrouse-sgV2jX0FEOL9JmXXK+q4OQ@public.gmane.org
PATCH 1/16 drm/msm: Remove dependency on COMMON_CLK
Remove an uneeded dependency on COMMON_CLK. Anything that uses COMMON_CLK is already appropriately ifdefed.
--- drivers/gpu/drm/msm/Kconfig | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/msm/Kconfig +1 -1
@@ -3,7 +3,7 @@ config DRM_MSM tristate "MSM DRM" depends on DRM depends on ARCH_QCOM || (ARM && COMPILE_TEST) - depends on OF && COMMON_CLK + depends on OF select REGULATOR select DRM_KMS_HELPER select DRM_PANEL
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 2/16 drm/msm: Rename the MSM driver so it doesn't conflict with other drivers
In reply to a message not in the archiveMSM is a very loaded name. Rename it to msm-drm to make it a little bit more descriptive and to (kinda) avoid namespace contamination.
--- drivers/gpu/drm/msm/msm_drv.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/msm/msm_drv.c +1 -1
@@ -1057,7 +1057,7 @@ static struct platform_driver msm_platform_driver = { .probe = msm_pdev_probe, .remove = msm_pdev_remove, .driver = { - .name = "msm", + .name = "msm-drm", .of_match_table = dt_match, .pm = &msm_pm_ops, },
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 3/16 drm/msm: gpu: Cut down the list of "generic" registers to the ones we use
In reply to a message not in the archiveThere are very few register accesses in the common code. Cut down the list of common registers to just those that are used. This saves const space and saves us the effort of maintaining registers for A3XX and A4XX that don't exist or are unused.
--- drivers/gpu/drm/msm/adreno/a3xx_gpu.c | 80 --------------------------------- drivers/gpu/drm/msm/adreno/a4xx_gpu.c | 76 ------------------------------- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 59 ------------------------ 3 files changed, 215 deletions(-)
drivers/gpu/drm/msm/adreno/a3xx_gpu.c +0 -80
@@ -419,91 +419,11 @@ static void a3xx_dump(struct msm_gpu *gpu) }/* Register offset defines for A3XX */ static const unsigned int a3xx_register_offsets[REG_ADRENO_REGISTER_MAX ] = { -REG_ADRENO_DEFINE (REG_ADRENO_CP_DEBUG ,REG_AXXX_CP_DEBUG ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_ME_RAM_WADDR ,REG_AXXX_CP_ME_RAM_WADDR ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_ME_RAM_DATA ,REG_AXXX_CP_ME_RAM_DATA ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_PFP_UCODE_DATA , -REG_A3XX_CP_PFP_UCODE_DATA ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_PFP_UCODE_ADDR , -REG_A3XX_CP_PFP_UCODE_ADDR ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_WFI_PEND_CTR ,REG_A3XX_CP_WFI_PEND_CTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_BASE ,REG_AXXX_CP_RB_BASE ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR_ADDR ,REG_AXXX_CP_RB_RPTR_ADDR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR ,REG_AXXX_CP_RB_RPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_WPTR ,REG_AXXX_CP_RB_WPTR ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_PROTECT_CTRL ,REG_A3XX_CP_PROTECT_CTRL ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_ME_CNTL ,REG_AXXX_CP_ME_CNTL ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_CNTL ,REG_AXXX_CP_RB_CNTL ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_IB1_BASE ,REG_AXXX_CP_IB1_BASE ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_IB1_BUFSZ ,REG_AXXX_CP_IB1_BUFSZ ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_IB2_BASE ,REG_AXXX_CP_IB2_BASE ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_IB2_BUFSZ ,REG_AXXX_CP_IB2_BUFSZ ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_TIMESTAMP ,REG_AXXX_CP_SCRATCH_REG0 ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_ME_RAM_RADDR ,REG_AXXX_CP_ME_RAM_RADDR ), -REG_ADRENO_DEFINE (REG_ADRENO_SCRATCH_ADDR ,REG_AXXX_SCRATCH_ADDR ), -REG_ADRENO_DEFINE (REG_ADRENO_SCRATCH_UMSK ,REG_AXXX_SCRATCH_UMSK ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_ROQ_ADDR ,REG_A3XX_CP_ROQ_ADDR ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_ROQ_DATA ,REG_A3XX_CP_ROQ_DATA ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_MERCIU_ADDR ,REG_A3XX_CP_MERCIU_ADDR ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_MERCIU_DATA ,REG_A3XX_CP_MERCIU_DATA ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_MERCIU_DATA2 ,REG_A3XX_CP_MERCIU_DATA2 ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_MEQ_ADDR ,REG_A3XX_CP_MEQ_ADDR ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_MEQ_DATA ,REG_A3XX_CP_MEQ_DATA ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_HW_FAULT ,REG_A3XX_CP_HW_FAULT ), -REG_ADRENO_DEFINE (REG_ADRENO_CP_PROTECT_STATUS , -REG_A3XX_CP_PROTECT_STATUS ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_STATUS ,REG_A3XX_RBBM_STATUS ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_PERFCTR_CTL , -REG_A3XX_RBBM_PERFCTR_CTL ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_PERFCTR_LOAD_CMD0 , -REG_A3XX_RBBM_PERFCTR_LOAD_CMD0 ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_PERFCTR_LOAD_CMD1 , -REG_A3XX_RBBM_PERFCTR_LOAD_CMD1 ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_PERFCTR_PWR_1_LO , -REG_A3XX_RBBM_PERFCTR_PWR_1_LO ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_INT_0_MASK ,REG_A3XX_RBBM_INT_0_MASK ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_INT_0_STATUS , -REG_A3XX_RBBM_INT_0_STATUS ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_AHB_ERROR_STATUS , -REG_A3XX_RBBM_AHB_ERROR_STATUS ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_AHB_CMD ,REG_A3XX_RBBM_AHB_CMD ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_INT_CLEAR_CMD , -REG_A3XX_RBBM_INT_CLEAR_CMD ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_CLOCK_CTL ,REG_A3XX_RBBM_CLOCK_CTL ), -REG_ADRENO_DEFINE (REG_ADRENO_VPC_DEBUG_RAM_SEL , -REG_A3XX_VPC_VPC_DEBUG_RAM_SEL ), -REG_ADRENO_DEFINE (REG_ADRENO_VPC_DEBUG_RAM_READ , -REG_A3XX_VPC_VPC_DEBUG_RAM_READ ), -REG_ADRENO_DEFINE (REG_ADRENO_VSC_SIZE_ADDRESS , -REG_A3XX_VSC_SIZE_ADDRESS ), -REG_ADRENO_DEFINE (REG_ADRENO_VFD_CONTROL_0 ,REG_A3XX_VFD_CONTROL_0 ), -REG_ADRENO_DEFINE (REG_ADRENO_VFD_INDEX_MAX ,REG_A3XX_VFD_INDEX_MAX ), -REG_ADRENO_DEFINE (REG_ADRENO_SP_VS_PVT_MEM_ADDR_REG , -REG_A3XX_SP_VS_PVT_MEM_ADDR_REG ), -REG_ADRENO_DEFINE (REG_ADRENO_SP_FS_PVT_MEM_ADDR_REG , -REG_A3XX_SP_FS_PVT_MEM_ADDR_REG ), -REG_ADRENO_DEFINE (REG_ADRENO_SP_VS_OBJ_START_REG , -REG_A3XX_SP_VS_OBJ_START_REG ), -REG_ADRENO_DEFINE (REG_ADRENO_SP_FS_OBJ_START_REG , -REG_A3XX_SP_FS_OBJ_START_REG ), -REG_ADRENO_DEFINE (REG_ADRENO_PA_SC_AA_CONFIG ,REG_A3XX_PA_SC_AA_CONFIG ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_PM_OVERRIDE2 , -REG_A3XX_RBBM_PM_OVERRIDE2 ), -REG_ADRENO_DEFINE (REG_ADRENO_SCRATCH_REG2 ,REG_AXXX_CP_SCRATCH_REG2 ), -REG_ADRENO_DEFINE (REG_ADRENO_SQ_GPR_MANAGEMENT , -REG_A3XX_SQ_GPR_MANAGEMENT ), -REG_ADRENO_DEFINE (REG_ADRENO_SQ_INST_STORE_MANAGMENT , -REG_A3XX_SQ_INST_STORE_MANAGMENT ), -REG_ADRENO_DEFINE (REG_ADRENO_TP0_CHICKEN ,REG_A3XX_TP0_CHICKEN ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_RBBM_CTL ,REG_A3XX_RBBM_RBBM_CTL ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_SW_RESET_CMD , -REG_A3XX_RBBM_SW_RESET_CMD ), -REG_ADRENO_DEFINE (REG_ADRENO_UCHE_INVALIDATE0 , -REG_A3XX_UCHE_CACHE_INVALIDATE0_REG ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_PERFCTR_LOAD_VALUE_LO , -REG_A3XX_RBBM_PERFCTR_LOAD_VALUE_LO ), -REG_ADRENO_DEFINE (REG_ADRENO_RBBM_PERFCTR_LOAD_VALUE_HI , -REG_A3XX_RBBM_PERFCTR_LOAD_VALUE_HI ), };static const struct adreno_gpu_funcs funcs = {
drivers/gpu/drm/msm/adreno/a4xx_gpu.c +0 -76
87 lines not on this page · raw message
drivers/gpu/drm/msm/adreno/adreno_gpu.h +0 -59
70 lines not on this page · raw message
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 4/16 drm: msm: Flush the cache immediately after allocating pages
In reply to a message not in the archiveFor reasons that are not entirely understood using dma_map_sg() for nocache/write combine buffers doesn't always successfully flush the cache after the memory is zeroed somewhere deep in the bowels of the shmem code. My working theory is that the cache flush on the swiotlb bounce buffer address work isn't always flushing what we need.
Instead of using dma_map_sg() directly kmap and flush each page at allocate time. We could use invalidate + clean or just invalidate if we wanted to but on ARM64 using a flush is safer and not much slower for what we are trying to do.
Hopefully someday I'll more clearly understand the relationship between shmem kmap, vmap and the swiotlb bounce buffer and we can be smarter about when and how we invalidate the caches.
--- drivers/gpu/drm/msm/msm_gem.c | 21 ++++++++------------- 1 file changed, 8 insertions(+), 13 deletions(-)
drivers/gpu/drm/msm/msm_gem.c +8 -13
@@ -79,6 +79,7 @@ static struct page **get_pages(struct drm_gem_object *obj)struct drm_device *dev = obj->dev;struct page **p;int npages = obj->size >>PAGE_SHIFT ; +int i;if (use_pages (obj)) p =drm_gem_get_pages (obj);
@@ -91,6 +92,13 @@ static struct page **get_pages(struct drm_gem_object *obj)return p; } +for (i =0 ; i < npages; i++) { +void *addr =kmap_atomic (p[i]); + +__dma_flush_range (addr, addr +PAGE_SIZE ); +kunmap_atomic (addr); + } + msm_obj->sgt =drm_prime_pages_to_sg (p, npages);if (IS_ERR (msm_obj->sgt)) {dev_err (dev->dev,"failed to allocate sgt\n" );
@@ -98,13 +106,6 @@ static struct page **get_pages(struct drm_gem_object *obj) } msm_obj->pages = p; - -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent: -*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) -dma_map_sg (dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL ); }return msm_obj->pages;
@@ -115,12 +116,6 @@ static void put_pages(struct drm_gem_object *obj)struct msm_gem_object *msm_obj =to_msm_bo (obj);if (msm_obj->pages) { -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent: -*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) -dma_unmap_sg (obj->dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL );sg_free_table (msm_obj->sgt);kfree (msm_obj->sgt);
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
Re: [Freedreno] [PATCH 04/16] drm: msm: Flush the cache immediately after allocating pages
Quoted 7 lines · Jordan Crouse
For reasons that are not entirely understood using
dma_map_sg()for nocache/write combine buffers doesn't always successfully flush the cache after the memory is zeroed somewhere deep in the bowels of the shmem code. My working theory is that the cache flush on the swiotlb bounce buffer address work isn't always flushing what we need.
Quoted 8 lines
Instead of using
dma_map_sg()directly kmap and flush each page at allocate time. We could use invalidate + clean or just invalidate if we wanted to but on ARM64 using a flush is safer and not much slower for what we are trying to do.Hopefully someday I'll more clearly understand the relationship between shmem kmap, vmap and the swiotlb bounce buffer and we can be smarter about when and how we invalidate the caches.
Like I mentioned on irc, we defn don't want to ever hit bounce buffers. I think the problem here is dma-mapping assumes we only support 32b physical addresses, which is not true (at least as long as we have iommu)..
Archit hit a similar problem on the display side of things.
I think the proper solution is to do something like this somewhere:
dma_set_mask_and_coherent(drm->dev, DMA_BIT_MASK(size))
where size is 32 or 64 (48?) depending on device..
Note that this value should be perhaps something that the iommu driver knows, since really it is about the iommu page tables.
Maybe it would even make sense for the iommu driver to set this when we attach? Although since the GEM code is allocating/mapping for multiple subdev's that might not work out (ie. if we only attached subdev's and not the parent drm dev which is used by the GEM code for dma_map/unmap()).
(ofc it would be better if dma-mapping was structured more like helpers which could be bypassed in the few special cases where the abstraction doesn't work, rather than forcing us to do pretend dma_map/unmap() for cache operations.. but that is a topic for a different rant)
BR,
-R
Quoted 65 lines
Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/msm_gem.c | 21 ++++++++------------- 1 file changed, 8 insertions(+), 13 deletions(-)drivers/gpu/drm/msm/msm_gem.c +8
-14@@ -79,6 +79,7 @@ static struct page **get_pages(struct drm_gem_object *obj)struct drm_device *dev = obj->dev;struct page **p;int npages = obj->size >>PAGE_SHIFT ; +int i;if (use_pages (obj)) p =drm_gem_get_pages (obj);@@ -91,6 +92,13 @@ static struct page **get_pages(struct drm_gem_object *obj)return p; } +for (i =0 ; i < npages; i++) { +void *addr =kmap_atomic (p[i]); + +__dma_flush_range (addr, addr +PAGE_SIZE ); +kunmap_atomic (addr); + } + msm_obj->sgt =drm_prime_pages_to_sg (p, npages);if (IS_ERR (msm_obj->sgt)) {dev_err (dev->dev,"failed to allocate sgt\n" );@@ -98,13 +106,6 @@ static struct page **get_pages(struct drm_gem_object *obj) } msm_obj->pages = p; - -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent: -*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) -dma_map_sg (dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL ); }return msm_obj->pages;@@ -115,12 +116,6 @@ static void put_pages(struct drm_gem_object *obj)struct msm_gem_object *msm_obj =to_msm_bo (obj);if (msm_obj->pages) { -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent: -*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) -dma_unmap_sg (obj->dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL );sg_free_table (msm_obj->sgt);kfree (msm_obj->sgt); --1.9.1
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
A message that is not in the archive (sent off-list or not yet received): CAF6AEGtDv8tRZi82Eno5RF6a58qSRpjYcUo-J8dDDioDLLJqmg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org
Re: [PATCH 04/16] drm: msm: Flush the cache immediately after allocating pages
Quoted 17 lines · Rob Clark
Quoted 7 lines · Jordan Crouse
For reasons that are not entirely understood using
dma_map_sg()for nocache/write combine buffers doesn't always successfully flush the cache after the memory is zeroed somewhere deep in the bowels of the shmem code. My working theory is that the cache flush on the swiotlb bounce buffer address work isn't always flushing what we need.Quoted 8 lines
Instead of using
dma_map_sg()directly kmap and flush each page at allocate time. We could use invalidate + clean or just invalidate if we wanted to but on ARM64 using a flush is safer and not much slower for what we are trying to do.Hopefully someday I'll more clearly understand the relationship between shmem kmap, vmap and the swiotlb bounce buffer and we can be smarter about when and how we invalidate the caches.
Quoted 6 lines
Like I mentioned on irc, we defn don't want to ever hit bounce buffers. I think the problem here is dma-mapping assumes we only support 32b physical addresses, which is not true (at least as long as we have iommu)..
Archit hit a similar problem on the display side of things.
Yeah, the shmem allocated pages ended up being 33 bit addresses some times on db820c. The msm driver sets the dma mask to a default of 32 bits. The dma mapping api gets unhappy whenever we get sg chunks with 33 bit addresses, and tries to use switolb for them. We eventually end up overflowing the swiotlb.
Setting the mask to 33 bits worked as a temporary hack.
Quoted 7 lines
I think the proper solution is to do something like this somewhere:
dma_set_mask_and_coherent(drm->dev, DMA_BIT_MASK(size))where size is 32 or 64 (48?) depending on device..
Quoted 8 lines
Note that this value should be perhaps something that the iommu driver knows, since really it is about the iommu page tables.
Maybe it would even make sense for the iommu driver to set this when we attach? Although since the GEM code is allocating/mapping for multiple subdev's that might not work out (ie. if we only attached subdev's and not the parent drm dev which is used by the GEM code for dma_map/unmap()).
By multiple subdevs, you mean MDP and GPU devs? As far as their dma masks are concerned, it should be the same for both, right? It's only the iommu driver's returned iova that we need to care about. Weren't we thinking of managing that by having separate drm_mm's for MDP and GPU?
Quoted 6 lines
(ofc it would be better if dma-mapping was structured more like helpers which could be bypassed in the few special cases where the abstraction doesn't work, rather than forcing us to do pretend dma_map/unmap() for cache operations.. but that is a topic for a different rant)
Yeah, that would be nice.
Archit
Quoted 69 lines
BR,
-RQuoted 65 lines
Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/msm_gem.c | 21 ++++++++------------- 1 file changed, 8 insertions(+), 13 deletions(-)drivers/gpu/drm/msm/msm_gem.c +8
-14@@ -79,6 +79,7 @@ static struct page **get_pages(struct drm_gem_object *obj)struct drm_device *dev = obj->dev;struct page **p;int npages = obj->size >>PAGE_SHIFT ; +int i;if (use_pages (obj)) p =drm_gem_get_pages (obj);@@ -91,6 +92,13 @@ static struct page **get_pages(struct drm_gem_object *obj)return p; } +for (i =0 ; i < npages; i++) { +void *addr =kmap_atomic (p[i]); + +__dma_flush_range (addr, addr +PAGE_SIZE ); +kunmap_atomic (addr); + } + msm_obj->sgt =drm_prime_pages_to_sg (p, npages);if (IS_ERR (msm_obj->sgt)) {dev_err (dev->dev,"failed to allocate sgt\n" );@@ -98,13 +106,6 @@ static struct page **get_pages(struct drm_gem_object *obj) } msm_obj->pages = p; - -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent: -*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) -dma_map_sg (dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL ); }return msm_obj->pages;@@ -115,12 +116,6 @@ static void put_pages(struct drm_gem_object *obj)struct msm_gem_object *msm_obj =to_msm_bo (obj);if (msm_obj->pages) { -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent: -*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) -dma_unmap_sg (obj->dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL );sg_free_table (msm_obj->sgt);kfree (msm_obj->sgt); --1.9.1
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
Signature · 6 lines
Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, a Linux Foundation Collaborative Project _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
A message that is not in the archive (sent off-list or not yet received): 99a66f0f-ec84-a26e-0108-60367362c29e-sgV2jX0FEOL9JmXXK+q4OQ@public.gmane.org
Re: [PATCH 04/16] drm: msm: Flush the cache immediately after allocating pages
Quoted 32 lines · Archit Taneja
Quoted 21 lines · Rob Clark
Quoted 8 lines · Jordan Crouse
For reasons that are not entirely understood using
dma_map_sg()for nocache/write combine buffers doesn't always successfully flush the cache after the memory is zeroed somewhere deep in the bowels of the shmem code. My working theory is that the cache flush on the swiotlb bounce buffer address work isn't always flushing what we need.Quoted 8 lines
Instead of using
dma_map_sg()directly kmap and flush each page at allocate time. We could use invalidate + clean or just invalidate if we wanted to but on ARM64 using a flush is safer and not much slower for what we are trying to do.Hopefully someday I'll more clearly understand the relationship between shmem kmap, vmap and the swiotlb bounce buffer and we can be smarter about when and how we invalidate the caches.
Quoted 6 lines
Like I mentioned on irc, we defn don't want to ever hit bounce buffers. I think the problem here is dma-mapping assumes we only support 32b physical addresses, which is not true (at least as long as we have iommu)..
Archit hit a similar problem on the display side of things.
Quoted 7 lines
Yeah, the shmem allocated pages ended up being 33 bit addresses some times on db820c. The msm driver sets the dma mask to a default of 32 bits. The dma mapping api gets unhappy whenever we get sg chunks with 33 bit addresses, and tries to use switolb for them. We eventually end up overflowing the swiotlb.
Setting the mask to 33 bits worked as a temporary hack.
actually I think setting the mask is the correct thing to do, but probably should use dma_set_ fxn.. and I suspect that the PA for the iommu is larger than 33 bits. It is probably equal to the number of address lines that are wired up. Not quite sure what that is, but I don't think there are any devices where the iommu cannot map some physical pages.
Quoted 17 lines
Quoted 7 lines
I think the proper solution is to do something like this somewhere:
dma_set_mask_and_coherent(drm->dev, DMA_BIT_MASK(size))where size is 32 or 64 (48?) depending on device..
Quoted 8 lines
Note that this value should be perhaps something that the iommu driver knows, since really it is about the iommu page tables.
Maybe it would even make sense for the iommu driver to set this when we attach? Although since the GEM code is allocating/mapping for multiple subdev's that might not work out (ie. if we only attached subdev's and not the parent drm dev which is used by the GEM code for dma_map/unmap()).
Quoted 4 lines
By multiple subdevs, you mean MDP and GPU devs? As far as their dma masks are concerned, it should be the same for both, right? It's only the iommu driver's returned iova that we need to care about. Weren't we thinking of managing that by having separate drm_mm's for MDP and GPU?
correct, it isn't about the mdp vs gpu iova, but about the pa that is mapped in the iommu.
And yeah, multiple address spaces is one of the things I have for 4.10:
https://github.com/freedreno/kernel-msm/commit/40d73b331e45fa4bb255ae26012378d396ee46a5
BR,
-R
Quoted 87 lines
Quoted 7 lines
(ofc it would be better if dma-mapping was structured more like helpers which could be bypassed in the few special cases where the abstraction doesn't work, rather than forcing us to do pretend dma_map/unmap() for cache operations.. but that is a topic for a different rant)
Yeah, that would be nice.
Archit
Quoted 73 lines
BR,
-RQuoted 69 lines
Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/msm_gem.c | 21 ++++++++------------- 1 file changed, 8 insertions(+), 13 deletions(-)drivers/gpu/drm/msm/msm_gem.c +1
-0@@ -79,6 +79,7 @@ static struct page **get_pages(struct drm_gem_object *obj)struct drm_device *dev = obj->dev;struct page **p;int npages = obj->size >>PAGE_SHIFT ; +int i;if (use_pages (obj))p = drm_gem_get_pages(obj);drivers/gpu/drm/msm/msm_gem.c +7
-0@@ -91,6 +92,13 @@ static struct page **get_pages(struct drm_gem_object *obj)return p; } +for (i =0 ; i < npages; i++) { +void *addr =kmap_atomic (p[i]); + +__dma_flush_range (addr, addr +PAGE_SIZE ); +kunmap_atomic (addr); + } + msm_obj->sgt =drm_prime_pages_to_sg (p, npages);if (IS_ERR (msm_obj->sgt)) {dev_err(dev->dev, "failed to allocate sgt\n");drivers/gpu/drm/msm/msm_gem.c +0
-3@@ -98,13 +106,6 @@ static struct page **get_pages(struct drm_gem_object *obj) } msm_obj->pages = p; - -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent:
drivers/gpu/drm/msm/msm_gem.c +0
-4-*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) - dma_map_sg(dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL); } return msm_obj->pages;drivers/gpu/drm/msm/msm_gem.c +0
-2@@ -115,12 +116,6 @@ static void put_pages(struct drm_gem_object *obj)struct msm_gem_object *msm_obj =to_msm_bo (obj);if (msm_obj->pages) { -/* For non-cached buffers, ensure the new pages are clean -* because display controller, GPU, etc. are not coherent:
drivers/gpu/drm/msm/msm_gem.c +0
-4-*/ -if (msm_obj->flags & (MSM_BO_WC |MSM_BO_UNCACHED )) - dma_unmap_sg(obj->dev->dev, msm_obj->sgt->sgl, - msm_obj->sgt->nents,DMA_BIDIRECTIONAL); sg_free_table(msm_obj->sgt); kfree(msm_obj->sgt);--
1.9.1
Quoted 9 lines
Quoted 4 lines
Quoted 4 lines
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno--
Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, a Linux Foundation Collaborative Project
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
Re: [Freedreno] [PATCH 04/16] drm: msm: Flush the cache immediately after allocating pages
Quoted 39 lines · Rob Clark
Quoted 38 lines · Archit Taneja
Quoted 21 lines · Rob Clark
Quoted 8 lines · Jordan Crouse
For reasons that are not entirely understood using
dma_map_sg()for nocache/write combine buffers doesn't always successfully flush the cache after the memory is zeroed somewhere deep in the bowels of the shmem code. My working theory is that the cache flush on the swiotlb bounce buffer address work isn't always flushing what we need.Quoted 8 lines
Instead of using
dma_map_sg()directly kmap and flush each page at allocate time. We could use invalidate + clean or just invalidate if we wanted to but on ARM64 using a flush is safer and not much slower for what we are trying to do.Hopefully someday I'll more clearly understand the relationship between shmem kmap, vmap and the swiotlb bounce buffer and we can be smarter about when and how we invalidate the caches.
Quoted 6 lines
Like I mentioned on irc, we defn don't want to ever hit bounce buffers. I think the problem here is dma-mapping assumes we only support 32b physical addresses, which is not true (at least as long as we have iommu)..
Archit hit a similar problem on the display side of things.
Yeah, the shmem allocated pages ended up being 33 bit addresses some times on db820c. The msm driver sets the dma mask to a default of 32 bits. The dma mapping api gets unhappy whenever we get sg chunks with 33 bit addresses, and tries to use switolb for them. We eventually end up overflowing the swiotlb.
Quoted 8 lines
Quoted 1 line
Setting the mask to 33 bits worked as a temporary hack.
actually I think setting the mask is the correct thing to do, but probably should use
dma_set_fxn.. and I suspect that the PA for the iommu is larger than 33 bits. It is probably equal to the number of address lines that are wired up. Not quite sure what that is, but I don't think there are any devices where the iommu cannot map some physical pages.
The GPU/MMU combo supporting 48 bit PAs since at least the 4XX era. I'm not sure if a 48 bit mask would break the older targets or not - you won't be getting any addressable memory > 32 bits on those devices anyway.
I'll try the dma_set_mask trick with 48 bits and see how it pans out.
Jordan
Signature · 2 lines
The Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, a Linux Foundation Collaborative Project
PATCH 5/16 drm/msm: gpu: Return error on hw_init failure
In reply to a message not in the archiveWhen the GPU hardware init function fails (like say, ME_INIT timed out) return error instead of blindly continuing on. This gives us a small chance of saving the system before it goes boom.
--- drivers/gpu/drm/msm/adreno/a3xx_gpu.c | 21 ++++++++++++--------- drivers/gpu/drm/msm/adreno/a4xx_gpu.c | 20 +++++++++++--------- drivers/gpu/drm/msm/adreno/adreno_gpu.c | 11 +++++------ drivers/gpu/drm/msm/adreno/adreno_gpu.h | 2 +- drivers/gpu/drm/msm/msm_gpu.h | 2 +- 5 files changed, 30 insertions(+), 26 deletions(-)
drivers/gpu/drm/msm/adreno/a3xx_gpu.c +12 -9
@@ -41,7 +41,7 @@ extern bool hang_debug;static void a3xx_dump (struct msm_gpu *gpu); -static void a3xx_me_init (struct msm_gpu *gpu) +static bool a3xx_me_init (struct msm_gpu *gpu) {struct msm_ringbuffer *ring = gpu->rb;
@@ -65,7 +65,7 @@ static void a3xx_me_init(struct msm_gpu *gpu)OUT_RING (ring,0x00000000 ); gpu->funcs->flush (gpu); - gpu->funcs->idle (gpu); +return gpu->funcs->idle (gpu); }static int a3xx_hw_init (struct msm_gpu *gpu)
@@ -294,9 +294,7 @@ static int a3xx_hw_init(struct msm_gpu *gpu)/* clear ME_HALT to start micro engine */ gpu_write (gpu,REG_AXXX_CP_ME_CNTL ,0 ); -a3xx_me_init (gpu); - -return 0 ; +return a3xx_me_init (gpu) ?0 : -EINVAL ; }static void a3xx_recover (struct msm_gpu *gpu)
@@ -330,17 +328,22 @@ static void a3xx_destroy(struct msm_gpu *gpu)kfree (a3xx_gpu); } -static void a3xx_idle (struct msm_gpu *gpu) +static bool a3xx_idle (struct msm_gpu *gpu) {/* wait for ringbuffer to drain: */ -adreno_idle (gpu); +if (!adreno_idle (gpu)) +return false;/* then wait for GPU to finish: */ if (spin_until (!(gpu_read (gpu,REG_A3XX_RBBM_STATUS ) & -A3XX_RBBM_STATUS_GPU_BUSY ))) +A3XX_RBBM_STATUS_GPU_BUSY ))) {DRM_ERROR ("%s: timeout waiting for GPU to idle!\n" , gpu->name); -/* TODO maybe we need to reset GPU here to recover from hang? */ +/* TODO maybe we need to reset GPU here to recover from hang? */ +return false; + } + +return true; }static irqreturn_t a3xx_irq (struct msm_gpu *gpu)
drivers/gpu/drm/msm/adreno/a4xx_gpu.c +11 -9
@@ -113,7 +113,7 @@ static void a4xx_enable_hwcg(struct msm_gpu *gpu) } -static void a4xx_me_init (struct msm_gpu *gpu) +static bool a4xx_me_init (struct msm_gpu *gpu) {struct msm_ringbuffer *ring = gpu->rb;
@@ -137,7 +137,7 @@ static void a4xx_me_init(struct msm_gpu *gpu)OUT_RING (ring,0x00000000 ); gpu->funcs->flush (gpu); - gpu->funcs->idle (gpu); +return gpu->funcs->idle (gpu); }static int a4xx_hw_init (struct msm_gpu *gpu)
@@ -292,9 +292,7 @@ static int a4xx_hw_init(struct msm_gpu *gpu)/* clear ME_HALT to start micro engine */ gpu_write (gpu,REG_A4XX_CP_ME_CNTL ,0 ); -a4xx_me_init (gpu); - -return 0 ; +return a4xx_me_init (gpu) ?0 : -EINVAL ; }static void a4xx_recover (struct msm_gpu *gpu)
@@ -328,17 +326,21 @@ static void a4xx_destroy(struct msm_gpu *gpu)kfree (a4xx_gpu); } -static void a4xx_idle (struct msm_gpu *gpu) +static bool a4xx_idle (struct msm_gpu *gpu) {/* wait for ringbuffer to drain: */ -adreno_idle (gpu); +if (!adreno_idle (gpu)) +return false;/* then wait for GPU to finish: */ if (spin_until (!(gpu_read (gpu,REG_A4XX_RBBM_STATUS ) & -A4XX_RBBM_STATUS_GPU_BUSY ))) +A4XX_RBBM_STATUS_GPU_BUSY ))) {DRM_ERROR ("%s: timeout waiting for GPU to idle!\n" , gpu->name); +/* TODO maybe we need to reset GPU here to recover from hang? */ +return false; + } -/* TODO maybe we need to reset GPU here to recover from hang? */ +return true; }static irqreturn_t a4xx_irq (struct msm_gpu *gpu)
drivers/gpu/drm/msm/adreno/adreno_gpu.c +5 -6
@@ -218,19 +218,18 @@ void adreno_flush(struct msm_gpu *gpu)adreno_gpu_write (adreno_gpu,REG_ADRENO_CP_RB_WPTR , wptr); } -void adreno_idle (struct msm_gpu *gpu) +bool adreno_idle (struct msm_gpu *gpu) {struct adreno_gpu *adreno_gpu =to_adreno_gpu (gpu);uint32_t wptr =get_wptr (gpu->rb); -int ret;/* wait for CP to drain ringbuffer: */ - ret =spin_until (get_rptr (adreno_gpu) == wptr); - -if (ret) -DRM_ERROR ("%s: timeout waiting to drain ringbuffer!\n" , gpu->name); +if (!spin_until (get_rptr (adreno_gpu) == wptr)) +return true;/* TODO maybe we need to reset GPU here to recover from hang? */ +DRM_ERROR ("%s: timeout waiting to drain ringbuffer!\n" , gpu->name); +return false; }#ifdef CONFIG_DEBUG_FS
drivers/gpu/drm/msm/adreno/adreno_gpu.h +1 -1
@@ -182,7 +182,7 @@ void adreno_recover(struct msm_gpu *gpu);void adreno_submit (struct msm_gpu *gpu,struct msm_gem_submit *submit,struct msm_file_private *ctx);void adreno_flush (struct msm_gpu *gpu); -void adreno_idle (struct msm_gpu *gpu); +bool adreno_idle (struct msm_gpu *gpu);#ifdef CONFIG_DEBUG_FS void adreno_show (struct msm_gpu *gpu,struct seq_file *m);#endif
drivers/gpu/drm/msm/msm_gpu.h +1 -1
@@ -50,7 +50,7 @@ struct msm_gpu_funcs {void (*submit)(struct msm_gpu *gpu,struct msm_gem_submit *submit,struct msm_file_private *ctx);void (*flush)(struct msm_gpu *gpu); -void (*idle)(struct msm_gpu *gpu); +bool (*idle)(struct msm_gpu *gpu);irqreturn_t (*irq)(struct msm_gpu *irq);uint32_t (*last_fence)(struct msm_gpu *gpu);void (*recover)(struct msm_gpu *gpu);
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
A message that is not in the archive (sent off-list or not yet received): 1478299497-9729-6-git-send-email-jcrouse-sgV2jX0FEOL9JmXXK+q4OQ@public.gmane.org
Re: [PATCH 05/16] drm/msm: gpu: Return error on hw_init failure
Quoted 3 lines · Jordan Crouse
When the GPU hardware init function fails (like say,
ME_INITtimed out) return error instead of blindly continuing on. This gives us a small chance of saving the system before it goes boom.
seems like a good idea.. although I guess we should just make it an int return (ie. 0 or -ETIMEDOUT)..
BR,
-R
Quoted 186 lines
Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/adreno/a3xx_gpu.c | 21 ++++++++++++--------- drivers/gpu/drm/msm/adreno/a4xx_gpu.c | 20 +++++++++++--------- drivers/gpu/drm/msm/adreno/adreno_gpu.c | 11 +++++------ drivers/gpu/drm/msm/adreno/adreno_gpu.h | 2 +- drivers/gpu/drm/msm/msm_gpu.h | 2 +- 5 files changed, 30 insertions(+), 26 deletions(-)drivers/gpu/drm/msm/adreno/a3xx_gpu.c +12
-9@@ -41,7 +41,7 @@ extern bool hang_debug;static void a3xx_dump (struct msm_gpu *gpu); -static void a3xx_me_init (struct msm_gpu *gpu) +static bool a3xx_me_init (struct msm_gpu *gpu) {struct msm_ringbuffer *ring = gpu->rb;@@ -65,7 +65,7 @@ static void a3xx_me_init(struct msm_gpu *gpu)OUT_RING (ring,0x00000000 ); gpu->funcs->flush (gpu); - gpu->funcs->idle (gpu); +return gpu->funcs->idle (gpu); }static int a3xx_hw_init (struct msm_gpu *gpu)@@ -294,9 +294,7 @@ static int a3xx_hw_init(struct msm_gpu *gpu)/* clear ME_HALT to start micro engine */ gpu_write (gpu,REG_AXXX_CP_ME_CNTL ,0 ); -a3xx_me_init (gpu); - -return 0 ; +return a3xx_me_init (gpu) ?0 : -EINVAL ; }static void a3xx_recover (struct msm_gpu *gpu)@@ -330,17 +328,22 @@ static void a3xx_destroy(struct msm_gpu *gpu)kfree (a3xx_gpu); } -static void a3xx_idle (struct msm_gpu *gpu) +static bool a3xx_idle (struct msm_gpu *gpu) {/* wait for ringbuffer to drain: */ -adreno_idle (gpu); +if (!adreno_idle (gpu)) +return false;/* then wait for GPU to finish: */ if (spin_until (!(gpu_read (gpu,REG_A3XX_RBBM_STATUS ) & -A3XX_RBBM_STATUS_GPU_BUSY ))) +A3XX_RBBM_STATUS_GPU_BUSY ))) {DRM_ERROR ("%s: timeout waiting for GPU to idle!\n" , gpu->name); -/* TODO maybe we need to reset GPU here to recover from hang? */ +/* TODO maybe we need to reset GPU here to recover from hang? */ +return false; + } + +return true; }static irqreturn_t a3xx_irq (struct msm_gpu *gpu)drivers/gpu/drm/msm/adreno/a4xx_gpu.c +11
-9@@ -113,7 +113,7 @@ static void a4xx_enable_hwcg(struct msm_gpu *gpu) } -static void a4xx_me_init (struct msm_gpu *gpu) +static bool a4xx_me_init (struct msm_gpu *gpu) {struct msm_ringbuffer *ring = gpu->rb;@@ -137,7 +137,7 @@ static void a4xx_me_init(struct msm_gpu *gpu)OUT_RING (ring,0x00000000 ); gpu->funcs->flush (gpu); - gpu->funcs->idle (gpu); +return gpu->funcs->idle (gpu); }static int a4xx_hw_init (struct msm_gpu *gpu)@@ -292,9 +292,7 @@ static int a4xx_hw_init(struct msm_gpu *gpu)/* clear ME_HALT to start micro engine */ gpu_write (gpu,REG_A4XX_CP_ME_CNTL ,0 ); -a4xx_me_init (gpu); - -return 0 ; +return a4xx_me_init (gpu) ?0 : -EINVAL ; }static void a4xx_recover (struct msm_gpu *gpu)@@ -328,17 +326,21 @@ static void a4xx_destroy(struct msm_gpu *gpu)kfree (a4xx_gpu); } -static void a4xx_idle (struct msm_gpu *gpu) +static bool a4xx_idle (struct msm_gpu *gpu) {/* wait for ringbuffer to drain: */ -adreno_idle (gpu); +if (!adreno_idle (gpu)) +return false;/* then wait for GPU to finish: */ if (spin_until (!(gpu_read (gpu,REG_A4XX_RBBM_STATUS ) & -A4XX_RBBM_STATUS_GPU_BUSY ))) +A4XX_RBBM_STATUS_GPU_BUSY ))) {DRM_ERROR ("%s: timeout waiting for GPU to idle!\n" , gpu->name); +/* TODO maybe we need to reset GPU here to recover from hang? */ +return false; + } -/* TODO maybe we need to reset GPU here to recover from hang? */ +return true; }static irqreturn_t a4xx_irq (struct msm_gpu *gpu)drivers/gpu/drm/msm/adreno/adreno_gpu.c +5
-6@@ -218,19 +218,18 @@ void adreno_flush(struct msm_gpu *gpu)adreno_gpu_write (adreno_gpu,REG_ADRENO_CP_RB_WPTR , wptr); } -void adreno_idle (struct msm_gpu *gpu) +bool adreno_idle (struct msm_gpu *gpu) {struct adreno_gpu *adreno_gpu =to_adreno_gpu (gpu);uint32_t wptr =get_wptr (gpu->rb); -int ret;/* wait for CP to drain ringbuffer: */ - ret =spin_until (get_rptr (adreno_gpu) == wptr); - -if (ret) -DRM_ERROR ("%s: timeout waiting to drain ringbuffer!\n" , gpu->name); +if (!spin_until (get_rptr (adreno_gpu) == wptr)) +return true;/* TODO maybe we need to reset GPU here to recover from hang? */ +DRM_ERROR ("%s: timeout waiting to drain ringbuffer!\n" , gpu->name); +return false; }#ifdef CONFIG_DEBUG_FS drivers/gpu/drm/msm/adreno/adreno_gpu.h +1
-1@@ -182,7 +182,7 @@ void adreno_recover(struct msm_gpu *gpu);void adreno_submit (struct msm_gpu *gpu,struct msm_gem_submit *submit,struct msm_file_private *ctx);void adreno_flush (struct msm_gpu *gpu); -void adreno_idle (struct msm_gpu *gpu); +bool adreno_idle (struct msm_gpu *gpu);#ifdef CONFIG_DEBUG_FS void adreno_show (struct msm_gpu *gpu,struct seq_file *m);#endif drivers/gpu/drm/msm/msm_gpu.h +1
-2@@ -50,7 +50,7 @@ struct msm_gpu_funcs {void (*submit)(struct msm_gpu *gpu,struct msm_gem_submit *submit,struct msm_file_private *ctx);void (*flush)(struct msm_gpu *gpu); -void (*idle)(struct msm_gpu *gpu); +bool (*idle)(struct msm_gpu *gpu);irqreturn_t (*irq)(struct msm_gpu *irq);uint32_t (*last_fence)(struct msm_gpu *gpu);void (*recover)(struct msm_gpu *gpu); --1.9.1
Quoted 4 lines
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 6/16 drm/msm: gpu: Add OUT_TYPE4 and OUT_TYPE7
In reply to a message not in the archiveAdd helper functions for TYPE4 and TYPE7 ME opcodes that replace TYPE0 and TYPE3 starting with the A5XX targets.
--- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 30 ++++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+)
drivers/gpu/drm/msm/adreno/adreno_gpu.h +30 -0
@@ -219,6 +219,36 @@ OUT_PKT3(struct msm_ringbuffer *ring, uint8_t opcode, uint16_t cnt)OUT_RING (ring,CP_TYPE3_PKT | ((cnt-1 ) <<16 ) | ((opcode &0xFF ) <<8 )); } +static inline u32 PM4_PARITY (u32 val) +{ +return (0x9669 >> (0xF & (val ^ + (val >>4 ) ^ (val >>8 ) ^ (val >>12 ) ^ + (val >>16 ) ^ ((val) >>20 ) ^ (val >>24 ) ^ + (val >>28 )))) &1 ; +} + +/* Maximum number of values that can be executed for one opcode */ +#define TYPE4_MAX_PAYLOAD 127 + +#define PKT4 (_reg, _cnt) \ + (CP_TYPE4_PKT | ((_cnt) << 0) | (PM4_PARITY((_cnt)) << 7) | \ + (((_reg) & 0x3FFFF) << 8) | (PM4_PARITY((_reg)) << 27)) + +static inline void +OUT_PKT4 (struct msm_ringbuffer *ring,uint16_t regindx,uint16_t cnt) +{ +adreno_wait_ring (ring->gpu, cnt +1 ); +OUT_RING (ring,PKT4 (regindx, cnt)); +} + +static inline void +OUT_PKT7 (struct msm_ringbuffer *ring,uint8_t opcode,uint16_t cnt) +{ +adreno_wait_ring (ring->gpu, cnt +1 ); +OUT_RING (ring,CP_TYPE7_PKT | (cnt <<0 ) | (PM4_PARITY (cnt) <<15 ) | + ((opcode &0x7F ) <<16 ) | (PM4_PARITY (opcode) <<23 )); +} +/* * adreno_checkreg_off() - Checks the validity of a register enum * @gpu: Pointer to struct adreno_gpu
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 7/16 drm/msm: Add adreno_gpu_write64()
In reply to a message not in the archiveAdd a new generic function to write a "64" bit value. This isn't actually a 64 bit operation, it just writes the upper and lower 32 bit of a 64 bit value to a specified LO and HI register. If a particular target doesn't support one of the registers it can mark that register as SKIP and writes/reads from that register will be quietly dropped.
This can be immediately put in place for the ringbuffer base and the RPTR address. Both writes are converted to use adreno_gpu_write64() with their respective high and low registers and the high register appropriately marked as SKIP for both 32 bit targets (a3xx and a4xx). When a5xx comes it will define valid target registers for the 'hi' option and everything else will just work.
--- drivers/gpu/drm/msm/adreno/a3xx_gpu.c | 2 ++ drivers/gpu/drm/msm/adreno/a4xx_gpu.c | 2 ++ drivers/gpu/drm/msm/adreno/adreno_gpu.c | 11 +++++++---- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 24 +++++++++++++++++++++++- 4 files changed, 34 insertions(+), 5 deletions(-)
drivers/gpu/drm/msm/adreno/a3xx_gpu.c +2 -0
@@ -423,7 +423,9 @@ static void a3xx_dump(struct msm_gpu *gpu)/* Register offset defines for A3XX */ static const unsigned int a3xx_register_offsets[REG_ADRENO_REGISTER_MAX ] = {REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_BASE ,REG_AXXX_CP_RB_BASE ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_BASE_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR_ADDR ,REG_AXXX_CP_RB_RPTR_ADDR ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_RPTR_ADDR_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR ,REG_AXXX_CP_RB_RPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_WPTR ,REG_AXXX_CP_RB_WPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_CNTL ,REG_AXXX_CP_RB_CNTL ),
drivers/gpu/drm/msm/adreno/a4xx_gpu.c +2 -0
@@ -463,7 +463,9 @@ static void a4xx_show(struct msm_gpu *gpu, struct seq_file *m)/* Register offset defines for A4XX, in order of enum adreno_regs */ static const unsigned int a4xx_register_offsets[REG_ADRENO_REGISTER_MAX ] = {REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_BASE ,REG_A4XX_CP_RB_BASE ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_BASE_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR_ADDR ,REG_A4XX_CP_RB_RPTR_ADDR ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_RPTR_ADDR_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR ,REG_A4XX_CP_RB_RPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_WPTR ,REG_A4XX_CP_RB_WPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_CNTL ,REG_A4XX_CP_RB_CNTL ),
drivers/gpu/drm/msm/adreno/adreno_gpu.c +7 -4
@@ -79,11 +79,14 @@ int adreno_hw_init(struct msm_gpu *gpu) (adreno_is_a430(adreno_gpu) ? AXXX_CP_RB_CNTL_NO_UPDATE : 0));/* Setup ringbuffer address: */ -adreno_gpu_write (adreno_gpu,REG_ADRENO_CP_RB_BASE , gpu->rb_iova); +adreno_gpu_write64 (adreno_gpu,REG_ADRENO_CP_RB_BASE , +REG_ADRENO_CP_RB_BASE_HI , gpu->rb_iova); -if (!adreno_is_a430 (adreno_gpu)) -adreno_gpu_write (adreno_gpu,REG_ADRENO_CP_RB_RPTR_ADDR , -rbmemptr (adreno_gpu, rptr)); +if (!adreno_is_a430 (adreno_gpu)) { +adreno_gpu_write64 (adreno_gpu,REG_ADRENO_CP_RB_RPTR_ADDR , +REG_ADRENO_CP_RB_RPTR_ADDR_HI , +rbmemptr (adreno_gpu, rptr)); + }return 0 ; }
drivers/gpu/drm/msm/adreno/adreno_gpu.h +23 -1
@@ -28,6 +28,9 @@#include "adreno_pm4.xml.h" #define REG_ADRENO_DEFINE (_offset, _reg) [_offset] = (_reg) + 1 +#define REG_SKIP ~0 +#define REG_ADRENO_SKIP (_offset) [_offset] = REG_SKIP +/** * adreno_regs: List of registers that are used in across all * 3D devices. Each device type has different offset value for the same
@@ -36,7 +39,9 @@*/ enum adreno_regs {REG_ADRENO_CP_RB_BASE , +REG_ADRENO_CP_RB_BASE_HI ,REG_ADRENO_CP_RB_RPTR_ADDR , +REG_ADRENO_CP_RB_RPTR_ADDR_HI ,REG_ADRENO_CP_RB_RPTR ,REG_ADRENO_CP_RB_WPTR ,REG_ADRENO_CP_RB_CNTL ,
@@ -250,7 +255,7 @@ OUT_PKT7(struct msm_ringbuffer *ring, uint8_t opcode, uint16_t cnt) }/* -* adreno_checkreg_off() - Checks the validity of a register enum +* adreno_reg_check() - Checks the validity of a register enum * @gpu: Pointer to struct adreno_gpu * @offset_name: The register enum that is checked */
@@ -261,6 +266,16 @@ static inline bool adreno_reg_check(struct adreno_gpu *gpu, !gpu->reg_offsets[offset_name]) {BUG (); } + +/* +* REG_SKIP is a special value that tell us that the register in +* question isn't implemented on target but don't trigger a BUG(). This +* is used to cleanly implement adreno_gpu_write64() and +* adreno_gpu_read64() in a generic fashion +*/ +if (gpu->reg_offsets[offset_name] ==REG_SKIP ) +return false; +return true; }
@@ -282,4 +297,11 @@ static inline void adreno_gpu_write(struct adreno_gpu *gpu, gpu_write(&gpu->base, reg - 1, data); } +static inline void adreno_gpu_write64 (struct adreno_gpu *gpu, +enum adreno_regs lo,enum adreno_regs hi,u64 data) +{ +adreno_gpu_write (gpu, lo,lower_32_bits (data)); +adreno_gpu_write (gpu, hi,upper_32_bits (data)); +} +#endif /* __ADRENO_GPU_H__ */
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
Re: [Freedreno] [PATCH 07/16] drm/msm: Add adreno_gpu_write64()
Quoted 78 lines · Jordan Crouse
Add a new generic function to write a "64" bit value. This isn't actually a 64 bit operation, it just writes the upper and lower 32 bit of a 64 bit value to a specified LO and HI register. If a particular target doesn't support one of the registers it can mark that register as SKIP and writes/reads from that register will be quietly dropped.
This can be immediately put in place for the ringbuffer base and the RPTR address. Both writes are converted to use
adreno_gpu_write64()with their respective high and low registers and the high register appropriately marked as SKIP for both 32 bit targets (a3xx and a4xx). When a5xx comes it will define valid target registers for the 'hi' option and everything else will just work.Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/adreno/a3xx_gpu.c | 2 ++ drivers/gpu/drm/msm/adreno/a4xx_gpu.c | 2 ++ drivers/gpu/drm/msm/adreno/adreno_gpu.c | 11 +++++++---- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 24 +++++++++++++++++++++++- 4 files changed, 34 insertions(+), 5 deletions(-)drivers/gpu/drm/msm/adreno/a3xx_gpu.c +2
-0@@ -423,7 +423,9 @@ static void a3xx_dump(struct msm_gpu *gpu)/* Register offset defines for A3XX */ static const unsigned int a3xx_register_offsets[REG_ADRENO_REGISTER_MAX ] = {REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_BASE ,REG_AXXX_CP_RB_BASE ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_BASE_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR_ADDR ,REG_AXXX_CP_RB_RPTR_ADDR ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_RPTR_ADDR_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR ,REG_AXXX_CP_RB_RPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_WPTR ,REG_AXXX_CP_RB_WPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_CNTL ,REG_AXXX_CP_RB_CNTL ),drivers/gpu/drm/msm/adreno/a4xx_gpu.c +2
-0@@ -463,7 +463,9 @@ static void a4xx_show(struct msm_gpu *gpu, struct seq_file *m)/* Register offset defines for A4XX, in order of enum adreno_regs */ static const unsigned int a4xx_register_offsets[REG_ADRENO_REGISTER_MAX ] = {REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_BASE ,REG_A4XX_CP_RB_BASE ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_BASE_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR_ADDR ,REG_A4XX_CP_RB_RPTR_ADDR ), +REG_ADRENO_SKIP (REG_ADRENO_CP_RB_RPTR_ADDR_HI ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_RPTR ,REG_A4XX_CP_RB_RPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_WPTR ,REG_A4XX_CP_RB_WPTR ),REG_ADRENO_DEFINE (REG_ADRENO_CP_RB_CNTL ,REG_A4XX_CP_RB_CNTL ),drivers/gpu/drm/msm/adreno/adreno_gpu.c +7
-4@@ -79,11 +79,14 @@ int adreno_hw_init(struct msm_gpu *gpu) (adreno_is_a430(adreno_gpu) ? AXXX_CP_RB_CNTL_NO_UPDATE : 0));/* Setup ringbuffer address: */ -adreno_gpu_write (adreno_gpu,REG_ADRENO_CP_RB_BASE , gpu->rb_iova); +adreno_gpu_write64 (adreno_gpu,REG_ADRENO_CP_RB_BASE , +REG_ADRENO_CP_RB_BASE_HI , gpu->rb_iova); -if (!adreno_is_a430 (adreno_gpu)) -adreno_gpu_write (adreno_gpu,REG_ADRENO_CP_RB_RPTR_ADDR , -rbmemptr (adreno_gpu, rptr)); +if (!adreno_is_a430 (adreno_gpu)) { +adreno_gpu_write64 (adreno_gpu,REG_ADRENO_CP_RB_RPTR_ADDR , +REG_ADRENO_CP_RB_RPTR_ADDR_HI , +rbmemptr (adreno_gpu, rptr)); + }return 0 ; }drivers/gpu/drm/msm/adreno/adreno_gpu.h +0
-0
drivers/gpu/drm/msm/adreno/adreno_gpu.h line 33
Quoted 6 lines
drivers/gpu/drm/msm/adreno/adreno_gpu.h +3
-0@@ -28,6 +28,9 @@#include "adreno_pm4.xml.h" #define REG_ADRENO_DEFINE (_offset, _reg) [_offset] = (_reg) + 1 +#define REG_SKIP ~0 +#define REG_ADRENO_SKIP (_offset) [_offset] = REG_SKIP +
I think you can drop this.. we use (_reg)+1 so that a zero value in the table can be interpreted as a skip. That was one small diff from how the downstream driver does it.
BR,
-R
Quoted 58 lines
drivers/gpu/drm/msm/adreno/adreno_gpu.h +20
-2/** * adreno_regs: List of registers that are used in across all * 3D devices. Each device type has different offset value for the same @@ -36,7 +39,9 @@*/ enum adreno_regs {REG_ADRENO_CP_RB_BASE , +REG_ADRENO_CP_RB_BASE_HI ,REG_ADRENO_CP_RB_RPTR_ADDR , +REG_ADRENO_CP_RB_RPTR_ADDR_HI ,REG_ADRENO_CP_RB_RPTR ,REG_ADRENO_CP_RB_WPTR ,REG_ADRENO_CP_RB_CNTL ,@@ -250,7 +255,7 @@ OUT_PKT7(struct msm_ringbuffer *ring, uint8_t opcode, uint16_t cnt) }/* -* adreno_checkreg_off() - Checks the validity of a register enum +* adreno_reg_check() - Checks the validity of a register enum * @gpu: Pointer to struct adreno_gpu * @offset_name: The register enum that is checked */ @@ -261,6 +266,16 @@ static inline bool adreno_reg_check(struct adreno_gpu *gpu, !gpu->reg_offsets[offset_name]) {BUG (); } + +/* +* REG_SKIP is a special value that tell us that the register in +* question isn't implemented on target but don't trigger a BUG(). This +* is used to cleanly implement adreno_gpu_write64() and +* adreno_gpu_read64() in a generic fashion +*/ +if (gpu->reg_offsets[offset_name] ==REG_SKIP ) +return false; +return true; }@@ -282,4 +297,11 @@ static inline void adreno_gpu_write(struct adreno_gpu *gpu, gpu_write(&gpu->base, reg - 1, data); } +static inline void adreno_gpu_write64 (struct adreno_gpu *gpu, +enum adreno_regs lo,enum adreno_regs hi,u64 data) +{ +adreno_gpu_write (gpu, lo,lower_32_bits (data)); +adreno_gpu_write (gpu, hi,upper_32_bits (data)); +} +#endif /* __ADRENO_GPU_H__ */ --1.9.1
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 8/16 drm/msm: Remove 'src_clk' from adreno configuration
In reply to a message not in the archiveThe adreno code inherited a silly workaround from downstream from the bad old days before decent clock control. grp_clk[0] (named 'src_clk') doesn't actually exist - it was used as a proxy for whatever the core clock actually was (usually 'core_clk').
All targets should be able to correctly request 'core_clk' and get the right thing back so zap the anachronism and directly use grp_clk[0] to control the clock rate.
--- drivers/gpu/drm/msm/msm_gpu.c | 36 +++++++++++++----------------------- drivers/gpu/drm/msm/msm_gpu.h | 2 +- 2 files changed, 14 insertions(+), 24 deletions(-)
drivers/gpu/drm/msm/msm_gpu.c +13 -23
@@ -91,21 +91,16 @@ static int disable_pwrrail(struct msm_gpu *gpu)static int enable_clk (struct msm_gpu *gpu) { -struct clk *rate_clk =NULL ;int i; -/* NOTE: kgsl_pwrctrl_clk() ignores grp_clks[0].. */ -for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >0 ; i--) { -if (gpu->grp_clks[i]) { -clk_prepare (gpu->grp_clks[i]); - rate_clk = gpu->grp_clks[i]; - } - } +if (gpu->grp_clks[0 ] && gpu->fast_rate) +clk_set_rate (gpu->grp_clks[0 ], gpu->fast_rate); -if (rate_clk && gpu->fast_rate) -clk_set_rate (rate_clk, gpu->fast_rate); +for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >=0 ; i--) +if (gpu->grp_clks[i]) +clk_prepare (gpu->grp_clks[i]); -for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >0 ; i--) +for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >=0 ; i--)if (gpu->grp_clks[i])clk_enable (gpu->grp_clks[i]);
@@ -114,24 +109,19 @@ static int enable_clk(struct msm_gpu *gpu)static int disable_clk (struct msm_gpu *gpu) { -struct clk *rate_clk =NULL ;int i; -/* NOTE: kgsl_pwrctrl_clk() ignores grp_clks[0].. */ -for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >0 ; i--) { -if (gpu->grp_clks[i]) { +for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >=0 ; i--) +if (gpu->grp_clks[i])clk_disable (gpu->grp_clks[i]); - rate_clk = gpu->grp_clks[i]; - } - } -if (rate_clk && gpu->slow_rate) -clk_set_rate (rate_clk, gpu->slow_rate); - -for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >0 ; i--) +for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >=0 ; i--)if (gpu->grp_clks[i])clk_unprepare (gpu->grp_clks[i]); +if (gpu->grp_clks[0 ] && gpu->slow_rate) +clk_set_rate (gpu->grp_clks[0 ], gpu->slow_rate); +return 0 ; }
@@ -572,7 +562,7 @@ static irqreturn_t irq_handler(int irq, void *data) }static const char *clk_names[] = { -"src_clk" ,"core_clk" ,"iface_clk" ,"mem_clk" ,"mem_iface_clk" , +"core_clk" ,"iface_clk" ,"mem_clk" ,"mem_iface_clk" ,"alt_mem_iface_clk" , };
drivers/gpu/drm/msm/msm_gpu.h +1 -1
@@ -103,7 +103,7 @@ struct msm_gpu {/* Power Control: */ struct regulator *gpu_reg, *gpu_cx; -struct clk *ebi1_clk, *grp_clks[6 ]; +struct clk *ebi1_clk, *grp_clks[5 ];uint32_t fast_rate, slow_rate, bus_freq;#ifdef DOWNSTREAM_CONFIG_MSM_BUS_SCALING
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 9/16 drm/msm: gpu Add new gpu register read/write functions
In reply to a message not in the archiveAdd some new functions to manipulate GPU registers. gpu_read64 and gpu_write64 can read/write a 64 bit value to two 32 bit registers. For 4XX and older these are normally perfcounter registers, but future targets will use 64 bit addressing so there will be many more spots where a 64 bit read and write are needed.
gpu_rmw() does a read/modify/write on a 32 bit register given a mask and bits to OR in.
--- drivers/gpu/drm/msm/adreno/a4xx_gpu.c | 12 ++--------- drivers/gpu/drm/msm/msm_gpu.h | 39 +++++++++++++++++++++++++++++++++++ 2 files changed, 41 insertions(+), 10 deletions(-)
drivers/gpu/drm/msm/adreno/a4xx_gpu.c +2 -10
@@ -515,16 +515,8 @@ static int a4xx_pm_suspend(struct msm_gpu *gpu) {static int a4xx_get_timestamp (struct msm_gpu *gpu,uint64_t *value) { -uint32_t hi, lo, tmp; - - tmp =gpu_read (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_HI ); -do { - hi = tmp; - lo =gpu_read (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_LO ); - tmp =gpu_read (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_HI ); - }while (tmp != hi); - - *value = (((uint64_t )hi) <<32 ) | lo; + *value =gpu_read64 (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_LO , +REG_A4XX_RBBM_PERFCTR_CP_0_HI );return 0 ; }
drivers/gpu/drm/msm/msm_gpu.h +39 -0
@@ -154,6 +154,45 @@ static inline u32 gpu_read(struct msm_gpu *gpu, u32 reg)return msm_readl (gpu->mmio + (reg <<2 )); } +static inline void gpu_rmw (struct msm_gpu *gpu,u32 reg,u32 mask,u32 or) +{ +uint32_t val =gpu_read (gpu, reg); + + val &= ~mask; +gpu_write (gpu, reg, val | or); +} + +static inline u64 gpu_read64 (struct msm_gpu *gpu,u32 lo,u32 hi) +{ +u64 val; + +/* +* Why not a readq here? Two reasons: 1) many of the LO registers are +* not quad word aligned and 2) the GPU hardware designers have a bit +* of a history of putting registers where they fit, especially in +* spins. The longer a GPU family goes the higher the chance that +* we'll get burned. We could do a series of validity checks if we +* wanted to, but really is a readq() that much better? Nah. +*/ + +/* +* For some lo/hi registers (like perfcounters), the hi value is latched +* when the lo is read, so make sure to read the lo first to trigger +* that +*/ + val = (u64 )msm_readl (gpu->mmio + (lo <<2 )); + val |= ((u64 )msm_readl (gpu->mmio + (hi <<2 )) <<32 ); + +return val; +} + +static inline void gpu_write64 (struct msm_gpu *gpu,u32 lo,u32 hi,u64 val) +{ +/* Why not a writeq here? Read the screed above */ +msm_writel (lower_32_bits (val), gpu->mmio + (lo <<2 )); +msm_writel (upper_32_bits (val), gpu->mmio + (hi <<2 )); +} +int msm_gpu_pm_suspend (struct msm_gpu *gpu);int msm_gpu_pm_resume (struct msm_gpu *gpu);
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
A message that is not in the archive (sent off-list or not yet received): 1478299497-9729-10-git-send-email-jcrouse-sgV2jX0FEOL9JmXXK+q4OQ@public.gmane.org
Re: [PATCH 09/16] drm/msm: gpu Add new gpu register read/write functions
Quoted 25 lines · Jordan Crouse
Add some new functions to manipulate GPU registers.
gpu_read64andgpu_write64can read/write a 64 bit value to two 32 bit registers. For 4XX and older these are normally perfcounter registers, but future targets will use 64 bit addressing so there will be many more spots where a 64 bit read and write are needed.
gpu_rmw()does a read/modify/write on a 32 bit register given a mask and bits to OR in.Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/adreno/a4xx_gpu.c | 12 ++--------- drivers/gpu/drm/msm/msm_gpu.h | 39 +++++++++++++++++++++++++++++++++++ 2 files changed, 41 insertions(+), 10 deletions(-)drivers/gpu/drm/msm/adreno/a4xx_gpu.c +0
-2@@ -515,16 +515,8 @@ static int a4xx_pm_suspend(struct msm_gpu *gpu) {static int a4xx_get_timestamp (struct msm_gpu *gpu,uint64_t *value) { -uint32_t hi, lo, tmp; -
drivers/gpu/drm/msm/adreno/a4xx_gpu.c static int a4xx_pm_suspend(struct msm_gpu *gpu) { · line 519
Quoted 10 lines
drivers/gpu/drm/msm/adreno/a4xx_gpu.c +2
-8- tmp =gpu_read (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_HI ); -do { - hi = tmp; - lo =gpu_read (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_LO ); - tmp =gpu_read (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_HI ); - }while (tmp != hi); - - *value = (((uint64_t )hi) <<32 ) | lo; + *value =gpu_read64 (gpu,REG_A4XX_RBBM_PERFCTR_CP_0_LO , +REG_A4XX_RBBM_PERFCTR_CP_0_HI );
probably other places are ok to use gpu_read64, but I kinda think the timestamp counters should stay with the loop while(tmp!=hi)..
I guess if we were reading perfctrs in enough places, a special read_perfctr type fxn would be in order.
BR,
-R
Quoted 55 lines
drivers/gpu/drm/msm/adreno/a4xx_gpu.c +0
-0return 0 ; }drivers/gpu/drm/msm/msm_gpu.h +39
-1@@ -154,6 +154,45 @@ static inline u32 gpu_read(struct msm_gpu *gpu, u32 reg)return msm_readl (gpu->mmio + (reg <<2 )); } +static inline void gpu_rmw (struct msm_gpu *gpu,u32 reg,u32 mask,u32 or) +{ +uint32_t val =gpu_read (gpu, reg); + + val &= ~mask; +gpu_write (gpu, reg, val | or); +} + +static inline u64 gpu_read64 (struct msm_gpu *gpu,u32 lo,u32 hi) +{ +u64 val; + +/* +* Why not a readq here? Two reasons: 1) many of the LO registers are +* not quad word aligned and 2) the GPU hardware designers have a bit +* of a history of putting registers where they fit, especially in +* spins. The longer a GPU family goes the higher the chance that +* we'll get burned. We could do a series of validity checks if we +* wanted to, but really is a readq() that much better? Nah. +*/ + +/* +* For some lo/hi registers (like perfcounters), the hi value is latched +* when the lo is read, so make sure to read the lo first to trigger +* that +*/ + val = (u64 )msm_readl (gpu->mmio + (lo <<2 )); + val |= ((u64 )msm_readl (gpu->mmio + (hi <<2 )) <<32 ); + +return val; +} + +static inline void gpu_write64 (struct msm_gpu *gpu,u32 lo,u32 hi,u64 val) +{ +/* Why not a writeq here? Read the screed above */ +msm_writel (lower_32_bits (val), gpu->mmio + (lo <<2 )); +msm_writel (upper_32_bits (val), gpu->mmio + (hi <<2 )); +} +int msm_gpu_pm_suspend (struct msm_gpu *gpu);int msm_gpu_pm_resume (struct msm_gpu *gpu); --1.9.1
Quoted 4 lines
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
_______________________________________________
Freedreno mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 10/16 drm/msm: Disable interrupts during init
In reply to a message not in the archiveDisable the interrupt during the init sequence to avoid having interrupts fired for errors and other things that we are not ready to handle while initializing.
--- drivers/gpu/drm/msm/adreno/adreno_device.c | 4 ++++ drivers/gpu/drm/msm/adreno/adreno_gpu.c | 3 +++ 2 files changed, 7 insertions(+)
drivers/gpu/drm/msm/adreno/adreno_device.c +4 -0
@@ -148,12 +148,16 @@ struct msm_gpu *adreno_load_gpu(struct drm_device *dev)mutex_lock (&dev->struct_mutex); gpu->funcs->pm_resume (gpu);mutex_unlock (&dev->struct_mutex); + +disable_irq (gpu->irq); + ret = gpu->funcs->hw_init (gpu);if (ret) {dev_err (dev->dev,"gpu hw init failed: %d\n" , ret); gpu->funcs->destroy (gpu); gpu =NULL ; }else { +enable_irq (gpu->irq);/* give inactive pm a chance to kick in: */ msm_gpu_retire (gpu); }
drivers/gpu/drm/msm/adreno/adreno_gpu.c +3 -0
@@ -129,11 +129,14 @@ void adreno_recover(struct msm_gpu *gpu) adreno_gpu->memptrs->wptr =0 ; gpu->funcs->pm_resume (gpu); + +disable_irq (gpu->irq); ret = gpu->funcs->hw_init (gpu);if (ret) {dev_err (dev->dev,"gpu hw init failed: %d\n" , ret);/* hmm, oh well? */ } +enable_irq (gpu->irq); } void adreno_submit(struct msm_gpu *gpu, struct msm_gem_submit *submit,
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 13/16 drm/msm: gpu: Add support for the GPMU
In reply to a message not in the archiveMost 5XX targets have GPMU (Graphics Power Management Unit) that handles a lot of the heavy lifting for power management including thermal and limits management and dynamic power collapse. While the GPMU itself is optional, it is usually nessesary to hit aggressive power targets.
The GPMU firmware needs to be loaded into the GPMU at init time via a shared hardware block of registers. Using the GPU to write the microcode is more efficient than using the CPU so at first load create an indirect buffer that can be executed during subsequent initalization sequences.
After loading the GPMU gets initalized through a shared register interface and then we mostly get out of its way and let it do its thing.
--- drivers/gpu/drm/msm/Makefile | 1 + drivers/gpu/drm/msm/adreno/a5xx_gpu.c | 64 +++++- drivers/gpu/drm/msm/adreno/a5xx_gpu.h | 23 ++ drivers/gpu/drm/msm/adreno/a5xx_power.c | 341 +++++++++++++++++++++++++++++ drivers/gpu/drm/msm/adreno/adreno_device.c | 1 + drivers/gpu/drm/msm/adreno/adreno_gpu.h | 1 + 6 files changed, 428 insertions(+), 3 deletions(-) create mode 100644 drivers/gpu/drm/msm/adreno/a5xx_power.c
drivers/gpu/drm/msm/Makefile +1 -0
@@ -7,6 +7,7 @@ msm-y := \ adreno/a3xx_gpu.o \ adreno/a4xx_gpu.o \ adreno/a5xx_gpu.o \ + adreno/a5xx_power.o \ hdmi/hdmi.o \ hdmi/hdmi_audio.o \ hdmi/hdmi_bridge.o \
drivers/gpu/drm/msm/adreno/a5xx_gpu.c +61 -3
104 lines not on this page · raw message
drivers/gpu/drm/msm/adreno/a5xx_gpu.h +23 -0
@@ -30,8 +30,31 @@ struct a5xx_gpu {struct drm_gem_object *pfp_bo;uint32_t pfp_iova; + +struct drm_gem_object *gpmu_bo; +uint32_t gpmu_iova; +uint32_t gpmu_dwords; + + uint32_t lm_leakage; };#define to_a5xx_gpu (x) container_of(x, struct a5xx_gpu, base) +int a5xx_power_init (struct msm_gpu *gpu); +void a5xx_gpmu_ucode_init (struct msm_gpu *gpu); + +static inline int spin_usecs (struct msm_gpu *gpu,uint32_t usecs, +uint32_t reg,uint32_t mask,uint32_t value) +{ +while (usecs--) { +udelay (1 ); +if ((gpu_read (gpu, reg) & mask) == value) +return 0 ; +cpu_relax (); + } + +return -ETIMEDOUT ; +} + +#endif /* __A5XX_GPU_H__ */
drivers/gpu/drm/msm/adreno/a5xx_power.c new file +341 -0
341 lines not on this page · raw message
drivers/gpu/drm/msm/adreno/adreno_device.c +1 -0
@@ -86,6 +86,7 @@ static const struct adreno_info gpulist[] = { .pfpfw = "a530_pfp.fw", .gmem = SZ_1M, .init = a5xx_gpu_init, + .gpmufw = "a530v3_gpmu.fw2", }, };
drivers/gpu/drm/msm/adreno/adreno_gpu.h +1 -0
@@ -73,6 +73,7 @@ struct adreno_info {uint32_t revn;const char *name;const char *pm4fw, *pfpfw; +const char *gpmufw;uint32_t gmem;struct msm_gpu *(*init)(struct drm_device *dev); };
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
A message that is not in the archive (sent off-list or not yet received): 1478299497-9729-14-git-send-email-jcrouse-sgV2jX0FEOL9JmXXK+q4OQ@public.gmane.org
Re: [PATCH 13/16] drm/msm: gpu: Add support for the GPMU
Hi Jordan,
Quoted 26 lines · Jordan Crouse
Most 5XX targets have GPMU (Graphics Power Management Unit) that handles a lot of the heavy lifting for power management including thermal and limits management and dynamic power collapse. While the GPMU itself is optional, it is usually nessesary to hit aggressive power targets.
The GPMU firmware needs to be loaded into the GPMU at init time via a shared hardware block of registers. Using the GPU to write the microcode is more efficient than using the CPU so at first load create an indirect buffer that can be executed during subsequent initalization sequences.
After loading the GPMU gets initalized through a shared register interface and then we mostly get out of its way and let it do its thing.
Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/Makefile | 1 + drivers/gpu/drm/msm/adreno/a5xx_gpu.c | 64 +++++- drivers/gpu/drm/msm/adreno/a5xx_gpu.h | 23 ++ drivers/gpu/drm/msm/adreno/a5xx_power.c | 341 +++++++++++++++++++++++++++++ drivers/gpu/drm/msm/adreno/adreno_device.c | 1 + drivers/gpu/drm/msm/adreno/adreno_gpu.h | 1 + 6 files changed, 428 insertions(+), 3 deletions(-) create mode 100644 drivers/gpu/drm/msm/adreno/a5xx_power.c
<cut>
drivers/gpu/drm/msm/adreno/a5xx_power.c line 182
Quoted 12 lines
drivers/gpu/drm/msm/adreno/a5xx_power.c new file +12
-0+/* Enable the GPMU microcontroller */ +static int a5xx_gpmu_init (struct msm_gpu *gpu) +{ +struct adreno_gpu *adreno_gpu =to_adreno_gpu (gpu); +struct a5xx_gpu *a5xx_gpu =to_a5xx_gpu (adreno_gpu); +struct msm_ringbuffer *ring = gpu->rb; + +if (!a5xx_gpu->gpmu_dwords) +return 0 ; + +/* Turn off protected mode for this operation */ +OUT_PKT7 (ring,CP_SET_PROTECTED_MODE ,1 );
This looks wrong, shouldn't it be?
OUT_PKT7(ring, CP_SET_PROTECTED_MODE, 0)
Quoted 37 lines
drivers/gpu/drm/msm/adreno/a5xx_power.c new file +37
-0+OUT_RING (ring,0 ); + +/* Kick off the IB to load the GPMU microcode */ +OUT_PKT7 (ring,CP_INDIRECT_BUFFER_PFE ,3 ); +OUT_RING (ring,lower_32_bits (a5xx_gpu->gpmu_iova)); +OUT_RING (ring,upper_32_bits (a5xx_gpu->gpmu_iova)); +OUT_RING (ring, a5xx_gpu->gpmu_dwords); + +/* Turn back on protected mode */ +OUT_PKT7 (ring,CP_SET_PROTECTED_MODE ,1 ); +OUT_RING (ring,1 ); + + gpu->funcs->flush (gpu); + +if (!gpu->funcs->idle (gpu)) { +DRM_ERROR ("%s: Unable to load GPMU firmware. GPMU will not be active\n" , + gpu->name); +return -EINVAL ; + } + +gpu_write (gpu,REG_A5XX_GPMU_WFI_CONFIG ,0x4014 ); + +/* Kick off the GPMU */ +gpu_write (gpu,REG_A5XX_GPMU_CM3_SYSRESET ,0x0 ); + +/* +* Wait for the GPMU to respond. It isn't fatal if it doesn't, we just +* won't have advanced power collapse. +*/ +if (spin_usecs (gpu,25 ,REG_A5XX_GPMU_GENERAL_0 ,0xFFFFFFFF , +0xBABEFACE )) +DRM_ERROR ("%s: GPMU firmware initialization timed out\n" , + gpu->name); + +return 0 ; +} +
<cut>
Signature · 6 lines
regards, Stan _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
Re: [Freedreno] [PATCH 13/16] drm/msm: gpu: Add support for the GPMU
Quoted 4 lines · Stanimir Varbanov
Review
Quoted 2 lines
(quoted diff) +2
-0+ /* Turn off protected mode for this operation */ + OUT_PKT7(ring, CP_SET_PROTECTED_MODE, 1);This looks wrong, shouldn't it be?
no, it is actually correct, the 3rd arg is # of dwords of payload in the msg. So the payload of the CP_SET_PROTECTED_MODE packet is the following OUT_RING(ring, 0)
BR,
-R
Quoted 3 lines
OUT_PKT7(ring, CP_SET_PROTECTED_MODE, 0)Quoted 1 line
+
OUT_RING(ring, 0);
A message that is not in the archive (sent off-list or not yet received): CAF6AEGuW6ThJM-+X-=XGtqTCY_hcq8DghJHRf38OWjy4Z3R=DQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org
Re: [PATCH 13/16] drm/msm: gpu: Add support for the GPMU
Hi Rob,
Quoted 10 lines · Rob Clark
Quoted 4 lines · Stanimir Varbanov
Review
Quoted 2 lines
(quoted diff) +2
-0+ /* Turn off protected mode for this operation */ + OUT_PKT7(ring, CP_SET_PROTECTED_MODE, 1);This looks wrong, shouldn't it be?
no, it is actually correct, the 3rd arg is # of dwords of payload in the msg. So the payload of the
CP_SET_PROTECTED_MODEpacket is the followingOUT_RING(ring, 0)
Ahh, understood now. Sorry for the noise :)
Signature · 6 lines
regards, Stan _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
A message that is not in the archive (sent off-list or not yet received): 740c4fda-dfd6-7a70-9cb7-3eec6a5781ca-QSEj5FYQhm4dnm+yROfE0A@public.gmane.org
Re: [PATCH 13/16] drm/msm: gpu: Add support for the GPMU
Quoted 47 lines · Stanimir Varbanov
Hi Jordan,
Quoted 26 lines · Jordan Crouse
Most 5XX targets have GPMU (Graphics Power Management Unit) that handles a lot of the heavy lifting for power management including thermal and limits management and dynamic power collapse. While the GPMU itself is optional, it is usually nessesary to hit aggressive power targets.
The GPMU firmware needs to be loaded into the GPMU at init time via a shared hardware block of registers. Using the GPU to write the microcode is more efficient than using the CPU so at first load create an indirect buffer that can be executed during subsequent initalization sequences.
After loading the GPMU gets initalized through a shared register interface and then we mostly get out of its way and let it do its thing.
Signed-off-by Jordan Crouse <[email protected]>--- drivers/gpu/drm/msm/Makefile | 1 + drivers/gpu/drm/msm/adreno/a5xx_gpu.c | 64 +++++- drivers/gpu/drm/msm/adreno/a5xx_gpu.h | 23 ++ drivers/gpu/drm/msm/adreno/a5xx_power.c | 341 +++++++++++++++++++++++++++++ drivers/gpu/drm/msm/adreno/adreno_device.c | 1 + drivers/gpu/drm/msm/adreno/adreno_gpu.h | 1 + 6 files changed, 428 insertions(+), 3 deletions(-) create mode 100644 drivers/gpu/drm/msm/adreno/a5xx_power.c<cut>
drivers/gpu/drm/msm/adreno/a5xx_power.c line 182
Quoted 12 lines
drivers/gpu/drm/msm/adreno/a5xx_power.c new file +12
-0+/* Enable the GPMU microcontroller */ +static int a5xx_gpmu_init (struct msm_gpu *gpu) +{ +struct adreno_gpu *adreno_gpu =to_adreno_gpu (gpu); +struct a5xx_gpu *a5xx_gpu =to_a5xx_gpu (adreno_gpu); +struct msm_ringbuffer *ring = gpu->rb; + +if (!a5xx_gpu->gpmu_dwords) +return 0 ; + +/* Turn off protected mode for this operation */ +OUT_PKT7 (ring,CP_SET_PROTECTED_MODE ,1 );This looks wrong, shouldn't it be?
Quoted 1 line
OUT_PKT7(ring, CP_SET_PROTECTED_MODE, 0)
I admit this syntax can be really confusing. Opcode headers consist of a opcode and a payload size (and some other stuff you don't need to worry about). So this line is declaring opcode CP_SET_PROTETED_MODE with a payload length of 1 dword. The payload is either 0 (disable protected mode) or 1 (enable protected mode):
Quoted 1 line
drivers/gpu/drm/msm/adreno/a5xx_power.c line 183
Quoted 1 line
drivers/gpu/drm/msm/adreno/a5xx_power.c new file +1
-0+OUT_RING (ring,0 );
Here we disable.
Quoted 10 lines
drivers/gpu/drm/msm/adreno/a5xx_power.c line 193
Quoted 10 lines
drivers/gpu/drm/msm/adreno/a5xx_power.c new file +10
-0+ +/* Kick off the IB to load the GPMU microcode */ +OUT_PKT7 (ring,CP_INDIRECT_BUFFER_PFE ,3 ); +OUT_RING (ring,lower_32_bits (a5xx_gpu->gpmu_iova)); +OUT_RING (ring,upper_32_bits (a5xx_gpu->gpmu_iova)); +OUT_RING (ring, a5xx_gpu->gpmu_dwords); + +/* Turn back on protected mode */ +OUT_PKT7 (ring,CP_SET_PROTECTED_MODE ,1 ); +OUT_RING (ring,1 );
And here we re-enable.
Downstream uses inline functions for a lot of the common CP functions to avoid confusion like this - the problem with those is that you need to pass in the GPU and do a bunch of logic to get the right opcode for pre-A5XX and post-A5XX and I don't generally like those when you can just directly go to the ring with a minimum of fuss.
Jordan
Signature · 6 lines
The Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, a Linux Foundation Collaborative Project _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 15/16 drm/msm: Add a quick and dirty PIL loader
In reply to a message not in the archiveIn order to switch the GPU out of secure mode on most systems we need to load a zap shader into memory and get it authenticated and into the secure world. All the bits and pieces to do the load are scattered throughout the kernel, but we need to bring everything together.
Add a semi-custom loader that will read a MDT file and get it loaded and authenticated through SCM.
--- drivers/gpu/drm/msm/adreno/a5xx_gpu.c | 166 ++++++++++++++++++++++++++++++++++ 1 file changed, 166 insertions(+)
drivers/gpu/drm/msm/adreno/a5xx_gpu.c +166 -0
@@ -11,12 +11,178 @@* */ +#include <linux/elf.h> +#include <linux/types.h> +#include <linux/cpumask.h> +#include <linux/qcom_scm.h> +#include <linux/dma-mapping.h> +#include <linux/of_reserved_mem.h> #include "msm_gem.h" #include "a5xx_gpu.h" extern bool hang_debug;static void a5xx_dump (struct msm_gpu *gpu); +static inline bool _check_segment (const struct elf32_phdr *phdr) +{ +return ((phdr->p_type ==PT_LOAD ) && + ((phdr->p_flags & (7 <<24 )) != (2 <<24 )) && + phdr->p_memsz); +} + +static int __pil_tz_load_image (struct platform_device *pdev, +const struct firmware *mdt,const char *fwname, +void *fwptr,size_t fw_size,unsigned long fw_min_addr) +{ +char str[64 ] = {0 }; +const struct elf32_hdr *ehdr = (struct elf32_hdr *) mdt->data; +const struct elf32_phdr *phdrs = (struct elf32_phdr *) (ehdr +1 ); +const struct firmware *fw; +int i, ret =0 ; + +for (i =0 ; i < ehdr->e_phnum; i++) { +const struct elf32_phdr *phdr = &phdrs[i]; +size_t offset; + +/* Make sure the segment is loadable */ +if (!_check_segment (phdr)) +continue ; + +/* Get the offset of the segment within the region */ + offset = (phdr->p_paddr - fw_min_addr); + +/* Request the file containing the segment */ +snprintf (str,sizeof (str) -1 ,"%s.b%02d" , fwname, i); + + ret =request_firmware (&fw, str, &pdev->dev); +if (ret) { +dev_err (&pdev->dev,"Failed to load segment %s\n" , str); +break ; + } + +if (offset + fw->size > fw_size) { +dev_err (&pdev->dev,"Segment %s is too big\n" , str); + ret = -EINVAL ; +release_firmware (fw); +break ; + } + +/* Copy the segment into place */ +memcpy (fwptr + offset, fw->data, fw->size); +release_firmware (fw); + } + +return ret; +} + +static int _pil_tz_load_image (struct platform_device *pdev) +{ +char str[64 ] = {0 }; +const char *fwname; +const struct elf32_hdr *ehdr; +const struct elf32_phdr *phdrs; +const struct firmware *mdt; +phys_addr_t fw_min_addr, fw_max_addr; +dma_addr_t fw_phys; +size_t fw_size; +u32 pas_id; +void *ptr; +int i, ret; + +if (pdev ==NULL ) +return -ENODEV ; + +if (!qcom_scm_is_available ()) { +dev_err (&pdev->dev,"SCM is not available\n" ); +return -EINVAL ; + } + + ret =of_reserved_mem_device_init (&pdev->dev); + +if (ret) { +dev_err (&pdev->dev,"Unable to set up the reserved memory\n" ); +return ret; + } + +/* Get the firmware and PAS id from the device node */ +if (of_property_read_string (pdev->dev.of_node,"qcom,firmware" , + &fwname)) { +dev_err (&pdev->dev,"Could not read a firmware name\n" ); +return -EINVAL ; + } + +if (of_property_read_u32 (pdev->dev.of_node,"qcom,pas-id" , &pas_id)) { +dev_err (&pdev->dev,"Could not read the pas ID\n" ); +return -EINVAL ; + } + +snprintf (str,sizeof (str) -1 ,"%s.mdt" , fwname); + +/* Request the MDT file for the firmware */ + ret =request_firmware (&mdt, str, &pdev->dev); +if (ret) { +dev_err (&pdev->dev,"Unable to load %s\n" , str); +return ret; + } + + ehdr = (struct elf32_hdr *) mdt->data; + phdrs = (struct elf32_phdr *) (ehdr +1 ); + +/* Get the extents of the firmware image */ + + fw_min_addr = (phys_addr_t )ULLONG_MAX ; + fw_max_addr =0 ; + +for (i =0 ; i < ehdr->e_phnum; i++) { +const struct elf32_phdr *phdr = &phdrs[i]; + +if (!_check_segment (phdr)) +continue ; + + fw_min_addr =min_t (phys_addr_t, fw_min_addr, phdr->p_paddr); + fw_max_addr =max_t (phys_addr_t, fw_max_addr, +PAGE_ALIGN (phdr->p_paddr + phdr->p_memsz)); + } + +if (fw_min_addr == (phys_addr_t )ULLONG_MAX && fw_max_addr ==0 ) + goto out; + + fw_size = (size_t ) (fw_max_addr - fw_min_addr); + +/* Verify the MDT header */ + ret =qcom_scm_pas_init_image (pas_id, mdt->data, mdt->size); +if (ret) { +dev_err (&pdev->dev,"Invalid firmware metadata\n" ); + goto out; + } + +/* allocate some memory */ + ptr =dma_alloc_coherent (&pdev->dev, fw_size, &fw_phys,GFP_KERNEL ); +if (ptr ==NULL ) + goto out; + +/* Set up the newly allocated memory region */ + ret =qcom_scm_pas_mem_setup (pas_id, fw_phys, fw_size); +if (ret) { +dev_err (&pdev->dev,"Unable to set up firmware memory\n" ); + goto out; + } + + ret =__pil_tz_load_image (pdev, mdt, fwname, ptr, fw_size, fw_min_addr); +if (!ret) { + ret =qcom_scm_pas_auth_and_reset (pas_id); +if (ret) +dev_err (&pdev->dev,"Unable to authorize the image\n" ); + } + +out: +if (ret && ptr) +dma_free_coherent (&pdev->dev, fw_size, ptr, fw_phys); + +release_firmware (mdt); +return ret; +} +static void a5xx_submit (struct msm_gpu *gpu,struct msm_gem_submit *submit,struct msm_file_private *ctx) {
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 16/16 drm/msm: gpu: Use the zap shader on 5XX if we can
In reply to a message not in the archiveThe A5XX GPU powers on in "secure" mode. In secure mode the GPU can only render to buffers that are marked as secure and inaccessible to the kernel and user through a series of hardware protections. In practice secure mode is used to draw things like a UI on a secure video frame.
In order to switch out of secure mode the GPU executes a special shader that clears out the GMEM and other sensitve registers and then writes a register. Because the kernel can't be trusted the shader binary is signed and verified and programmed by the secure world. To do this we need to read the MDT header and the segments from the firmware location and put them in memory and present them for approval.
For targets without secure support there is an out: if the secure world doesn't support secure then there are no hardware protections and we can freely write the SECVID_TRUST register from the CPU. We don't have 100% confidence that we can query the secure capabilities at run time but we have enough calls that need to go right to give us some confidence that we're at least doing something useful.
Of course if we guess wrong you trigger a permissions violation which usually ends up in a system crash but thats a problem that shows up immediately.
--- arch/arm64/boot/dts/qcom/msm8996.dtsi | 20 ++++++++++ drivers/gpu/drm/msm/adreno/a5xx_gpu.c | 72 ++++++++++++++++++++++++++++++++++- 2 files changed, 90 insertions(+), 2 deletions(-)
arch/arm64/boot/dts/qcom/msm8996.dtsi +20 -0
@@ -133,6 +133,18 @@ method = "smc"; }; + reserved-memory { + #address-cells = <2>; + #size-cells = <2>; + ranges; + + peripheral_reserved: peripheral_region@8ea00000 { + compatible = "shared-dma-pool"; + reg = <0 0x8ea00000 0 0x2b00000>; + no-map; + }; + }; + soc: soc { #address-cells = <1>; #size-cells = <1>;
@@ -543,6 +555,14 @@ qcom,gpu-freq = <27000000>; }; }; + + qcom,zap-shader { + compatible = "qcom,zap-shader"; + memory-region = <&peripheral_reserved>; + + qcom,firmware = "a530_zap"; + qcom,pas-id = <13>; + }; }; mdp_smmu: arm,smmu@d00000 {
drivers/gpu/drm/msm/adreno/a5xx_gpu.c +70 -2
84 lines not on this page · raw message
Signature · 6 lines
1.9.1 _______________________________________________ Freedreno mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/freedreno
PATCH 11/16 arm64: dts: Add Adreno GPU and GPU smmu definitions
In reply to Jordan CrouseAdd an initial node for the Adreno GPU and it's companion SMMU. The GPU node is mostly complete except for a bare bones power table that will be filled out more completely later.
--- arch/arm64/boot/dts/qcom/msm8996.dtsi | 78 +++++++++++++++++++++++++++++++++++ 1 file changed, 78 insertions(+)
arch/arm64/boot/dts/qcom/msm8996.dtsi +78 -0
@@ -467,6 +467,84 @@ }; }; + adreno_smmu: arm,smmu@b40000 { + compatible = "arm,smmu-v2"; + reg = <0xb40000 0x10000>; + + #global-interrupts = <1>; + interrupts = <0 334 0>, + <0 329 0>, + <0 330 0>; + #iommu-cells = <1>; + + clocks = <&mmcc MMSS_MMAGIC_AHB_CLK>, + <&mmcc MMSS_MMAGIC_CFG_AHB_CLK>, + <&mmcc GPU_AHB_CLK>, + <&gcc GCC_MMSS_BIMC_GFX_CLK>, + <&gcc GCC_BIMC_GFX_CLK>, + <&mmcc MMSS_MISC_AHB_CLK>; + clock-names = "mmagic_ahb_clk", + "mmagic_cfg_ahb_clk", + "gpu_ahb_clk", + "gcc_mmss_bimc_gfx_clk", + "gcc_bimc_gfx_clk", + "mmss_misc_bus_clk"; + + power-domains = <&mmcc GPU_GDSC>; + + qcom,skip-init; + qcom,register-save; + + status = "okay"; + }; + + adreno-3xx@b00000 { + compatible = "qcom,adreno-3xx"; + #stream-id-cells = <16>; + + reg = <0xb00000 0x3f000>; + reg-names = "kgsl_3d0_reg_memory"; + + interrupts = <0 300 0>; + interrupt-names = "kgsl_3d0_irq"; + + clocks = <&mmcc GPU_GX_GFX3D_CLK>, + <&mmcc GPU_AHB_CLK>, + <&mmcc GPU_GX_RBBMTIMER_CLK>, + <&gcc GCC_BIMC_GFX_CLK>, + <&gcc GCC_MMSS_BIMC_GFX_CLK>, + <&mmcc MMSS_MMAGIC_AHB_CLK>; + + clock-names = "core_clk", + "iface_clk", + "rbbmtimer_clk", + "mem_clk", + "mem_iface_clk", + "alt_mem_iface_clk"; + + power-domains = <&mmcc GPU_GDSC>; + iommus = <&adreno_smmu 0>; + + /* There are patchlevel 3 chips in the world (Snapdragon + * (820) but they are functionally similar to the 821 in + * the code so we can safely set the chipset as + * patchlevel 4. */ + qcom,chipid = <0x05030004>; + + /* This is a safe speed for bring up in all bin levels. + * This isn't the fastest the chip can go, but we can + * get there eventually */ + qcom,gpu-pwrlevels { + compatible = "qcom,gpu-pwrlevels"; + qcom,gpu-pwrlevel@0 { + qcom,gpu-freq = <205000000>; + }; + qcom,gpu-pwrlevel@1 { + qcom,gpu-freq = <27000000>; + }; + }; + }; + mdp_smmu: arm,smmu@d00000 { compatible = "arm,smmu-v2"; reg = <0xd00000 0x10000>;
Signature · 1 line
1.9.1
PATCH 12/16 drm/msm: gpu: Add A5XX target support
In reply to Jordan CrouseAdd support for the A5XX family of Adreno GPUs.
--- drivers/gpu/drm/msm/Makefile | 1 + drivers/gpu/drm/msm/adreno/a5xx_gpu.c | 820 +++++++++++++++++++++++++++++ drivers/gpu/drm/msm/adreno/a5xx_gpu.h | 37 ++ drivers/gpu/drm/msm/adreno/adreno_device.c | 25 +- drivers/gpu/drm/msm/adreno/adreno_gpu.c | 6 +- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 40 ++ drivers/gpu/drm/msm/msm_gpu.c | 11 +- drivers/gpu/drm/msm/msm_gpu.h | 2 +- 8 files changed, 934 insertions(+), 8 deletions(-) create mode 100644 drivers/gpu/drm/msm/adreno/a5xx_gpu.c create mode 100644 drivers/gpu/drm/msm/adreno/a5xx_gpu.h
drivers/gpu/drm/msm/Makefile +1 -0
@@ -6,6 +6,7 @@ msm-y := \ adreno/adreno_gpu.o \ adreno/a3xx_gpu.o \ adreno/a4xx_gpu.o \ + adreno/a5xx_gpu.o \ hdmi/hdmi.o \ hdmi/hdmi_audio.o \ hdmi/hdmi_bridge.o \
drivers/gpu/drm/msm/adreno/a5xx_gpu.c new file +820 -0
820 lines not on this page · raw message
drivers/gpu/drm/msm/adreno/a5xx_gpu.h new file +37 -0
@@ -0,0 +1,37 @@ +/* Copyright (c) 2016 The Linux Foundation. All rights reserved. +* +* This program is free software; you can redistribute it and/or modify +* it under the terms of the GNU General Public License version 2 and +* only version 2 as published by the Free Software Foundation. +* +* This program is distributed in the hope that it will be useful, +* but WITHOUT ANY WARRANTY; without even the implied warranty of +* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +* GNU General Public License for more details. +* +*/ +#ifndef __A5XX_GPU_H__ +#define __A5XX_GPU_H__ + +#include "adreno_gpu.h" + +/* Bringing over the hack from the previous targets */ +#undef ROP_COPY +#undef ROP_XOR + +#include "a5xx.xml.h" + +struct a5xx_gpu { +struct adreno_gpu base; +struct platform_device *pdev; + +struct drm_gem_object *pm4_bo; +uint32_t pm4_iova; + +struct drm_gem_object *pfp_bo; +uint32_t pfp_iova; +}; + +#define to_a5xx_gpu (x) container_of(x, struct a5xx_gpu, base) + +#endif /* __A5XX_GPU_H__ */
drivers/gpu/drm/msm/adreno/adreno_device.c +24 -1
@@ -27,6 +27,7 @@ module_param_named(hang_debug, hang_debug, bool, 0600);struct msm_gpu *a3xx_gpu_init (struct drm_device *dev);struct msm_gpu *a4xx_gpu_init (struct drm_device *dev); +struct msm_gpu *a5xx_gpu_init (struct drm_device *dev);static const struct adreno_info gpulist[] = { {
@@ -77,6 +78,14 @@ static const struct adreno_info gpulist[] = { .pfpfw = "a420_pfp.fw", .gmem = (SZ_1M + SZ_512K), .init = a4xx_gpu_init, + }, { + .rev = ADRENO_REV(5, 3, 0, ANY_ID), + .revn = 530, + .name = "A530", + .pm4fw = "a530_pm4.fw", + .pfpfw = "a530_pfp.fw", + .gmem = SZ_1M, + .init = a5xx_gpu_init, }, };
@@ -86,6 +95,8 @@ MODULE_FIRMWARE("a330_pm4.fw");MODULE_FIRMWARE ("a330_pfp.fw" );MODULE_FIRMWARE ("a420_pm4.fw" );MODULE_FIRMWARE ("a420_pfp.fw" ); +MODULE_FIRMWARE ("a530_fm4.fw" ); +MODULE_FIRMWARE ("a530_pfp.fw" );static inline bool _rev_match (uint8_t entry,uint8_t id) {
@@ -173,12 +184,20 @@ static void set_gpu_pdev(struct drm_device *dev, priv->gpu_pdev = pdev; } +static const struct { +const char *str; +uint32_t flag; +} quirks[] = { + {"qcom,gpu-quirk-two-pass-use-wfi" ,ADRENO_QUIRK_TWO_PASS_USE_WFI }, + {"qcom,gpu-quirk-fault-detect-mask" ,ADRENO_QUIRK_FAULT_DETECT_MASK }, +}; +static int adreno_bind (struct device *dev,struct device *master,void *data) {static struct adreno_platform_config config = {};struct device_node *child, *node = dev->of_node;u32 val; -int ret; +int ret, i; ret =of_property_read_u32 (node,"qcom,chipid" , &val);if (ret) {
@@ -212,6 +231,10 @@ static int adreno_bind(struct device *dev, struct device *master, void *data)return -ENXIO ; } +for (i =0 ; i <ARRAY_SIZE (quirks); i++) +if (of_property_read_bool (node, quirks[i].str)) + config.quirks |= quirks[i].flag; + dev->platform_data = &config;set_gpu_pdev (dev_get_drvdata (master),to_platform_device (dev));return 0 ;
drivers/gpu/drm/msm/adreno/adreno_gpu.c +2 -4
@@ -22,7 +22,7 @@#include "msm_mmu.h" #define RB_SIZE SZ_32K -#define RB_BLKSIZE 16 +#define RB_BLKSIZE 32int adreno_get_param (struct msm_gpu *gpu,uint32_t param,uint64_t *value) {
@@ -54,9 +54,6 @@ int adreno_get_param(struct msm_gpu *gpu, uint32_t param, uint64_t *value) } } -#define rbmemptr (adreno_gpu, member) \ - ((adreno_gpu)->memptrs_iova + offsetof(struct adreno_rbmemptrs, member)) -int adreno_hw_init (struct msm_gpu *gpu) {struct adreno_gpu *adreno_gpu =to_adreno_gpu (gpu);
@@ -355,6 +352,7 @@ int adreno_gpu_init(struct drm_device *drm, struct platform_device *pdev, adreno_gpu->gmem = adreno_gpu->info->gmem; adreno_gpu->revn = adreno_gpu->info->revn; adreno_gpu->rev = config->rev; + adreno_gpu->quirks = config->quirks; gpu->fast_rate = config->fast_rate; gpu->slow_rate = config->slow_rate;
drivers/gpu/drm/msm/adreno/adreno_gpu.h +40 -0
@@ -48,6 +48,11 @@ enum adreno_regs { REG_ADRENO_REGISTER_MAX, }; +enum adreno_quirks { +ADRENO_QUIRK_TWO_PASS_USE_WFI =1 , +ADRENO_QUIRK_FAULT_DETECT_MASK =2 , +}; +struct adreno_rev {uint8_t core;uint8_t major;
@@ -74,6 +79,9 @@ struct adreno_info {const struct adreno_info *adreno_info (struct adreno_rev rev); +#define rbmemptr (adreno_gpu, member) \ + ((adreno_gpu)->memptrs_iova + offsetof(struct adreno_rbmemptrs, member)) +struct adreno_rbmemptrs {volatile uint32_t rptr;volatile uint32_t wptr;
@@ -107,6 +115,8 @@ struct adreno_gpu {* code (a3xx_gpu.c) and stored in this common location. */ const unsigned int *reg_offsets; + +uint32_t quirks; };#define to_adreno_gpu (x) container_of(x, struct adreno_gpu, base)
@@ -117,6 +127,7 @@ struct adreno_platform_config {#ifdef DOWNSTREAM_CONFIG_MSM_BUS_SCALING struct msm_bus_scale_pdata *bus_scale_table;#endif +uint32_t quirks; };#define ADRENO_IDLE_TIMEOUT msecs_to_jiffies(1000)
@@ -180,6 +191,11 @@ static inline int adreno_is_a430(struct adreno_gpu *gpu)return gpu->revn ==430 ; } +static inline int adreno_is_a530 (struct adreno_gpu *gpu) +{ +return gpu->revn ==530 ; +} +int adreno_get_param (struct msm_gpu *gpu,uint32_t param,uint64_t *value);int adreno_hw_init (struct msm_gpu *gpu);uint32_t adreno_last_fence (struct msm_gpu *gpu);
@@ -304,4 +320,28 @@ static inline void adreno_gpu_write64(struct adreno_gpu *gpu, adreno_gpu_write(gpu, hi, upper_32_bits(data)); } +/* +* Given a register and a count, return a value to program into +* REG_CP_PROTECT_REG(n) - this will block both reads and writes for _len +* registers starting at _reg. +* +* The register base needs to be a multiple of the length. If it is not, the +* hardware will quietly mask off the bits for you and shift the size. For +* example, if you intend the protection to start at 0x07 for a length of 4 +* (0x07-0x0A) the hardware will actually protect (0x04-0x07) which might +* expose registers you intended to protect! +*/ +#define ADRENO_PROTECT_RW (_reg, _len) \ + ((1 << 30) | (1 << 29) | \ + ((ilog2((_len)) & 0x1F) << 24) | (((_reg) << 2) & 0xFFFFF)) + +/* +* Same as above, but allow reads over the range. For areas of mixed use (such +* as performance counters) this allows us to protect a much larger range with a +* single register +*/ +#define ADRENO_PROTECT_RDONLY (_reg, _len) \ + ((1 << 29) \ + ((ilog2((_len)) & 0x1F) << 24) | (((_reg) << 2) & 0xFFFFF)) +#endif /* __ADRENO_GPU_H__ */
drivers/gpu/drm/msm/msm_gpu.c +9 -2
@@ -96,6 +96,10 @@ static int enable_clk(struct msm_gpu *gpu)if (gpu->grp_clks[0 ] && gpu->fast_rate)clk_set_rate (gpu->grp_clks[0 ], gpu->fast_rate); +/* Set the RBBM timer rate to 19.2Mhz */ +if (gpu->grp_clks[2 ]) +clk_set_rate (gpu->grp_clks[2 ],19200000 ); +for (i =ARRAY_SIZE (gpu->grp_clks) -1 ; i >=0 ; i--)if (gpu->grp_clks[i])clk_prepare (gpu->grp_clks[i]);
@@ -122,6 +126,9 @@ static int disable_clk(struct msm_gpu *gpu)if (gpu->grp_clks[0 ] && gpu->slow_rate)clk_set_rate (gpu->grp_clks[0 ], gpu->slow_rate); +if (gpu->grp_clks[2 ]) +clk_set_rate (gpu->grp_clks[2 ],0 ); +return 0 ; }
@@ -562,8 +569,8 @@ static irqreturn_t irq_handler(int irq, void *data) }static const char *clk_names[] = { -"core_clk" ,"iface_clk" ,"mem_clk" ,"mem_iface_clk" , -"alt_mem_iface_clk" , +"core_clk" ,"iface_clk" ,"rbbmtimer_clk" ,"mem_clk" , +"mem_iface_clk" ,"alt_mem_iface_clk" , }; int msm_gpu_init(struct drm_device *drm, struct platform_device *pdev,
drivers/gpu/drm/msm/msm_gpu.h +1 -1
@@ -103,7 +103,7 @@ struct msm_gpu {/* Power Control: */ struct regulator *gpu_reg, *gpu_cx; -struct clk *ebi1_clk, *grp_clks[5 ]; +struct clk *ebi1_clk, *grp_clks[6 ];uint32_t fast_rate, slow_rate, bus_freq;#ifdef DOWNSTREAM_CONFIG_MSM_BUS_SCALING
Signature · 1 line
1.9.1
PATCH 14/16 firmware: qcom_scm: Add qcom_scm_gpu_zap_resume()
In reply to Jordan CrouseAdd an interface to trigger the remote processor to reinitialize the GPU zap shader on power-up.
--- drivers/firmware/qcom_scm-32.c | 5 +++++ drivers/firmware/qcom_scm-64.c | 15 +++++++++++++++ drivers/firmware/qcom_scm.c | 6 ++++++ drivers/firmware/qcom_scm.h | 2 ++ include/linux/qcom_scm.h | 2 ++ 5 files changed, 30 insertions(+)
drivers/firmware/qcom_scm-32.c +5 -0
@@ -560,3 +560,8 @@ int __qcom_scm_pas_mss_reset(struct device *dev, bool reset)return ret ? :le32_to_cpu (out); } + +int __qcom_scm_gpu_zap_resume (struct device *dev) +{ +return -ENOTSUPP ; +}
drivers/firmware/qcom_scm-64.c +15 -0
@@ -358,3 +358,18 @@ int __qcom_scm_pas_mss_reset(struct device *dev, bool reset)return ret ? : res.a1; } + +int __qcom_scm_gpu_zap_resume (struct device *dev) +{ +struct qcom_scm_desc desc = {0 }; +struct arm_smccc_res res; +int ret; + + desc.args[0 ] =0 ; + desc.args[1 ] =13 ; + desc.arginfo =QCOM_SCM_ARGS (2 ); + + ret =qcom_scm_call (dev,QCOM_SCM_SVC_BOOT ,0x0A , &desc, &res); + +return ret ? : res.a1; +}
drivers/firmware/qcom_scm.c +6 -0
@@ -308,6 +308,12 @@ static const struct reset_control_ops qcom_scm_pas_reset_ops = { .deassert = qcom_scm_pas_reset_deassert, }; +int qcom_scm_gpu_zap_resume (void ) +{ +return __qcom_scm_gpu_zap_resume (__scm->dev); +} +EXPORT_SYMBOL (qcom_scm_gpu_zap_resume); +/** * qcom_scm_is_available() - Checks if SCM is available */
drivers/firmware/qcom_scm.h +2 -0
@@ -56,6 +56,8 @@ extern int __qcom_scm_pas_auth_and_reset(struct device *dev, u32 peripheral);extern int __qcom_scm_pas_shutdown (struct device *dev,u32 peripheral);extern int __qcom_scm_pas_mss_reset (struct device *dev,bool reset); +extern int __qcom_scm_gpu_zap_resume (struct device *dev); +/* common error codes */ #define QCOM_SCM_V2_EBUSY -12#define QCOM_SCM_ENOMEM -5
include/linux/qcom_scm.h +2 -0
@@ -37,6 +37,8 @@ extern int qcom_scm_pas_mem_setup(u32 peripheral, phys_addr_t addr,extern int qcom_scm_pas_auth_and_reset (u32 peripheral);extern int qcom_scm_pas_shutdown (u32 peripheral); +extern int qcom_scm_gpu_zap_resume (void ); +#define QCOM_SCM_CPU_PWR_DOWN_L2_ON 0x0#define QCOM_SCM_CPU_PWR_DOWN_L2_OFF 0x1
Signature · 1 line
1.9.1
Quoted 9 lines · Jordan Crouse
Here is the first blast of patches for support for the fine family of Adreno A5XX GPUs. These are designed to work against Rob's version of the Linaro target tree with some additional 8996 clock stuff added in:
https://github.com/freedreno/kernel-msm/tree/a5xx
In addition, you will also need these SCM changes for the last three patches to work:
Quoted 12 lines
https://patchwork.kernel.org/patch/9291593/ arm64: kernel: Add SMC Session ID to results
https://patchwork.kernel.org/patch/9291595/ firmware: qcom: scm: Fix interrupted SCM calls
https://patchwork.kernel.org/patch/9353735/ firmware: qcom: scm: Fix interrupted SCM calls fully
https://patchwork.codeaurora.org/patch/109673/ dt-bindings: firmware: scm: Add MSM8996 DT bindings
https://patchwork.codeaurora.org/patch/109675/ firmware: qcom: scm: Remove core, iface and bus clocks dependency
https://patchwork.codeaurora.org/patch/109671/ firmware: qcom: scm: ReturnPTR_ERRwhendevm_clk_getfails
Note, you'll also want this to add the SCM DT bindings:
https://patchwork.codeaurora.org/patch/106901/
Jordan
Signature · 2 lines
The Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, a Linux Foundation Collaborative Project