staging: android: ion: Restrict cache maintenance to dma mapped memory
PATCH 1/1 staging: android: ion: Restrict cache maintenance to dma mapped memory
The ION begin_cpu_access and end_cpu_access functions use the dma_sync_sg_for_cpu and dma_sync_sg_for_device APIs to perform cache maintenance.
Currently it is possible to apply cache maintenance, via the begin_cpu_access and end_cpu_access APIs, to ION buffers which are not dma mapped.
The dma sync sg APIs should not be called on sg lists which have not been dma mapped as this can result in cache maintenance being applied to the wrong address. If an sg list has not been dma mapped then its dma_address field has not been populated, some dma ops such as the swiotlb_dma_ops ops use the dma_address field to calculate the address onto which to apply cache maintenance.
Fix the ION begin_cpu_access and end_cpu_access functions to only apply cache maintenance to buffers which have been dma mapped.
--- drivers/staging/android/ion/ion.c | 16 ++++++++++++---- 1 file changed, 12 insertions(+), 4 deletions(-)
drivers/staging/android/ion/ion.c +12 -4
@@ -214,6 +214,7 @@ struct ion_dma_buf_attachment {struct device *dev;struct sg_table *table;struct list_head list; +bool dma_mapped; }; static int ion_dma_buf_attach(struct dma_buf *dmabuf, struct device *dev,
@@ -235,6 +236,7 @@ static int ion_dma_buf_attach(struct dma_buf *dmabuf, struct device *dev, a->table = table; a->dev = dev; + a->dma_mapped = false;INIT_LIST_HEAD (&a->list); attachment->priv = a;
@@ -272,6 +274,7 @@ static struct sg_table *ion_map_dma_buf(struct dma_buf_attachment *attachment, direction))return ERR_PTR (-ENOMEM ); + a->dma_mapped = true;return table; }
@@ -279,7 +282,10 @@ static void ion_unmap_dma_buf(struct dma_buf_attachment *attachment,struct sg_table *table, enum dma_data_direction direction) { + struct ion_dma_buf_attachment *a = attachment->priv; +dma_unmap_sg (attachment->dev, table->sgl, table->nents, direction); + a->dma_mapped = false; }static int ion_mmap (struct dma_buf *dmabuf,struct vm_area_struct *vma)
@@ -345,8 +351,9 @@ static int ion_dma_buf_begin_cpu_access(struct dma_buf *dmabuf,mutex_lock (&buffer->lock);list_for_each_entry (a, &buffer->attachments, list) { -dma_sync_sg_for_cpu (a->dev, a->table->sgl, a->table->nents, - direction); +if (a->dma_mapped) +dma_sync_sg_for_cpu (a->dev, a->table->sgl, + a->table->nents, direction); }mutex_unlock (&buffer->lock);
@@ -367,8 +374,9 @@ static int ion_dma_buf_end_cpu_access(struct dma_buf *dmabuf,mutex_lock (&buffer->lock);list_for_each_entry (a, &buffer->attachments, list) { -dma_sync_sg_for_device (a->dev, a->table->sgl, a->table->nents, - direction); +if (a->dma_mapped) +dma_sync_sg_for_device (a->dev, a->table->sgl, + a->table->nents, direction); }mutex_unlock (&buffer->lock);
Signature · 9 lines
1.8.5.2 Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, a Linux Foundation Collaborative Project _______________________________________________ devel mailing list [email protected] http://driverdev.linuxdriverproject.org/mailman/listinfo/driverdev-devel
Quoted 15 lines · Liam Mark
The ION
begin_cpu_accessandend_cpu_accessfunctions use thedma_sync_sg_for_cpuanddma_sync_sg_for_deviceAPIs to perform cache maintenance.Currently it is possible to apply cache maintenance, via the
begin_cpu_accessandend_cpu_accessAPIs, to ION buffers which are not dma mapped.The dma sync sg APIs should not be called on sg lists which have not been dma mapped as this can result in cache maintenance being applied to the wrong address. If an sg list has not been dma mapped then its
dma_addressfield has not been populated, some dma ops such as theswiotlb_dma_opsops use thedma_addressfield to calculate the address onto which to apply cache maintenance.
Quoted 3 lines
Fix the ION
begin_cpu_accessandend_cpu_accessfunctions to only apply cache maintenance to buffers which have been dma mapped.
I think this looks okay. I was initially concerned about concurrency and setting the dma_mapped flag but I think that should be handled by the caller synchronizing map/unmap/cpu_access calls (we might need to re-evaluate in the future)
I would like to hold on queuing this for just a little bit until I finish working on the Ion unit test (doing this in the complete opposite order of course). I'm assuming this passed your internal tests Liam?
Thanks,
Laura
Quoted 60 lines
Fixes 2a55e7b5e544 ("staging: android: ion: Call dma_map_sg for syncing and mapping")Signed-off-by Liam Mark <[email protected]>--- drivers/staging/android/ion/ion.c | 16 ++++++++++++---- 1 file changed, 12 insertions(+), 4 deletions(-)drivers/staging/android/ion/ion.c +9
-2@@ -214,6 +214,7 @@ struct ion_dma_buf_attachment {struct device *dev;caller struct sg_table *table;struct list_head list; +bool dma_mapped; }; static int ion_dma_buf_attach(struct dma_buf *dmabuf, struct device *dev,@@ -235,6 +236,7 @@ static int ion_dma_buf_attach(struct dma_buf *dmabuf, struct device *dev, a->table = table; a->dev = dev; + a->dma_mapped = false;INIT_LIST_HEAD (&a->list); attachment->priv = a;@@ -272,6 +274,7 @@ static struct sg_table *ion_map_dma_buf(struct dma_buf_attachment *attachment, direction))return ERR_PTR (-ENOMEM ); + a->dma_mapped = true;return table; }@@ -279,7 +282,10 @@ static void ion_unmap_dma_buf(struct dma_buf_attachment *attachment,struct sg_table *table, enum dma_data_direction direction) { + struct ion_dma_buf_attachment *a = attachment->priv; +dma_unmap_sg (attachment->dev, table->sgl, table->nents, direction); + a->dma_mapped = false; }static int ion_mmap (struct dma_buf *dmabuf,struct vm_area_struct *vma)@@ -345,8 +351,9 @@ static int ion_dma_buf_begin_cpu_access(struct dma_buf *dmabuf,mutex_lock (&buffer->lock);list_for_each_entry (a, &buffer->attachments, list) { -dma_sync_sg_for_cpu (a->dev, a->table->sgl, a->table->nents, - direction); +if (a->dma_mapped) +dma_sync_sg_for_cpu (a->dev, a->table->sgl, + a->table->nents, direction); }mutex_unlock (&buffer->lock);@@ -367,8 +374,9 @@ static int ion_dma_buf_end_cpu_access(struct dma_buf *dmabuf,
drivers/staging/android/ion/ion.c static int ion_dma_buf_end_cpu_access(struct dma_buf *dmabuf, · line 382
Quoted 10 lines
drivers/staging/android/ion/ion.c +3
-2mutex_lock (&buffer->lock);list_for_each_entry (a, &buffer->attachments, list) { -dma_sync_sg_for_device (a->dev, a->table->sgl, a->table->nents, - direction); +if (a->dma_mapped) +dma_sync_sg_for_device (a->dev, a->table->sgl, + a->table->nents, direction); }mutex_unlock (&buffer->lock);
_______________________________________________
devel mailing list
[email protected]
http://driverdev.linuxdriverproject.org/mailman/listinfo/driverdev-devel
Quoted 15 lines · Liam Mark
The ION
begin_cpu_accessandend_cpu_accessfunctions use thedma_sync_sg_for_cpuanddma_sync_sg_for_deviceAPIs to perform cache maintenance.Currently it is possible to apply cache maintenance, via the
begin_cpu_accessandend_cpu_accessAPIs, to ION buffers which are not dma mapped.The dma sync sg APIs should not be called on sg lists which have not been dma mapped as this can result in cache maintenance being applied to the wrong address. If an sg list has not been dma mapped then its
dma_addressfield has not been populated, some dma ops such as theswiotlb_dma_opsops use thedma_addressfield to calculate the address onto which to apply cache maintenance.
Quoted 3 lines
Fix the ION
begin_cpu_accessandend_cpu_accessfunctions to only apply cache maintenance to buffers which have been dma mapped.
I think this looks okay. I was initially concerned about concurrency and setting the dma_mapped flag but I think that should be handled by the caller synchronizing map/unmap/cpu_access calls (we might need to re-evaluate in the future)
I would like to hold on queuing this for just a little bit until I finish working on the Ion unit test (doing this in the complete opposite order of course). I'm assuming this passed your internal tests Liam?
Thanks,
Laura
Quoted 60 lines
Fixes 2a55e7b5e544 ("staging: android: ion: Call dma_map_sg for syncing and mapping")Signed-off-by Liam Mark <[email protected]>--- drivers/staging/android/ion/ion.c | 16 ++++++++++++---- 1 file changed, 12 insertions(+), 4 deletions(-)drivers/staging/android/ion/ion.c +9
-2@@ -214,6 +214,7 @@ struct ion_dma_buf_attachment {struct device *dev;caller struct sg_table *table;struct list_head list; +bool dma_mapped; }; static int ion_dma_buf_attach(struct dma_buf *dmabuf, struct device *dev,@@ -235,6 +236,7 @@ static int ion_dma_buf_attach(struct dma_buf *dmabuf, struct device *dev, a->table = table; a->dev = dev; + a->dma_mapped = false;INIT_LIST_HEAD (&a->list); attachment->priv = a;@@ -272,6 +274,7 @@ static struct sg_table *ion_map_dma_buf(struct dma_buf_attachment *attachment, direction))return ERR_PTR (-ENOMEM ); + a->dma_mapped = true;return table; }@@ -279,7 +282,10 @@ static void ion_unmap_dma_buf(struct dma_buf_attachment *attachment,struct sg_table *table, enum dma_data_direction direction) { + struct ion_dma_buf_attachment *a = attachment->priv; +dma_unmap_sg (attachment->dev, table->sgl, table->nents, direction); + a->dma_mapped = false; }static int ion_mmap (struct dma_buf *dmabuf,struct vm_area_struct *vma)@@ -345,8 +351,9 @@ static int ion_dma_buf_begin_cpu_access(struct dma_buf *dmabuf,mutex_lock (&buffer->lock);list_for_each_entry (a, &buffer->attachments, list) { -dma_sync_sg_for_cpu (a->dev, a->table->sgl, a->table->nents, - direction); +if (a->dma_mapped) +dma_sync_sg_for_cpu (a->dev, a->table->sgl, + a->table->nents, direction); }mutex_unlock (&buffer->lock);@@ -367,8 +374,9 @@ static int ion_dma_buf_end_cpu_access(struct dma_buf *dmabuf,
drivers/staging/android/ion/ion.c static int ion_dma_buf_end_cpu_access(struct dma_buf *dmabuf, · line 382
Quoted 10 lines
drivers/staging/android/ion/ion.c +3
-2mutex_lock (&buffer->lock);list_for_each_entry (a, &buffer->attachments, list) { -dma_sync_sg_for_device (a->dev, a->table->sgl, a->table->nents, - direction); +if (a->dma_mapped) +dma_sync_sg_for_device (a->dev, a->table->sgl, + a->table->nents, direction); }mutex_unlock (&buffer->lock);
_______________________________________________
devel mailing list
[email protected]
http://driverdev.linuxdriverproject.org/mailman/listinfo/driverdev-devel
Quoted 16 lines · Laura Abbott
Quoted 15 lines · Liam Mark
The ION
begin_cpu_accessandend_cpu_accessfunctions use thedma_sync_sg_for_cpuanddma_sync_sg_for_deviceAPIs to perform cache maintenance.Currently it is possible to apply cache maintenance, via the
begin_cpu_accessandend_cpu_accessAPIs, to ION buffers which are not dma mapped.The dma sync sg APIs should not be called on sg lists which have not been dma mapped as this can result in cache maintenance being applied to the wrong address. If an sg list has not been dma mapped then its
dma_addressfield has not been populated, some dma ops such as theswiotlb_dma_opsops use thedma_addressfield to calculate the address onto which to apply cache maintenance.
Quoted 7 lines
Quoted 3 lines
Fix the ION
begin_cpu_accessandend_cpu_accessfunctions to only apply cache maintenance to buffers which have been dma mapped.I think this looks okay. I was initially concerned about concurrency and setting the
dma_mappedflag but I think that should be handled by the caller synchronizing map/unmap/cpu_access calls (we might need to re-evaluate in the future)
I had convinced myself that concurrency wasn't a problem, but you are right it does need to be re-evaluated. For example the code could be at the point after the dma unmap call has completed but before dma_mapped has been set to false, and if userspace happened to slip in a call to begin/end cpu access cache maintenance would happen on memory which isn't dma mapped. So at least this would need to be addressed, maybe for this issue just move the setting of dma_mapped to the start of the ion_unmap_dma_buf function.
I can clean this up and any other concurrency issues we can identify.
Quoted 4 lines
I would like to hold on queuing this for just a little bit until I finish working on the Ion unit test (doing this in the complete opposite order of course). I'm assuming this passed your internal tests Liam?
Yes it has passed my internal ION unit tests, though I haven't given the change to internal ION clients yet.
Liam
Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, a Linux Foundation Collaborative Project
_______________________________________________
devel mailing list
[email protected]
http://driverdev.linuxdriverproject.org/mailman/listinfo/driverdev-devel