Move all drivers to a common dma-buf locking convention
Subsystems (23)
v2 cover Move all drivers to a common dma-buf locking convention
Hello,
This series moves all drivers to a dynamic dma-buf locking specification. From now on all dma-buf importers are made responsible for holding dma-buf's reservation lock around all operations performed over dma-bufs in accordance to the locking specification. This allows us to utilize reservation lock more broadly around kernel without fearing of a potential deadlocks.
This patchset passes all i915 selftests. It was also tested using VirtIO, Panfrost, Lima and Tegra drivers. I tested cases of display+GPU, display+V4L and GPU+V4L dma-buf sharing, which covers majority of kernel drivers since rest of the drivers share same or similar code paths.
Changelog:
v2: - Changed locking specification to avoid problems with a cross-driver
ww locking, like was suggested by Christian König. Now the attach/detach callbacks are invoked without the held lock and exporter should take the lock.
- Added "locking convention" documentation that explains which dma-buf functions and callbacks are locked/unlocked for importers and exporters, which was requested by Christian König.
- Added ack from Tomasz Figa to the V4L patches that he gave to v1.
Dmitry Osipenko (5):
dma-buf: Add _unlocked postfix to function names drm/gem: Take reservation lock for vmap/vunmap operations
dma-buf: Move all dma-bufs to dynamic locking specification
media: videobuf2: Stop using internal dma-buf lock
dma-buf: Remove internal lock
Documentation/driver-api/dma-buf.rst | 6 + drivers/dma-buf/dma-buf.c | 253 +++++++++++++----- drivers/gpu/drm/amd/amdgpu/amdgpu_dma_buf.c | 4 +- drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c | 4 +- drivers/gpu/drm/armada/armada_gem.c | 14 +- drivers/gpu/drm/drm_client.c | 4 +- drivers/gpu/drm/drm_gem.c | 24 ++ drivers/gpu/drm/drm_gem_cma_helper.c | 6 +- drivers/gpu/drm/drm_gem_framebuffer_helper.c | 6 +- drivers/gpu/drm/drm_gem_shmem_helper.c | 6 +- drivers/gpu/drm/drm_prime.c | 12 +- drivers/gpu/drm/etnaviv/etnaviv_gem_prime.c | 6 +- drivers/gpu/drm/exynos/exynos_drm_gem.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 14 +- .../drm/i915/gem/selftests/i915_gem_dmabuf.c | 20 +- drivers/gpu/drm/omapdrm/omap_gem_dmabuf.c | 8 +- drivers/gpu/drm/qxl/qxl_object.c | 17 +- drivers/gpu/drm/qxl/qxl_prime.c | 4 +- drivers/gpu/drm/tegra/gem.c | 27 +- drivers/infiniband/core/umem_dmabuf.c | 11 +- .../common/videobuf2/videobuf2-dma-contig.c | 26 +- .../media/common/videobuf2/videobuf2-dma-sg.c | 23 +- .../common/videobuf2/videobuf2-vmalloc.c | 17 +- .../platform/nvidia/tegra-vde/dmabuf-cache.c | 12 +- drivers/misc/fastrpc.c | 12 +- drivers/xen/gntdev-dmabuf.c | 14 +- include/drm/drm_gem.h | 3 + include/linux/dma-buf.h | 71 ++--- 28 files changed, 372 insertions(+), 254 deletions(-)
Signature · 1 line
2.36.1
PATCH v2 1/5 dma-buf: Add _unlocked postfix to function names
Add _unlocked postfix to the dma-buf API function names in a preparation to move all non-dynamic dma-buf users over to the dynamic locking specification. This patch only renames API functions, preparing drivers to the common locking convention. Later on we will make the "unlocked" functions to take the reservation lock.
--- drivers/dma-buf/dma-buf.c | 76 ++++++++++--------- drivers/gpu/drm/amd/amdgpu/amdgpu_dma_buf.c | 4 +- drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c | 4 +- drivers/gpu/drm/armada/armada_gem.c | 14 ++-- drivers/gpu/drm/drm_gem_cma_helper.c | 6 +- drivers/gpu/drm/drm_gem_shmem_helper.c | 6 +- drivers/gpu/drm/drm_prime.c | 12 +-- drivers/gpu/drm/etnaviv/etnaviv_gem_prime.c | 6 +- drivers/gpu/drm/exynos/exynos_drm_gem.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 12 +-- .../drm/i915/gem/selftests/i915_gem_dmabuf.c | 20 ++--- drivers/gpu/drm/omapdrm/omap_gem_dmabuf.c | 8 +- drivers/gpu/drm/tegra/gem.c | 27 +++---- drivers/infiniband/core/umem_dmabuf.c | 11 +-- .../common/videobuf2/videobuf2-dma-contig.c | 15 ++-- .../media/common/videobuf2/videobuf2-dma-sg.c | 12 +-- .../common/videobuf2/videobuf2-vmalloc.c | 6 +- .../platform/nvidia/tegra-vde/dmabuf-cache.c | 12 +-- drivers/misc/fastrpc.c | 12 +-- drivers/xen/gntdev-dmabuf.c | 14 ++-- include/linux/dma-buf.h | 34 +++++---- 21 files changed, 161 insertions(+), 152 deletions(-)
drivers/dma-buf/dma-buf.c +39 -37
@@ -795,7 +795,7 @@ static struct sg_table * __map_dma_buf(struct dma_buf_attachment *attach, }/** -* dma_buf_dynamic_attach - Add the device to dma_buf's attachments list +* dma_buf_dynamic_attach_unlocked - Add the device to dma_buf's attachments list * @dmabuf: [in] buffer to attach device to. * @dev: [in] device to be attached. * @importer_ops: [in] importer operations for the attachment
@@ -817,9 +817,9 @@ static struct sg_table * __map_dma_buf(struct dma_buf_attachment *attach,* indicated with the error code -EBUSY. */ struct dma_buf_attachment * -dma_buf_dynamic_attach (struct dma_buf *dmabuf,struct device *dev, -const struct dma_buf_attach_ops *importer_ops, -void *importer_priv) +dma_buf_dynamic_attach_unlocked (struct dma_buf *dmabuf,struct device *dev, +const struct dma_buf_attach_ops *importer_ops, +void *importer_priv) {struct dma_buf_attachment *attach;int ret;
@@ -892,25 +892,25 @@ dma_buf_dynamic_attach(struct dma_buf *dmabuf, struct device *dev,if (dma_buf_is_dynamic (attach->dmabuf))dma_resv_unlock (attach->dmabuf->resv); -dma_buf_detach (dmabuf, attach); +dma_buf_detach_unlocked (dmabuf, attach);return ERR_PTR (ret); } -EXPORT_SYMBOL_NS_GPL (dma_buf_dynamic_attach,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_dynamic_attach_unlocked,DMA_BUF );/** -* dma_buf_attach - Wrapper for dma_buf_dynamic_attach +* dma_buf_attach_unlocked - Wrapper for dma_buf_dynamic_attach * @dmabuf: [in] buffer to attach device to. * @dev: [in] device to be attached. * -* Wrapper to call dma_buf_dynamic_attach() for drivers which still use a static -* mapping. +* Wrapper to call dma_buf_dynamic_attach_unlocked() for drivers which still +* use a static mapping. */ -struct dma_buf_attachment *dma_buf_attach (struct dma_buf *dmabuf, -struct device *dev) +struct dma_buf_attachment *dma_buf_attach_unlocked (struct dma_buf *dmabuf, +struct device *dev) { -return dma_buf_dynamic_attach (dmabuf, dev,NULL ,NULL ); +return dma_buf_dynamic_attach_unlocked (dmabuf, dev,NULL ,NULL ); } -EXPORT_SYMBOL_NS_GPL (dma_buf_attach,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_attach_unlocked,DMA_BUF ); static void __unmap_dma_buf(struct dma_buf_attachment *attach, struct sg_table *sg_table,
@@ -923,7 +923,7 @@ static void __unmap_dma_buf(struct dma_buf_attachment *attach, }/** -* dma_buf_detach - Remove the given attachment from dmabuf's attachments list +* dma_buf_detach_unlocked - Remove the given attachment from dmabuf's attachments list * @dmabuf: [in] buffer to detach from. * @attach: [in] attachment to be detached; is free'd after this call. *
@@ -931,7 +931,8 @@ static void __unmap_dma_buf(struct dma_buf_attachment *attach,* * Optionally this calls &dma_buf_ops.detach for device-specific detach. */ -void dma_buf_detach (struct dma_buf *dmabuf,struct dma_buf_attachment *attach) +void dma_buf_detach_unlocked (struct dma_buf *dmabuf, +struct dma_buf_attachment *attach) {if (WARN_ON (!dmabuf || !attach))return ;
@@ -956,14 +957,14 @@ void dma_buf_detach(struct dma_buf *dmabuf, struct dma_buf_attachment *attach)kfree (attach); } -EXPORT_SYMBOL_NS_GPL (dma_buf_detach,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_detach_unlocked,DMA_BUF );/** * dma_buf_pin - Lock down the DMA-buf * @attach: [in] attachment which should be pinned * -* Only dynamic importers (who set up @attach with dma_buf_dynamic_attach()) may -* call this, and only for limited use cases like scanout and not for temporary +* Only dynamic importers (who set up @attach with dma_buf_dynamic_attach_unlocked()) +* may call this, and only for limited use cases like scanout and not for temporary * pin operations. It is not permitted to allow userspace to pin arbitrary * amounts of buffers through this interface. *
@@ -1010,7 +1011,7 @@ void dma_buf_unpin(struct dma_buf_attachment *attach)EXPORT_SYMBOL_NS_GPL (dma_buf_unpin,DMA_BUF );/** -* dma_buf_map_attachment - Returns the scatterlist table of the attachment; +* dma_buf_map_attachment_locked - Returns the scatterlist table of the attachment; * mapped into _device_ address space. Is a wrapper for map_dma_buf() of the * dma_buf_ops. * @attach: [in] attachment whose scatterlist is to be returned
@@ -1030,8 +1031,9 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_unpin, DMA_BUF);* Important: Dynamic importers must wait for the exclusive fence of the struct * dma_resv attached to the DMA-BUF first. */ -struct sg_table *dma_buf_map_attachment (struct dma_buf_attachment *attach, -enum dma_data_direction direction) +struct sg_table * +dma_buf_map_attachment_unlocked (struct dma_buf_attachment *attach, +enum dma_data_direction direction) {struct sg_table *sg_table;int r;
@@ -1097,10 +1099,10 @@ struct sg_table *dma_buf_map_attachment(struct dma_buf_attachment *attach,#endif /* CONFIG_DMA_API_DEBUG */ return sg_table; } -EXPORT_SYMBOL_NS_GPL (dma_buf_map_attachment,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_map_attachment_unlocked,DMA_BUF );/** -* dma_buf_unmap_attachment - unmaps and decreases usecount of the buffer;might +* dma_buf_unmap_attachment_unlocked - unmaps and decreases usecount of the buffer;might * deallocate the scatterlist associated. Is a wrapper for unmap_dma_buf() of * dma_buf_ops. * @attach: [in] attachment to unmap buffer from
@@ -1109,9 +1111,9 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_map_attachment, DMA_BUF);* * This unmaps a DMA mapping for @attached obtained by dma_buf_map_attachment(). */ -void dma_buf_unmap_attachment (struct dma_buf_attachment *attach, -struct sg_table *sg_table, -enum dma_data_direction direction) +void dma_buf_unmap_attachment_unlocked (struct dma_buf_attachment *attach, +struct sg_table *sg_table, +enum dma_data_direction direction) {might_sleep ();
@@ -1133,7 +1135,7 @@ void dma_buf_unmap_attachment(struct dma_buf_attachment *attach, !IS_ENABLED(CONFIG_DMABUF_MOVE_NOTIFY))dma_buf_unpin (attach); } -EXPORT_SYMBOL_NS_GPL (dma_buf_unmap_attachment,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_unmap_attachment_unlocked,DMA_BUF );/** * dma_buf_move_notify - notify attachments that DMA-buf is moving
@@ -1330,7 +1332,7 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_end_cpu_access, DMA_BUF);/** -* dma_buf_mmap - Setup up a userspace mmap with the given vma +* dma_buf_mmap_unlocked - Setup up a userspace mmap with the given vma * @dmabuf: [in] buffer that should back the vma * @vma: [in] vma for the mmap * @pgoff: [in] offset in pages where this mmap should start within the
@@ -1343,8 +1345,8 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_end_cpu_access, DMA_BUF);* * Can return negative error values, returns 0 on success. */ -int dma_buf_mmap (struct dma_buf *dmabuf,struct vm_area_struct *vma, -unsigned long pgoff) +int dma_buf_mmap_unlocked (struct dma_buf *dmabuf,struct vm_area_struct *vma, +unsigned long pgoff) {if (WARN_ON (!dmabuf || !vma))return -EINVAL ;
@@ -1368,10 +1370,10 @@ int dma_buf_mmap(struct dma_buf *dmabuf, struct vm_area_struct *vma,return dmabuf->ops->mmap (dmabuf, vma); } -EXPORT_SYMBOL_NS_GPL (dma_buf_mmap,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_mmap_unlocked,DMA_BUF );/** -* dma_buf_vmap - Create virtual mapping for the buffer object into kernel +* dma_buf_vmap_unlocked - Create virtual mapping for the buffer object into kernel * address space. Same restrictions as for vmap and friends apply. * @dmabuf: [in] buffer to vmap * @map: [out] returns the vmap pointer
@@ -1386,7 +1388,7 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_mmap, DMA_BUF);* * Returns 0 on success, or a negative errno code otherwise. */ -int dma_buf_vmap (struct dma_buf *dmabuf,struct iosys_map *map) +int dma_buf_vmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map) {struct iosys_map ptr;int ret =0 ;
@@ -1422,14 +1424,14 @@ int dma_buf_vmap(struct dma_buf *dmabuf, struct iosys_map *map)mutex_unlock (&dmabuf->lock);return ret; } -EXPORT_SYMBOL_NS_GPL (dma_buf_vmap,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_vmap_unlocked,DMA_BUF );/** -* dma_buf_vunmap - Unmap a vmap obtained by dma_buf_vmap. +* dma_buf_vunmap_unlocked - Unmap a vmap obtained by dma_buf_vmap. * @dmabuf: [in] buffer to vunmap * @map: [in] vmap pointer to vunmap */ -void dma_buf_vunmap (struct dma_buf *dmabuf,struct iosys_map *map) +void dma_buf_vunmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map) {if (WARN_ON (!dmabuf))return ;
@@ -1446,7 +1448,7 @@ void dma_buf_vunmap(struct dma_buf *dmabuf, struct iosys_map *map) }mutex_unlock (&dmabuf->lock); } -EXPORT_SYMBOL_NS_GPL (dma_buf_vunmap,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_vunmap_unlocked,DMA_BUF );#ifdef CONFIG_DEBUG_FS static int dma_buf_debug_show (struct seq_file *s,void *unused)
drivers/gpu/drm/amd/amdgpu/amdgpu_dma_buf.c +2 -2
@@ -449,8 +449,8 @@ struct drm_gem_object *amdgpu_gem_prime_import(struct drm_device *dev,if (IS_ERR (obj))return obj; - attach =dma_buf_dynamic_attach (dma_buf, dev->dev, - &amdgpu_dma_buf_attach_ops, obj); + attach =dma_buf_dynamic_attach_unlocked (dma_buf, dev->dev, + &amdgpu_dma_buf_attach_ops, obj);if (IS_ERR (attach)) {drm_gem_object_put (obj);return ERR_CAST (attach);
drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c +2 -2
@@ -882,7 +882,7 @@ static int amdgpu_ttm_backend_bind(struct ttm_device *bdev,struct sg_table *sgt; attach = gtt->gobj->import_attach; - sgt =dma_buf_map_attachment (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt))return PTR_ERR (sgt);
@@ -1007,7 +1007,7 @@ static void amdgpu_ttm_backend_unbind(struct ttm_device *bdev,struct dma_buf_attachment *attach; attach = gtt->gobj->import_attach; -dma_buf_unmap_attachment (attach, ttm->sg,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, ttm->sg,DMA_BIDIRECTIONAL ); ttm->sg =NULL ; }
drivers/gpu/drm/armada/armada_gem.c +7 -7
@@ -66,8 +66,8 @@ void armada_gem_free_object(struct drm_gem_object *obj)if (dobj->obj.import_attach) {/* We only ever display imported data */ if (dobj->sgt) -dma_buf_unmap_attachment (dobj->obj.import_attach, - dobj->sgt,DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (dobj->obj.import_attach, + dobj->sgt,DMA_TO_DEVICE );drm_prime_gem_destroy (&dobj->obj,NULL ); }
@@ -364,7 +364,7 @@ int armada_gem_pwrite_ioctl(struct drm_device *dev, void *data,if (args->offset > dobj->obj.size || args->size > dobj->obj.size - args->offset) { -DRM_ERROR ("invalid size: object size %u\n" , dobj->obj.size); +DRM_ERROR ("invalid size: object size %zu\n" , dobj->obj.size); ret = -EINVAL ; goto unref; }
@@ -514,13 +514,13 @@ armada_gem_prime_import(struct drm_device *dev, struct dma_buf *buf) } } - attach =dma_buf_attach (buf, dev->dev); + attach =dma_buf_attach_unlocked (buf, dev->dev);if (IS_ERR (attach))return ERR_CAST (attach); dobj =armada_gem_alloc_private_object (dev, buf->size);if (!dobj) { -dma_buf_detach (buf, attach); +dma_buf_detach_unlocked (buf, attach);return ERR_PTR (-ENOMEM ); }
@@ -539,8 +539,8 @@ int armada_gem_map_import(struct armada_gem_object *dobj) {int ret; - dobj->sgt =dma_buf_map_attachment (dobj->obj.import_attach, -DMA_TO_DEVICE ); + dobj->sgt =dma_buf_map_attachment_unlocked (dobj->obj.import_attach, +DMA_TO_DEVICE );if (IS_ERR (dobj->sgt)) { ret =PTR_ERR (dobj->sgt); dobj->sgt =NULL ;
drivers/gpu/drm/drm_gem_cma_helper.c +3 -3
@@ -232,7 +232,7 @@ void drm_gem_cma_free(struct drm_gem_cma_object *cma_obj)if (gem_obj->import_attach) {if (cma_obj->vaddr) -dma_buf_vunmap (gem_obj->import_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (gem_obj->import_attach->dmabuf, &map);drm_prime_gem_destroy (gem_obj, cma_obj->sgt); }else if (cma_obj->vaddr) {if (cma_obj->map_noncoherent)
@@ -581,7 +581,7 @@ drm_gem_cma_prime_import_sg_table_vmap(struct drm_device *dev,struct iosys_map map;int ret; - ret =dma_buf_vmap (attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (attach->dmabuf, &map);if (ret) {DRM_ERROR ("Failed to vmap PRIME buffer\n" );return ERR_PTR (ret);
@@ -589,7 +589,7 @@ drm_gem_cma_prime_import_sg_table_vmap(struct drm_device *dev, obj =drm_gem_cma_prime_import_sg_table (dev, attach, sgt);if (IS_ERR (obj)) { -dma_buf_vunmap (attach->dmabuf, &map); +dma_buf_vunmap_unlocked (attach->dmabuf, &map);return obj; }
drivers/gpu/drm/drm_gem_shmem_helper.c +3 -3
@@ -299,7 +299,7 @@ static int drm_gem_shmem_vmap_locked(struct drm_gem_shmem_object *shmem, }if (obj->import_attach) { - ret =dma_buf_vmap (obj->import_attach->dmabuf, map); + ret =dma_buf_vmap_unlocked (obj->import_attach->dmabuf, map);if (!ret) {if (WARN_ON (map->is_iomem)) { ret = -EIO ;
@@ -382,7 +382,7 @@ static void drm_gem_shmem_vunmap_locked(struct drm_gem_shmem_object *shmem,return ;if (obj->import_attach) { -dma_buf_vunmap (obj->import_attach->dmabuf, map); +dma_buf_vunmap_unlocked (obj->import_attach->dmabuf, map); }else {vunmap (shmem->vaddr);drm_gem_shmem_put_pages (shmem);
@@ -617,7 +617,7 @@ int drm_gem_shmem_mmap(struct drm_gem_shmem_object *shmem, struct vm_area_structdrm_gem_object_put (obj); vma->vm_private_data =NULL ; -return dma_buf_mmap (obj->dma_buf, vma,0 ); +return dma_buf_mmap_unlocked (obj->dma_buf, vma,0 ); } ret =drm_gem_shmem_get_pages (shmem);
drivers/gpu/drm/drm_prime.c +6 -6
@@ -930,13 +930,13 @@ struct drm_gem_object *drm_gem_prime_import_dev(struct drm_device *dev,if (!dev->driver->gem_prime_import_sg_table)return ERR_PTR (-EINVAL ); - attach =dma_buf_attach (dma_buf, attach_dev); + attach =dma_buf_attach_unlocked (dma_buf, attach_dev);if (IS_ERR (attach))return ERR_CAST (attach);get_dma_buf (dma_buf); - sgt =dma_buf_map_attachment (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt)) { ret =PTR_ERR (sgt); goto fail_detach;
@@ -954,9 +954,9 @@ struct drm_gem_object *drm_gem_prime_import_dev(struct drm_device *dev,return obj; fail_unmap: -dma_buf_unmap_attachment (attach, sgt,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, sgt,DMA_BIDIRECTIONAL ); fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach);dma_buf_put (dma_buf);return ERR_PTR (ret);
@@ -1052,9 +1052,9 @@ void drm_prime_gem_destroy(struct drm_gem_object *obj, struct sg_table *sg) attach = obj->import_attach;if (sg) -dma_buf_unmap_attachment (attach, sg,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, sg,DMA_BIDIRECTIONAL ); dma_buf = attach->dmabuf; -dma_buf_detach (attach->dmabuf, attach); +dma_buf_detach_unlocked (attach->dmabuf, attach);/* remove the reference */ dma_buf_put (dma_buf); }
drivers/gpu/drm/etnaviv/etnaviv_gem_prime.c +3 -3
@@ -65,7 +65,7 @@ static void etnaviv_gem_prime_release(struct etnaviv_gem_object *etnaviv_obj)struct iosys_map map =IOSYS_MAP_INIT_VADDR (etnaviv_obj->vaddr);if (etnaviv_obj->vaddr) -dma_buf_vunmap (etnaviv_obj->base.import_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (etnaviv_obj->base.import_attach->dmabuf, &map);/* Don't drop the pages for imported dmabuf, as they are not * ours, just free the array we allocated:
@@ -82,7 +82,7 @@ static void *etnaviv_gem_prime_vmap_impl(struct etnaviv_gem_object *etnaviv_obj)lockdep_assert_held (&etnaviv_obj->lock); - ret =dma_buf_vmap (etnaviv_obj->base.import_attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (etnaviv_obj->base.import_attach->dmabuf, &map);if (ret)return NULL ;return map.vaddr;
@@ -91,7 +91,7 @@ static void *etnaviv_gem_prime_vmap_impl(struct etnaviv_gem_object *etnaviv_obj)static int etnaviv_gem_prime_mmap_obj (struct etnaviv_gem_object *etnaviv_obj,struct vm_area_struct *vma) { -return dma_buf_mmap (etnaviv_obj->base.dma_buf, vma,0 ); +return dma_buf_mmap_unlocked (etnaviv_obj->base.dma_buf, vma,0 ); }static const struct etnaviv_gem_ops etnaviv_gem_prime_ops = {
drivers/gpu/drm/exynos/exynos_drm_gem.c +1 -1
@@ -366,7 +366,7 @@ static int exynos_drm_gem_mmap(struct drm_gem_object *obj, struct vm_area_structint ret;if (obj->import_attach) -return dma_buf_mmap (obj->dma_buf, vma,0 ); +return dma_buf_mmap_unlocked (obj->dma_buf, vma,0 ); vma->vm_flags |=VM_IO |VM_DONTEXPAND |VM_DONTDUMP ;
drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +6 -6
@@ -241,8 +241,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)assert_object_held (obj); - pages =dma_buf_map_attachment (obj->base.import_attach, -DMA_BIDIRECTIONAL ); + pages =dma_buf_map_attachment_unlocked (obj->base.import_attach, +DMA_BIDIRECTIONAL );if (IS_ERR (pages))return PTR_ERR (pages);
@@ -270,8 +270,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)static void i915_gem_object_put_pages_dmabuf (struct drm_i915_gem_object *obj,struct sg_table *pages) { -dma_buf_unmap_attachment (obj->base.import_attach, pages, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (obj->base.import_attach, pages, +DMA_BIDIRECTIONAL ); }static const struct drm_i915_gem_object_ops i915_gem_object_dmabuf_ops = {
@@ -306,7 +306,7 @@ struct drm_gem_object *i915_gem_prime_import(struct drm_device *dev,return ERR_PTR (-E2BIG );/* need to attach */ - attach =dma_buf_attach (dma_buf, dev->dev); + attach =dma_buf_attach_unlocked (dma_buf, dev->dev);if (IS_ERR (attach))return ERR_CAST (attach);
@@ -337,7 +337,7 @@ struct drm_gem_object *i915_gem_prime_import(struct drm_device *dev,return &obj->base; fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach);dma_buf_put (dma_buf);return ERR_PTR (ret);
drivers/gpu/drm/i915/gem/selftests/i915_gem_dmabuf.c +10 -10
@@ -207,13 +207,13 @@ static int igt_dmabuf_import_same_driver(struct drm_i915_private *i915,i915_gem_object_unlock (import_obj);/* Now try a fake an importer */ - import_attach =dma_buf_attach (dmabuf, obj->base.dev->dev); + import_attach =dma_buf_attach_unlocked (dmabuf, obj->base.dev->dev);if (IS_ERR (import_attach)) { err =PTR_ERR (import_attach); goto out_import; } - st =dma_buf_map_attachment (import_attach,DMA_BIDIRECTIONAL ); + st =dma_buf_map_attachment_unlocked (import_attach,DMA_BIDIRECTIONAL );if (IS_ERR (st)) { err =PTR_ERR (st); goto out_detach;
@@ -226,9 +226,9 @@ static int igt_dmabuf_import_same_driver(struct drm_i915_private *i915, timeout = -ETIME ; } err = timeout >0 ?0 : timeout; -dma_buf_unmap_attachment (import_attach, st,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (import_attach, st,DMA_BIDIRECTIONAL ); out_detach: -dma_buf_detach (dmabuf, import_attach); +dma_buf_detach_unlocked (dmabuf, import_attach); out_import:i915_gem_object_put (import_obj); out_dmabuf:
@@ -296,7 +296,7 @@ static int igt_dmabuf_import(void *arg) goto out_obj; } - err =dma_buf_vmap (dmabuf, &map); + err =dma_buf_vmap_unlocked (dmabuf, &map); dma_map = err ?NULL : map.vaddr;if (!dma_map) {pr_err ("dma_buf_vmap failed\n" );
@@ -337,7 +337,7 @@ static int igt_dmabuf_import(void *arg) err =0 ; out_dma_map: -dma_buf_vunmap (dmabuf, &map); +dma_buf_vunmap_unlocked (dmabuf, &map); out_obj:i915_gem_object_put (obj); out_dmabuf:
@@ -358,7 +358,7 @@ static int igt_dmabuf_import_ownership(void *arg)if (IS_ERR (dmabuf))return PTR_ERR (dmabuf); - err =dma_buf_vmap (dmabuf, &map); + err =dma_buf_vmap_unlocked (dmabuf, &map); ptr = err ?NULL : map.vaddr;if (!ptr) {pr_err ("dma_buf_vmap failed\n" );
@@ -367,7 +367,7 @@ static int igt_dmabuf_import_ownership(void *arg) }memset (ptr,0xc5 ,PAGE_SIZE ); -dma_buf_vunmap (dmabuf, &map); +dma_buf_vunmap_unlocked (dmabuf, &map); obj =to_intel_bo (i915_gem_prime_import (&i915->drm, dmabuf));if (IS_ERR (obj)) {
@@ -418,7 +418,7 @@ static int igt_dmabuf_export_vmap(void *arg) }i915_gem_object_put (obj); - err =dma_buf_vmap (dmabuf, &map); + err =dma_buf_vmap_unlocked (dmabuf, &map); ptr = err ?NULL : map.vaddr;if (!ptr) {pr_err ("dma_buf_vmap failed\n" );
@@ -435,7 +435,7 @@ static int igt_dmabuf_export_vmap(void *arg)memset (ptr,0xc5 , dmabuf->size); err =0 ; -dma_buf_vunmap (dmabuf, &map); +dma_buf_vunmap_unlocked (dmabuf, &map); out:dma_buf_put (dmabuf);return err;
drivers/gpu/drm/omapdrm/omap_gem_dmabuf.c +4 -4
@@ -119,13 +119,13 @@ struct drm_gem_object *omap_gem_prime_import(struct drm_device *dev, } } - attach =dma_buf_attach (dma_buf, dev->dev); + attach =dma_buf_attach_unlocked (dma_buf, dev->dev);if (IS_ERR (attach))return ERR_CAST (attach);get_dma_buf (dma_buf); - sgt =dma_buf_map_attachment (attach,DMA_TO_DEVICE ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_TO_DEVICE );if (IS_ERR (sgt)) { ret =PTR_ERR (sgt); goto fail_detach;
@@ -142,9 +142,9 @@ struct drm_gem_object *omap_gem_prime_import(struct drm_device *dev,return obj; fail_unmap: -dma_buf_unmap_attachment (attach, sgt,DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (attach, sgt,DMA_TO_DEVICE ); fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach);dma_buf_put (dma_buf);return ERR_PTR (ret);
drivers/gpu/drm/tegra/gem.c +14 -13
@@ -78,15 +78,15 @@ static struct host1x_bo_mapping *tegra_bo_pin(struct device *dev, struct host1x_if (gem->import_attach) {struct dma_buf *buf = gem->import_attach->dmabuf; - map->attach =dma_buf_attach (buf, dev); + map->attach =dma_buf_attach_unlocked (buf, dev);if (IS_ERR (map->attach)) { err =PTR_ERR (map->attach); goto free; } - map->sgt =dma_buf_map_attachment (map->attach, direction); + map->sgt =dma_buf_map_attachment_unlocked (map->attach, direction);if (IS_ERR (map->sgt)) { -dma_buf_detach (buf, map->attach); +dma_buf_detach_unlocked (buf, map->attach); err =PTR_ERR (map->sgt); map->sgt =NULL ; goto free;
@@ -160,8 +160,9 @@ static struct host1x_bo_mapping *tegra_bo_pin(struct device *dev, struct host1x_static void tegra_bo_unpin (struct host1x_bo_mapping *map) {if (map->attach) { -dma_buf_unmap_attachment (map->attach, map->sgt, map->direction); -dma_buf_detach (map->attach->dmabuf, map->attach); +dma_buf_unmap_attachment_unlocked (map->attach, map->sgt, + map->direction); +dma_buf_detach_unlocked (map->attach->dmabuf, map->attach); }else {dma_unmap_sgtable (map->dev, map->sgt, map->direction,0 );sg_free_table (map->sgt);
@@ -181,7 +182,7 @@ static void *tegra_bo_mmap(struct host1x_bo *bo)if (obj->vaddr) {return obj->vaddr; }else if (obj->gem.import_attach) { - ret =dma_buf_vmap (obj->gem.import_attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (obj->gem.import_attach->dmabuf, &map);return ret ?NULL : map.vaddr; }else { return vmap(obj->pages, obj->num_pages, VM_MAP,
@@ -197,7 +198,7 @@ static void tegra_bo_munmap(struct host1x_bo *bo, void *addr)if (obj->vaddr)return ;else if (obj->gem.import_attach) -dma_buf_vunmap (obj->gem.import_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (obj->gem.import_attach->dmabuf, &map);else vunmap (addr); }
@@ -453,7 +454,7 @@ static struct tegra_bo *tegra_bo_import(struct drm_device *drm,if (IS_ERR (bo))return bo; - attach =dma_buf_attach (buf, drm->dev); + attach =dma_buf_attach_unlocked (buf, drm->dev);if (IS_ERR (attach)) { err =PTR_ERR (attach); goto free;
@@ -461,7 +462,7 @@ static struct tegra_bo *tegra_bo_import(struct drm_device *drm,get_dma_buf (buf); - bo->sgt =dma_buf_map_attachment (attach,DMA_TO_DEVICE ); + bo->sgt =dma_buf_map_attachment_unlocked (attach,DMA_TO_DEVICE );if (IS_ERR (bo->sgt)) { err =PTR_ERR (bo->sgt); goto detach;
@@ -479,9 +480,9 @@ static struct tegra_bo *tegra_bo_import(struct drm_device *drm, detach:if (!IS_ERR_OR_NULL (bo->sgt)) -dma_buf_unmap_attachment (attach, bo->sgt,DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (attach, bo->sgt,DMA_TO_DEVICE ); -dma_buf_detach (buf, attach); +dma_buf_detach_unlocked (buf, attach);dma_buf_put (buf); free:drm_gem_object_release (&bo->gem);
@@ -508,8 +509,8 @@ void tegra_bo_free_object(struct drm_gem_object *gem)tegra_bo_iommu_unmap (tegra, bo);if (gem->import_attach) { -dma_buf_unmap_attachment (gem->import_attach, bo->sgt, -DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (gem->import_attach, bo->sgt, +DMA_TO_DEVICE );drm_prime_gem_destroy (gem,NULL ); }else {tegra_bo_free (gem->dev, bo);
drivers/infiniband/core/umem_dmabuf.c +6 -5
@@ -25,7 +25,8 @@ int ib_umem_dmabuf_map_pages(struct ib_umem_dmabuf *umem_dmabuf)if (umem_dmabuf->sgt) goto wait_fence; - sgt =dma_buf_map_attachment (umem_dmabuf->attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (umem_dmabuf->attach, +DMA_BIDIRECTIONAL );if (IS_ERR (sgt))return PTR_ERR (sgt);
@@ -96,8 +97,8 @@ void ib_umem_dmabuf_unmap_pages(struct ib_umem_dmabuf *umem_dmabuf) umem_dmabuf->last_sg_trim =0 ; } -dma_buf_unmap_attachment (umem_dmabuf->attach, umem_dmabuf->sgt, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (umem_dmabuf->attach, umem_dmabuf->sgt, +DMA_BIDIRECTIONAL ); umem_dmabuf->sgt =NULL ; }
@@ -143,7 +144,7 @@ struct ib_umem_dmabuf *ib_umem_dmabuf_get(struct ib_device *device,if (!ib_umem_num_pages (umem)) goto out_free_umem; - umem_dmabuf->attach = dma_buf_dynamic_attach( + umem_dmabuf->attach = dma_buf_dynamic_attach_unlocked( dmabuf, device->dma_device, ops,
@@ -222,7 +223,7 @@ void ib_umem_dmabuf_release(struct ib_umem_dmabuf *umem_dmabuf)dma_buf_unpin (umem_dmabuf->attach);dma_resv_unlock (dmabuf->resv); -dma_buf_detach (dmabuf, umem_dmabuf->attach); +dma_buf_detach_unlocked (dmabuf, umem_dmabuf->attach);dma_buf_put (dmabuf);kfree (umem_dmabuf); }
drivers/media/common/videobuf2/videobuf2-dma-contig.c +8 -7
@@ -101,7 +101,7 @@ static void *vb2_dc_vaddr(struct vb2_buffer *vb, void *buf_priv)if (buf->db_attach) {struct iosys_map map; -if (!dma_buf_vmap (buf->db_attach->dmabuf, &map)) +if (!dma_buf_vmap_unlocked (buf->db_attach->dmabuf, &map)) buf->vaddr = map.vaddr;return buf->vaddr;
@@ -711,7 +711,7 @@ static int vb2_dc_map_dmabuf(void *mem_priv) }/* get the associated scatterlist for this buffer */ - sgt =dma_buf_map_attachment (buf->db_attach, buf->dma_dir); + sgt =dma_buf_map_attachment_unlocked (buf->db_attach, buf->dma_dir);if (IS_ERR (sgt)) {pr_err ("Error getting dmabuf scatterlist\n" );return -EINVAL ;
@@ -722,7 +722,8 @@ static int vb2_dc_map_dmabuf(void *mem_priv)if (contig_size < buf->size) {pr_err ("contiguous chunk is too small %lu/%lu\n" , contig_size, buf->size); -dma_buf_unmap_attachment (buf->db_attach, sgt, buf->dma_dir); +dma_buf_unmap_attachment_unlocked (buf->db_attach, sgt, + buf->dma_dir);return -EFAULT ; }
@@ -750,10 +751,10 @@ static void vb2_dc_unmap_dmabuf(void *mem_priv) }if (buf->vaddr) { -dma_buf_vunmap (buf->db_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (buf->db_attach->dmabuf, &map); buf->vaddr =NULL ; } -dma_buf_unmap_attachment (buf->db_attach, sgt, buf->dma_dir); +dma_buf_unmap_attachment_unlocked (buf->db_attach, sgt, buf->dma_dir); buf->dma_addr =0 ; buf->dma_sgt =NULL ;
@@ -768,7 +769,7 @@ static void vb2_dc_detach_dmabuf(void *mem_priv)vb2_dc_unmap_dmabuf (buf);/* detach this attachment */ -dma_buf_detach (buf->db_attach->dmabuf, buf->db_attach); +dma_buf_detach_unlocked (buf->db_attach->dmabuf, buf->db_attach);kfree (buf); }
@@ -792,7 +793,7 @@ static void *vb2_dc_attach_dmabuf(struct vb2_buffer *vb, struct device *dev, buf->vb = vb;/* create attachment for the dmabuf with the user device */ - dba =dma_buf_attach (dbuf, buf->dev); + dba =dma_buf_attach_unlocked (dbuf, buf->dev);if (IS_ERR (dba)) {pr_err ("failed to attach dmabuf\n" );kfree (buf);
drivers/media/common/videobuf2/videobuf2-dma-sg.c +6 -6
@@ -309,7 +309,7 @@ static void *vb2_dma_sg_vaddr(struct vb2_buffer *vb, void *buf_priv)if (!buf->vaddr) {if (buf->db_attach) { - ret =dma_buf_vmap (buf->db_attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (buf->db_attach->dmabuf, &map); buf->vaddr = ret ?NULL : map.vaddr; }else { buf->vaddr =vm_map_ram (buf->pages, buf->num_pages,-1 );
@@ -565,7 +565,7 @@ static int vb2_dma_sg_map_dmabuf(void *mem_priv) }/* get the associated scatterlist for this buffer */ - sgt =dma_buf_map_attachment (buf->db_attach, buf->dma_dir); + sgt =dma_buf_map_attachment_unlocked (buf->db_attach, buf->dma_dir);if (IS_ERR (sgt)) {pr_err ("Error getting dmabuf scatterlist\n" );return -EINVAL ;
@@ -594,10 +594,10 @@ static void vb2_dma_sg_unmap_dmabuf(void *mem_priv) }if (buf->vaddr) { -dma_buf_vunmap (buf->db_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (buf->db_attach->dmabuf, &map); buf->vaddr =NULL ; } -dma_buf_unmap_attachment (buf->db_attach, sgt, buf->dma_dir); +dma_buf_unmap_attachment_unlocked (buf->db_attach, sgt, buf->dma_dir); buf->dma_sgt =NULL ; }
@@ -611,7 +611,7 @@ static void vb2_dma_sg_detach_dmabuf(void *mem_priv)vb2_dma_sg_unmap_dmabuf (buf);/* detach this attachment */ -dma_buf_detach (buf->db_attach->dmabuf, buf->db_attach); +dma_buf_detach_unlocked (buf->db_attach->dmabuf, buf->db_attach);kfree (buf); }
@@ -633,7 +633,7 @@ static void *vb2_dma_sg_attach_dmabuf(struct vb2_buffer *vb, struct device *dev, buf->dev = dev;/* create attachment for the dmabuf with the user device */ - dba =dma_buf_attach (dbuf, buf->dev); + dba =dma_buf_attach_unlocked (dbuf, buf->dev);if (IS_ERR (dba)) {pr_err ("failed to attach dmabuf\n" );kfree (buf);
drivers/media/common/videobuf2/videobuf2-vmalloc.c +3 -3
@@ -376,7 +376,7 @@ static int vb2_vmalloc_map_dmabuf(void *mem_priv)struct iosys_map map;int ret; - ret =dma_buf_vmap (buf->dbuf, &map); + ret =dma_buf_vmap_unlocked (buf->dbuf, &map);if (ret)return -EFAULT ; buf->vaddr = map.vaddr;
@@ -389,7 +389,7 @@ static void vb2_vmalloc_unmap_dmabuf(void *mem_priv)struct vb2_vmalloc_buf *buf = mem_priv;struct iosys_map map =IOSYS_MAP_INIT_VADDR (buf->vaddr); -dma_buf_vunmap (buf->dbuf, &map); +dma_buf_vunmap_unlocked (buf->dbuf, &map); buf->vaddr =NULL ; }
@@ -399,7 +399,7 @@ static void vb2_vmalloc_detach_dmabuf(void *mem_priv)struct iosys_map map =IOSYS_MAP_INIT_VADDR (buf->vaddr);if (buf->vaddr) -dma_buf_vunmap (buf->dbuf, &map); +dma_buf_vunmap_unlocked (buf->dbuf, &map);kfree (buf); }
drivers/media/platform/nvidia/tegra-vde/dmabuf-cache.c +6 -6
@@ -38,8 +38,8 @@ static void tegra_vde_release_entry(struct tegra_vde_cache_entry *entry)if (entry->vde->domain)tegra_vde_iommu_unmap (entry->vde, entry->iova); -dma_buf_unmap_attachment (entry->a, entry->sgt, entry->dma_dir); -dma_buf_detach (dmabuf, entry->a); +dma_buf_unmap_attachment_unlocked (entry->a, entry->sgt, entry->dma_dir); +dma_buf_detach_unlocked (dmabuf, entry->a);dma_buf_put (dmabuf);list_del (&entry->list);
@@ -95,14 +95,14 @@ int tegra_vde_dmabuf_cache_map(struct tegra_vde *vde, goto ref; } - attachment =dma_buf_attach (dmabuf, dev); + attachment =dma_buf_attach_unlocked (dmabuf, dev);if (IS_ERR (attachment)) {dev_err (dev,"Failed to attach dmabuf\n" ); err =PTR_ERR (attachment); goto err_unlock; } - sgt =dma_buf_map_attachment (attachment, dma_dir); + sgt =dma_buf_map_attachment_unlocked (attachment, dma_dir);if (IS_ERR (sgt)) {dev_err (dev,"Failed to get dmabufs sg_table\n" ); err =PTR_ERR (sgt);
@@ -152,9 +152,9 @@ int tegra_vde_dmabuf_cache_map(struct tegra_vde *vde, err_free:kfree (entry); err_unmap: -dma_buf_unmap_attachment (attachment, sgt, dma_dir); +dma_buf_unmap_attachment_unlocked (attachment, sgt, dma_dir); err_detach: -dma_buf_detach (dmabuf, attachment); +dma_buf_detach_unlocked (dmabuf, attachment); err_unlock:mutex_unlock (&vde->map_lock);
drivers/misc/fastrpc.c +6 -6
@@ -310,9 +310,9 @@ static void fastrpc_free_map(struct kref *ref)return ; } } -dma_buf_unmap_attachment (map->attach, map->table, -DMA_BIDIRECTIONAL ); -dma_buf_detach (map->buf, map->attach); +dma_buf_unmap_attachment_unlocked (map->attach, map->table, +DMA_BIDIRECTIONAL ); +dma_buf_detach_unlocked (map->buf, map->attach);dma_buf_put (map->buf); }
@@ -719,14 +719,14 @@ static int fastrpc_map_create(struct fastrpc_user *fl, int fd, goto get_err; } - map->attach =dma_buf_attach (map->buf, sess->dev); + map->attach =dma_buf_attach_unlocked (map->buf, sess->dev);if (IS_ERR (map->attach)) {dev_err (sess->dev,"Failed to attach dmabuf\n" ); err =PTR_ERR (map->attach); goto attach_err; } - map->table =dma_buf_map_attachment (map->attach,DMA_BIDIRECTIONAL ); + map->table =dma_buf_map_attachment_unlocked (map->attach,DMA_BIDIRECTIONAL );if (IS_ERR (map->table)) { err =PTR_ERR (map->table); goto map_err;
@@ -763,7 +763,7 @@ static int fastrpc_map_create(struct fastrpc_user *fl, int fd,return 0 ; map_err: -dma_buf_detach (map->buf, map->attach); +dma_buf_detach_unlocked (map->buf, map->attach); attach_err:dma_buf_put (map->buf); get_err:
drivers/xen/gntdev-dmabuf.c +7 -7
@@ -592,7 +592,7 @@ dmabuf_imp_to_refs(struct gntdev_dmabuf_priv *priv, struct device *dev, gntdev_dmabuf->priv = priv; gntdev_dmabuf->fd = fd; - attach =dma_buf_attach (dma_buf, dev); + attach =dma_buf_attach_unlocked (dma_buf, dev);if (IS_ERR (attach)) { ret =ERR_CAST (attach); goto fail_free_obj;
@@ -600,7 +600,7 @@ dmabuf_imp_to_refs(struct gntdev_dmabuf_priv *priv, struct device *dev, gntdev_dmabuf->u.imp.attach = attach; - sgt =dma_buf_map_attachment (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt)) { ret =ERR_CAST (sgt); goto fail_detach;
@@ -658,9 +658,9 @@ dmabuf_imp_to_refs(struct gntdev_dmabuf_priv *priv, struct device *dev, fail_end_access:dmabuf_imp_end_foreign_access (gntdev_dmabuf->u.imp.refs, count); fail_unmap: -dma_buf_unmap_attachment (attach, sgt,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, sgt,DMA_BIDIRECTIONAL ); fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach); fail_free_obj:dmabuf_imp_free_storage (gntdev_dmabuf); fail_put:
@@ -708,10 +708,10 @@ static int dmabuf_imp_release(struct gntdev_dmabuf_priv *priv, u32 fd) attach = gntdev_dmabuf->u.imp.attach;if (gntdev_dmabuf->u.imp.sgt) -dma_buf_unmap_attachment (attach, gntdev_dmabuf->u.imp.sgt, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, gntdev_dmabuf->u.imp.sgt, +DMA_BIDIRECTIONAL ); dma_buf = attach->dmabuf; -dma_buf_detach (attach->dmabuf, attach); +dma_buf_detach_unlocked (attach->dmabuf, attach);dma_buf_put (dma_buf);dmabuf_imp_free_storage (gntdev_dmabuf);
include/linux/dma-buf.h +19 -15
@@ -601,14 +601,16 @@ dma_buf_attachment_is_dynamic(struct dma_buf_attachment *attach)return !!attach->importer_ops; } -struct dma_buf_attachment *dma_buf_attach (struct dma_buf *dmabuf, -struct device *dev); +struct dma_buf_attachment *dma_buf_attach_unlocked (struct dma_buf *dmabuf, +struct device *dev);struct dma_buf_attachment * -dma_buf_dynamic_attach (struct dma_buf *dmabuf,struct device *dev, -const struct dma_buf_attach_ops *importer_ops, -void *importer_priv); -void dma_buf_detach (struct dma_buf *dmabuf, -struct dma_buf_attachment *attach); +dma_buf_dynamic_attach_unlocked (struct dma_buf *dmabuf,struct device *dev, +const struct dma_buf_attach_ops *importer_ops, +void *importer_priv); + +void dma_buf_detach_unlocked (struct dma_buf *dmabuf, +struct dma_buf_attachment *attach); +int dma_buf_pin (struct dma_buf_attachment *attach);void dma_buf_unpin (struct dma_buf_attachment *attach);
@@ -618,18 +620,20 @@ int dma_buf_fd(struct dma_buf *dmabuf, int flags);struct dma_buf *dma_buf_get (int fd);void dma_buf_put (struct dma_buf *dmabuf); -struct sg_table *dma_buf_map_attachment (struct dma_buf_attachment *, -enum dma_data_direction ); -void dma_buf_unmap_attachment (struct dma_buf_attachment *,struct sg_table *, -enum dma_data_direction ); +struct sg_table *dma_buf_map_attachment_unlocked (struct dma_buf_attachment *, +enum dma_data_direction ); +void dma_buf_unmap_attachment_unlocked (struct dma_buf_attachment *, +struct sg_table *, +enum dma_data_direction ); +void dma_buf_move_notify (struct dma_buf *dma_buf);int dma_buf_begin_cpu_access (struct dma_buf *dma_buf,enum dma_data_direction dir);int dma_buf_end_cpu_access (struct dma_buf *dma_buf,enum dma_data_direction dir); -int dma_buf_mmap (struct dma_buf *,struct vm_area_struct *, -unsigned long ); -int dma_buf_vmap (struct dma_buf *dmabuf,struct iosys_map *map); -void dma_buf_vunmap (struct dma_buf *dmabuf,struct iosys_map *map); +int dma_buf_mmap_unlocked (struct dma_buf *,struct vm_area_struct *, +unsigned long ); +int dma_buf_vmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map); +void dma_buf_vunmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map);#endif /* __DMA_BUF_H__ */
Signature · 1 line
2.36.1
Re: [Linaro-mm-sig] [PATCH v2 1/5] dma-buf: Add _unlocked postfix to function names
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 8 lines
Add
_unlockedpostfix to the dma-buf API function names in a preparation to move all non-dynamic dma-buf users over to the dynamic locking specification. This patch only renames API functions, preparing drivers to the common locking convention. Later on we will make the "unlocked" functions to take the reservation lock.Suggested-by Christian König <[email protected]>Signed-off-by Dmitry Osipenko <[email protected]>
Could be that we later say we will remove the prefix again because some functions should stay unlocked, but for now it makes it much clearer what happens here.
This patch is Acked-by: Christian König <[email protected]>
Quoted 1,123 lines
--- drivers/dma-buf/dma-buf.c | 76 ++++++++++--------- drivers/gpu/drm/amd/amdgpu/amdgpu_dma_buf.c | 4 +- drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c | 4 +- drivers/gpu/drm/armada/armada_gem.c | 14 ++-- drivers/gpu/drm/drm_gem_cma_helper.c | 6 +- drivers/gpu/drm/drm_gem_shmem_helper.c | 6 +- drivers/gpu/drm/drm_prime.c | 12 +-- drivers/gpu/drm/etnaviv/etnaviv_gem_prime.c | 6 +- drivers/gpu/drm/exynos/exynos_drm_gem.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 12 +-- .../drm/i915/gem/selftests/i915_gem_dmabuf.c | 20 ++--- drivers/gpu/drm/omapdrm/omap_gem_dmabuf.c | 8 +- drivers/gpu/drm/tegra/gem.c | 27 +++---- drivers/infiniband/core/umem_dmabuf.c | 11 +-- .../common/videobuf2/videobuf2-dma-contig.c | 15 ++-- .../media/common/videobuf2/videobuf2-dma-sg.c | 12 +-- .../common/videobuf2/videobuf2-vmalloc.c | 6 +- .../platform/nvidia/tegra-vde/dmabuf-cache.c | 12 +-- drivers/misc/fastrpc.c | 12 +-- drivers/xen/gntdev-dmabuf.c | 14 ++-- include/linux/dma-buf.h | 34 +++++---- 21 files changed, 161 insertions(+), 152 deletions(-)drivers/dma-buf/dma-buf.c +39
-37@@ -795,7 +795,7 @@ static struct sg_table * __map_dma_buf(struct dma_buf_attachment *attach, }/** -* dma_buf_dynamic_attach - Add the device to dma_buf's attachments list +* dma_buf_dynamic_attach_unlocked - Add the device to dma_buf's attachments list * @dmabuf: [in] buffer to attach device to. * @dev: [in] device to be attached. * @importer_ops: [in] importer operations for the attachment @@ -817,9 +817,9 @@ static struct sg_table * __map_dma_buf(struct dma_buf_attachment *attach,* indicated with the error code -EBUSY. */ struct dma_buf_attachment * -dma_buf_dynamic_attach (struct dma_buf *dmabuf,struct device *dev, -const struct dma_buf_attach_ops *importer_ops, -void *importer_priv) +dma_buf_dynamic_attach_unlocked (struct dma_buf *dmabuf,struct device *dev, +const struct dma_buf_attach_ops *importer_ops, +void *importer_priv) {struct dma_buf_attachment *attach;int ret;@@ -892,25 +892,25 @@ dma_buf_dynamic_attach(struct dma_buf *dmabuf, struct device *dev,if (dma_buf_is_dynamic (attach->dmabuf))dma_resv_unlock (attach->dmabuf->resv); -dma_buf_detach (dmabuf, attach); +dma_buf_detach_unlocked (dmabuf, attach);return ERR_PTR (ret); } -EXPORT_SYMBOL_NS_GPL (dma_buf_dynamic_attach,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_dynamic_attach_unlocked,DMA_BUF );/** -* dma_buf_attach - Wrapper for dma_buf_dynamic_attach +* dma_buf_attach_unlocked - Wrapper for dma_buf_dynamic_attach * @dmabuf: [in] buffer to attach device to. * @dev: [in] device to be attached. * -* Wrapper to call dma_buf_dynamic_attach() for drivers which still use a static -* mapping. +* Wrapper to call dma_buf_dynamic_attach_unlocked() for drivers which still +* use a static mapping. */ -struct dma_buf_attachment *dma_buf_attach (struct dma_buf *dmabuf, -struct device *dev) +struct dma_buf_attachment *dma_buf_attach_unlocked (struct dma_buf *dmabuf, +struct device *dev) { -return dma_buf_dynamic_attach (dmabuf, dev,NULL ,NULL ); +return dma_buf_dynamic_attach_unlocked (dmabuf, dev,NULL ,NULL ); } -EXPORT_SYMBOL_NS_GPL (dma_buf_attach,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_attach_unlocked,DMA_BUF ); static void __unmap_dma_buf(struct dma_buf_attachment *attach, struct sg_table *sg_table,@@ -923,7 +923,7 @@ static void __unmap_dma_buf(struct dma_buf_attachment *attach, }/** -* dma_buf_detach - Remove the given attachment from dmabuf's attachments list +* dma_buf_detach_unlocked - Remove the given attachment from dmabuf's attachments list * @dmabuf: [in] buffer to detach from. * @attach: [in] attachment to be detached; is free'd after this call. * @@ -931,7 +931,8 @@ static void __unmap_dma_buf(struct dma_buf_attachment *attach,* * Optionally this calls &dma_buf_ops.detach for device-specific detach. */ -void dma_buf_detach (struct dma_buf *dmabuf,struct dma_buf_attachment *attach) +void dma_buf_detach_unlocked (struct dma_buf *dmabuf, +struct dma_buf_attachment *attach) {if (WARN_ON (!dmabuf || !attach))return ;@@ -956,14 +957,14 @@ void dma_buf_detach(struct dma_buf *dmabuf, struct dma_buf_attachment *attach)kfree (attach); } -EXPORT_SYMBOL_NS_GPL (dma_buf_detach,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_detach_unlocked,DMA_BUF );/** * dma_buf_pin - Lock down the DMA-buf * @attach: [in] attachment which should be pinned * -* Only dynamic importers (who set up @attach with dma_buf_dynamic_attach()) may -* call this, and only for limited use cases like scanout and not for temporary +* Only dynamic importers (who set up @attach with dma_buf_dynamic_attach_unlocked()) +* may call this, and only for limited use cases like scanout and not for temporary * pin operations. It is not permitted to allow userspace to pin arbitrary * amounts of buffers through this interface. * @@ -1010,7 +1011,7 @@ void dma_buf_unpin(struct dma_buf_attachment *attach)EXPORT_SYMBOL_NS_GPL (dma_buf_unpin,DMA_BUF );/** -* dma_buf_map_attachment - Returns the scatterlist table of the attachment; +* dma_buf_map_attachment_locked - Returns the scatterlist table of the attachment; * mapped into _device_ address space. Is a wrapper for map_dma_buf() of the * dma_buf_ops. * @attach: [in] attachment whose scatterlist is to be returned @@ -1030,8 +1031,9 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_unpin, DMA_BUF);* Important: Dynamic importers must wait for the exclusive fence of the struct * dma_resv attached to the DMA-BUF first. */ -struct sg_table *dma_buf_map_attachment (struct dma_buf_attachment *attach, -enum dma_data_direction direction) +struct sg_table * +dma_buf_map_attachment_unlocked (struct dma_buf_attachment *attach, +enum dma_data_direction direction) {struct sg_table *sg_table;int r;@@ -1097,10 +1099,10 @@ struct sg_table *dma_buf_map_attachment(struct dma_buf_attachment *attach,#endif /* CONFIG_DMA_API_DEBUG */ return sg_table; } -EXPORT_SYMBOL_NS_GPL (dma_buf_map_attachment,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_map_attachment_unlocked,DMA_BUF );/** -* dma_buf_unmap_attachment - unmaps and decreases usecount of the buffer;might +* dma_buf_unmap_attachment_unlocked - unmaps and decreases usecount of the buffer;might * deallocate the scatterlist associated. Is a wrapper for unmap_dma_buf() of * dma_buf_ops. * @attach: [in] attachment to unmap buffer from @@ -1109,9 +1111,9 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_map_attachment, DMA_BUF);* * This unmaps a DMA mapping for @attached obtained by dma_buf_map_attachment(). */ -void dma_buf_unmap_attachment (struct dma_buf_attachment *attach, -struct sg_table *sg_table, -enum dma_data_direction direction) +void dma_buf_unmap_attachment_unlocked (struct dma_buf_attachment *attach, +struct sg_table *sg_table, +enum dma_data_direction direction) {might_sleep ();@@ -1133,7 +1135,7 @@ void dma_buf_unmap_attachment(struct dma_buf_attachment *attach, !IS_ENABLED(CONFIG_DMABUF_MOVE_NOTIFY))dma_buf_unpin (attach); } -EXPORT_SYMBOL_NS_GPL (dma_buf_unmap_attachment,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_unmap_attachment_unlocked,DMA_BUF );/** * dma_buf_move_notify - notify attachments that DMA-buf is moving @@ -1330,7 +1332,7 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_end_cpu_access, DMA_BUF);/** -* dma_buf_mmap - Setup up a userspace mmap with the given vma +* dma_buf_mmap_unlocked - Setup up a userspace mmap with the given vma * @dmabuf: [in] buffer that should back the vma * @vma: [in] vma for the mmap * @pgoff: [in] offset in pages where this mmap should start within the @@ -1343,8 +1345,8 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_end_cpu_access, DMA_BUF);* * Can return negative error values, returns 0 on success. */ -int dma_buf_mmap (struct dma_buf *dmabuf,struct vm_area_struct *vma, -unsigned long pgoff) +int dma_buf_mmap_unlocked (struct dma_buf *dmabuf,struct vm_area_struct *vma, +unsigned long pgoff) {if (WARN_ON (!dmabuf || !vma))return -EINVAL ;@@ -1368,10 +1370,10 @@ int dma_buf_mmap(struct dma_buf *dmabuf, struct vm_area_struct *vma,return dmabuf->ops->mmap (dmabuf, vma); } -EXPORT_SYMBOL_NS_GPL (dma_buf_mmap,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_mmap_unlocked,DMA_BUF );/** -* dma_buf_vmap - Create virtual mapping for the buffer object into kernel +* dma_buf_vmap_unlocked - Create virtual mapping for the buffer object into kernel * address space. Same restrictions as for vmap and friends apply. * @dmabuf: [in] buffer to vmap * @map: [out] returns the vmap pointer @@ -1386,7 +1388,7 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_mmap, DMA_BUF);* * Returns 0 on success, or a negative errno code otherwise. */ -int dma_buf_vmap (struct dma_buf *dmabuf,struct iosys_map *map) +int dma_buf_vmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map) {struct iosys_map ptr;int ret =0 ;@@ -1422,14 +1424,14 @@ int dma_buf_vmap(struct dma_buf *dmabuf, struct iosys_map *map)mutex_unlock (&dmabuf->lock);return ret; } -EXPORT_SYMBOL_NS_GPL (dma_buf_vmap,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_vmap_unlocked,DMA_BUF );/** -* dma_buf_vunmap - Unmap a vmap obtained by dma_buf_vmap. +* dma_buf_vunmap_unlocked - Unmap a vmap obtained by dma_buf_vmap. * @dmabuf: [in] buffer to vunmap * @map: [in] vmap pointer to vunmap */ -void dma_buf_vunmap (struct dma_buf *dmabuf,struct iosys_map *map) +void dma_buf_vunmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map) {if (WARN_ON (!dmabuf))return ;@@ -1446,7 +1448,7 @@ void dma_buf_vunmap(struct dma_buf *dmabuf, struct iosys_map *map) }mutex_unlock (&dmabuf->lock); } -EXPORT_SYMBOL_NS_GPL (dma_buf_vunmap,DMA_BUF ); +EXPORT_SYMBOL_NS_GPL (dma_buf_vunmap_unlocked,DMA_BUF );#ifdef CONFIG_DEBUG_FS static int dma_buf_debug_show (struct seq_file *s,void *unused)drivers/gpu/drm/amd/amdgpu/amdgpu_dma_buf.c +2
-2@@ -449,8 +449,8 @@ struct drm_gem_object *amdgpu_gem_prime_import(struct drm_device *dev,if (IS_ERR (obj))return obj; - attach =dma_buf_dynamic_attach (dma_buf, dev->dev, - &amdgpu_dma_buf_attach_ops, obj); + attach =dma_buf_dynamic_attach_unlocked (dma_buf, dev->dev, + &amdgpu_dma_buf_attach_ops, obj);if (IS_ERR (attach)) {drm_gem_object_put (obj);return ERR_CAST (attach);drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c +2
-2@@ -882,7 +882,7 @@ static int amdgpu_ttm_backend_bind(struct ttm_device *bdev,struct sg_table *sgt; attach = gtt->gobj->import_attach; - sgt =dma_buf_map_attachment (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt))return PTR_ERR (sgt);@@ -1007,7 +1007,7 @@ static void amdgpu_ttm_backend_unbind(struct ttm_device *bdev,struct dma_buf_attachment *attach; attach = gtt->gobj->import_attach; -dma_buf_unmap_attachment (attach, ttm->sg,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, ttm->sg,DMA_BIDIRECTIONAL ); ttm->sg =NULL ; }drivers/gpu/drm/armada/armada_gem.c +7
-7@@ -66,8 +66,8 @@ void armada_gem_free_object(struct drm_gem_object *obj)if (dobj->obj.import_attach) {/* We only ever display imported data */ if (dobj->sgt) -dma_buf_unmap_attachment (dobj->obj.import_attach, - dobj->sgt,DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (dobj->obj.import_attach, + dobj->sgt,DMA_TO_DEVICE );drm_prime_gem_destroy (&dobj->obj,NULL ); }@@ -364,7 +364,7 @@ int armada_gem_pwrite_ioctl(struct drm_device *dev, void *data,if (args->offset > dobj->obj.size || args->size > dobj->obj.size - args->offset) { -DRM_ERROR ("invalid size: object size %u\n" , dobj->obj.size); +DRM_ERROR ("invalid size: object size %zu\n" , dobj->obj.size); ret = -EINVAL ; goto unref; }@@ -514,13 +514,13 @@ armada_gem_prime_import(struct drm_device *dev, struct dma_buf *buf) } } - attach =dma_buf_attach (buf, dev->dev); + attach =dma_buf_attach_unlocked (buf, dev->dev);if (IS_ERR (attach))return ERR_CAST (attach); dobj =armada_gem_alloc_private_object (dev, buf->size);if (!dobj) { -dma_buf_detach (buf, attach); +dma_buf_detach_unlocked (buf, attach);return ERR_PTR (-ENOMEM ); }@@ -539,8 +539,8 @@ int armada_gem_map_import(struct armada_gem_object *dobj) {int ret; - dobj->sgt =dma_buf_map_attachment (dobj->obj.import_attach, -DMA_TO_DEVICE ); + dobj->sgt =dma_buf_map_attachment_unlocked (dobj->obj.import_attach, +DMA_TO_DEVICE );if (IS_ERR (dobj->sgt)) { ret =PTR_ERR (dobj->sgt); dobj->sgt =NULL ;drivers/gpu/drm/drm_gem_cma_helper.c +3
-3@@ -232,7 +232,7 @@ void drm_gem_cma_free(struct drm_gem_cma_object *cma_obj)if (gem_obj->import_attach) {if (cma_obj->vaddr) -dma_buf_vunmap (gem_obj->import_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (gem_obj->import_attach->dmabuf, &map);drm_prime_gem_destroy (gem_obj, cma_obj->sgt); }else if (cma_obj->vaddr) {if (cma_obj->map_noncoherent)@@ -581,7 +581,7 @@ drm_gem_cma_prime_import_sg_table_vmap(struct drm_device *dev,struct iosys_map map;int ret; - ret =dma_buf_vmap (attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (attach->dmabuf, &map);if (ret) {DRM_ERROR ("Failed to vmap PRIME buffer\n" );return ERR_PTR (ret);@@ -589,7 +589,7 @@ drm_gem_cma_prime_import_sg_table_vmap(struct drm_device *dev, obj =drm_gem_cma_prime_import_sg_table (dev, attach, sgt);if (IS_ERR (obj)) { -dma_buf_vunmap (attach->dmabuf, &map); +dma_buf_vunmap_unlocked (attach->dmabuf, &map);return obj; }drivers/gpu/drm/drm_gem_shmem_helper.c +3
-3@@ -299,7 +299,7 @@ static int drm_gem_shmem_vmap_locked(struct drm_gem_shmem_object *shmem, }if (obj->import_attach) { - ret =dma_buf_vmap (obj->import_attach->dmabuf, map); + ret =dma_buf_vmap_unlocked (obj->import_attach->dmabuf, map);if (!ret) {if (WARN_ON (map->is_iomem)) { ret = -EIO ;@@ -382,7 +382,7 @@ static void drm_gem_shmem_vunmap_locked(struct drm_gem_shmem_object *shmem,return ;if (obj->import_attach) { -dma_buf_vunmap (obj->import_attach->dmabuf, map); +dma_buf_vunmap_unlocked (obj->import_attach->dmabuf, map); }else {vunmap (shmem->vaddr);drm_gem_shmem_put_pages (shmem);@@ -617,7 +617,7 @@ int drm_gem_shmem_mmap(struct drm_gem_shmem_object *shmem, struct vm_area_structdrm_gem_object_put (obj); vma->vm_private_data =NULL ; -return dma_buf_mmap (obj->dma_buf, vma,0 ); +return dma_buf_mmap_unlocked (obj->dma_buf, vma,0 ); } ret =drm_gem_shmem_get_pages (shmem);drivers/gpu/drm/drm_prime.c +6
-6@@ -930,13 +930,13 @@ struct drm_gem_object *drm_gem_prime_import_dev(struct drm_device *dev,if (!dev->driver->gem_prime_import_sg_table)return ERR_PTR (-EINVAL ); - attach =dma_buf_attach (dma_buf, attach_dev); + attach =dma_buf_attach_unlocked (dma_buf, attach_dev);if (IS_ERR (attach))return ERR_CAST (attach);get_dma_buf (dma_buf); - sgt =dma_buf_map_attachment (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt)) { ret =PTR_ERR (sgt); goto fail_detach;@@ -954,9 +954,9 @@ struct drm_gem_object *drm_gem_prime_import_dev(struct drm_device *dev,return obj; fail_unmap: -dma_buf_unmap_attachment (attach, sgt,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, sgt,DMA_BIDIRECTIONAL ); fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach);dma_buf_put (dma_buf);return ERR_PTR (ret);@@ -1052,9 +1052,9 @@ void drm_prime_gem_destroy(struct drm_gem_object *obj, struct sg_table *sg) attach = obj->import_attach;if (sg) -dma_buf_unmap_attachment (attach, sg,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, sg,DMA_BIDIRECTIONAL ); dma_buf = attach->dmabuf; -dma_buf_detach (attach->dmabuf, attach); +dma_buf_detach_unlocked (attach->dmabuf, attach);/* remove the reference */ dma_buf_put (dma_buf); }drivers/gpu/drm/etnaviv/etnaviv_gem_prime.c +3
-3@@ -65,7 +65,7 @@ static void etnaviv_gem_prime_release(struct etnaviv_gem_object *etnaviv_obj)struct iosys_map map =IOSYS_MAP_INIT_VADDR (etnaviv_obj->vaddr);if (etnaviv_obj->vaddr) -dma_buf_vunmap (etnaviv_obj->base.import_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (etnaviv_obj->base.import_attach->dmabuf, &map);/* Don't drop the pages for imported dmabuf, as they are not * ours, just free the array we allocated: @@ -82,7 +82,7 @@ static void *etnaviv_gem_prime_vmap_impl(struct etnaviv_gem_object *etnaviv_obj)lockdep_assert_held (&etnaviv_obj->lock); - ret =dma_buf_vmap (etnaviv_obj->base.import_attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (etnaviv_obj->base.import_attach->dmabuf, &map);if (ret)return NULL ;return map.vaddr;@@ -91,7 +91,7 @@ static void *etnaviv_gem_prime_vmap_impl(struct etnaviv_gem_object *etnaviv_obj)static int etnaviv_gem_prime_mmap_obj (struct etnaviv_gem_object *etnaviv_obj,struct vm_area_struct *vma) { -return dma_buf_mmap (etnaviv_obj->base.dma_buf, vma,0 ); +return dma_buf_mmap_unlocked (etnaviv_obj->base.dma_buf, vma,0 ); }static const struct etnaviv_gem_ops etnaviv_gem_prime_ops = {drivers/gpu/drm/exynos/exynos_drm_gem.c +1
-1@@ -366,7 +366,7 @@ static int exynos_drm_gem_mmap(struct drm_gem_object *obj, struct vm_area_structint ret;if (obj->import_attach) -return dma_buf_mmap (obj->dma_buf, vma,0 ); +return dma_buf_mmap_unlocked (obj->dma_buf, vma,0 ); vma->vm_flags |=VM_IO |VM_DONTEXPAND |VM_DONTDUMP ;drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +6
-6@@ -241,8 +241,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)assert_object_held (obj); - pages =dma_buf_map_attachment (obj->base.import_attach, -DMA_BIDIRECTIONAL ); + pages =dma_buf_map_attachment_unlocked (obj->base.import_attach, +DMA_BIDIRECTIONAL );if (IS_ERR (pages))return PTR_ERR (pages);@@ -270,8 +270,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)static void i915_gem_object_put_pages_dmabuf (struct drm_i915_gem_object *obj,struct sg_table *pages) { -dma_buf_unmap_attachment (obj->base.import_attach, pages, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (obj->base.import_attach, pages, +DMA_BIDIRECTIONAL ); }static const struct drm_i915_gem_object_ops i915_gem_object_dmabuf_ops = {@@ -306,7 +306,7 @@ struct drm_gem_object *i915_gem_prime_import(struct drm_device *dev,return ERR_PTR (-E2BIG );/* need to attach */ - attach =dma_buf_attach (dma_buf, dev->dev); + attach =dma_buf_attach_unlocked (dma_buf, dev->dev);if (IS_ERR (attach))return ERR_CAST (attach);@@ -337,7 +337,7 @@ struct drm_gem_object *i915_gem_prime_import(struct drm_device *dev,return &obj->base; fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach);dma_buf_put (dma_buf);return ERR_PTR (ret);drivers/gpu/drm/i915/gem/selftests/i915_gem_dmabuf.c +10
-10@@ -207,13 +207,13 @@ static int igt_dmabuf_import_same_driver(struct drm_i915_private *i915,i915_gem_object_unlock (import_obj);/* Now try a fake an importer */ - import_attach =dma_buf_attach (dmabuf, obj->base.dev->dev); + import_attach =dma_buf_attach_unlocked (dmabuf, obj->base.dev->dev);if (IS_ERR (import_attach)) { err =PTR_ERR (import_attach); goto out_import; } - st =dma_buf_map_attachment (import_attach,DMA_BIDIRECTIONAL ); + st =dma_buf_map_attachment_unlocked (import_attach,DMA_BIDIRECTIONAL );if (IS_ERR (st)) { err =PTR_ERR (st); goto out_detach;@@ -226,9 +226,9 @@ static int igt_dmabuf_import_same_driver(struct drm_i915_private *i915, timeout = -ETIME ; } err = timeout >0 ?0 : timeout; -dma_buf_unmap_attachment (import_attach, st,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (import_attach, st,DMA_BIDIRECTIONAL ); out_detach: -dma_buf_detach (dmabuf, import_attach); +dma_buf_detach_unlocked (dmabuf, import_attach); out_import:i915_gem_object_put (import_obj); out_dmabuf:@@ -296,7 +296,7 @@ static int igt_dmabuf_import(void *arg) goto out_obj; } - err =dma_buf_vmap (dmabuf, &map); + err =dma_buf_vmap_unlocked (dmabuf, &map); dma_map = err ?NULL : map.vaddr;if (!dma_map) {pr_err ("dma_buf_vmap failed\n" );@@ -337,7 +337,7 @@ static int igt_dmabuf_import(void *arg) err =0 ; out_dma_map: -dma_buf_vunmap (dmabuf, &map); +dma_buf_vunmap_unlocked (dmabuf, &map); out_obj:i915_gem_object_put (obj); out_dmabuf:@@ -358,7 +358,7 @@ static int igt_dmabuf_import_ownership(void *arg)if (IS_ERR (dmabuf))return PTR_ERR (dmabuf); - err =dma_buf_vmap (dmabuf, &map); + err =dma_buf_vmap_unlocked (dmabuf, &map); ptr = err ?NULL : map.vaddr;if (!ptr) {pr_err ("dma_buf_vmap failed\n" );@@ -367,7 +367,7 @@ static int igt_dmabuf_import_ownership(void *arg) }memset (ptr,0xc5 ,PAGE_SIZE ); -dma_buf_vunmap (dmabuf, &map); +dma_buf_vunmap_unlocked (dmabuf, &map); obj =to_intel_bo (i915_gem_prime_import (&i915->drm, dmabuf));if (IS_ERR (obj)) {@@ -418,7 +418,7 @@ static int igt_dmabuf_export_vmap(void *arg) }i915_gem_object_put (obj); - err =dma_buf_vmap (dmabuf, &map); + err =dma_buf_vmap_unlocked (dmabuf, &map); ptr = err ?NULL : map.vaddr;if (!ptr) {pr_err ("dma_buf_vmap failed\n" );@@ -435,7 +435,7 @@ static int igt_dmabuf_export_vmap(void *arg)memset (ptr,0xc5 , dmabuf->size); err =0 ; -dma_buf_vunmap (dmabuf, &map); +dma_buf_vunmap_unlocked (dmabuf, &map); out:dma_buf_put (dmabuf);return err;drivers/gpu/drm/omapdrm/omap_gem_dmabuf.c +4
-4@@ -119,13 +119,13 @@ struct drm_gem_object *omap_gem_prime_import(struct drm_device *dev, } } - attach =dma_buf_attach (dma_buf, dev->dev); + attach =dma_buf_attach_unlocked (dma_buf, dev->dev);if (IS_ERR (attach))return ERR_CAST (attach);get_dma_buf (dma_buf); - sgt =dma_buf_map_attachment (attach,DMA_TO_DEVICE ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_TO_DEVICE );if (IS_ERR (sgt)) { ret =PTR_ERR (sgt); goto fail_detach;@@ -142,9 +142,9 @@ struct drm_gem_object *omap_gem_prime_import(struct drm_device *dev,return obj; fail_unmap: -dma_buf_unmap_attachment (attach, sgt,DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (attach, sgt,DMA_TO_DEVICE ); fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach);dma_buf_put (dma_buf);return ERR_PTR (ret);drivers/gpu/drm/tegra/gem.c +14
-13@@ -78,15 +78,15 @@ static struct host1x_bo_mapping *tegra_bo_pin(struct device *dev, struct host1x_if (gem->import_attach) {struct dma_buf *buf = gem->import_attach->dmabuf; - map->attach =dma_buf_attach (buf, dev); + map->attach =dma_buf_attach_unlocked (buf, dev);if (IS_ERR (map->attach)) { err =PTR_ERR (map->attach); goto free; } - map->sgt =dma_buf_map_attachment (map->attach, direction); + map->sgt =dma_buf_map_attachment_unlocked (map->attach, direction);if (IS_ERR (map->sgt)) { -dma_buf_detach (buf, map->attach); +dma_buf_detach_unlocked (buf, map->attach); err =PTR_ERR (map->sgt); map->sgt =NULL ; goto free;@@ -160,8 +160,9 @@ static struct host1x_bo_mapping *tegra_bo_pin(struct device *dev, struct host1x_static void tegra_bo_unpin (struct host1x_bo_mapping *map) {if (map->attach) { -dma_buf_unmap_attachment (map->attach, map->sgt, map->direction); -dma_buf_detach (map->attach->dmabuf, map->attach); +dma_buf_unmap_attachment_unlocked (map->attach, map->sgt, + map->direction); +dma_buf_detach_unlocked (map->attach->dmabuf, map->attach); }else {dma_unmap_sgtable (map->dev, map->sgt, map->direction,0 );sg_free_table (map->sgt);@@ -181,7 +182,7 @@ static void *tegra_bo_mmap(struct host1x_bo *bo)if (obj->vaddr) {return obj->vaddr; }else if (obj->gem.import_attach) { - ret =dma_buf_vmap (obj->gem.import_attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (obj->gem.import_attach->dmabuf, &map);return ret ?NULL : map.vaddr; }else { return vmap(obj->pages, obj->num_pages, VM_MAP,@@ -197,7 +198,7 @@ static void tegra_bo_munmap(struct host1x_bo *bo, void *addr)if (obj->vaddr)return ;else if (obj->gem.import_attach) -dma_buf_vunmap (obj->gem.import_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (obj->gem.import_attach->dmabuf, &map);else vunmap (addr); }@@ -453,7 +454,7 @@ static struct tegra_bo *tegra_bo_import(struct drm_device *drm,if (IS_ERR (bo))return bo; - attach =dma_buf_attach (buf, drm->dev); + attach =dma_buf_attach_unlocked (buf, drm->dev);if (IS_ERR (attach)) { err =PTR_ERR (attach); goto free;@@ -461,7 +462,7 @@ static struct tegra_bo *tegra_bo_import(struct drm_device *drm,get_dma_buf (buf); - bo->sgt =dma_buf_map_attachment (attach,DMA_TO_DEVICE ); + bo->sgt =dma_buf_map_attachment_unlocked (attach,DMA_TO_DEVICE );if (IS_ERR (bo->sgt)) { err =PTR_ERR (bo->sgt); goto detach;@@ -479,9 +480,9 @@ static struct tegra_bo *tegra_bo_import(struct drm_device *drm, detach:if (!IS_ERR_OR_NULL (bo->sgt)) -dma_buf_unmap_attachment (attach, bo->sgt,DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (attach, bo->sgt,DMA_TO_DEVICE ); -dma_buf_detach (buf, attach); +dma_buf_detach_unlocked (buf, attach);dma_buf_put (buf); free:drm_gem_object_release (&bo->gem);@@ -508,8 +509,8 @@ void tegra_bo_free_object(struct drm_gem_object *gem)tegra_bo_iommu_unmap (tegra, bo);if (gem->import_attach) { -dma_buf_unmap_attachment (gem->import_attach, bo->sgt, -DMA_TO_DEVICE ); +dma_buf_unmap_attachment_unlocked (gem->import_attach, bo->sgt, +DMA_TO_DEVICE );drm_prime_gem_destroy (gem,NULL ); }else {tegra_bo_free (gem->dev, bo);drivers/infiniband/core/umem_dmabuf.c +6
-5@@ -25,7 +25,8 @@ int ib_umem_dmabuf_map_pages(struct ib_umem_dmabuf *umem_dmabuf)if (umem_dmabuf->sgt) goto wait_fence; - sgt =dma_buf_map_attachment (umem_dmabuf->attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (umem_dmabuf->attach, +DMA_BIDIRECTIONAL );if (IS_ERR (sgt))return PTR_ERR (sgt);@@ -96,8 +97,8 @@ void ib_umem_dmabuf_unmap_pages(struct ib_umem_dmabuf *umem_dmabuf) umem_dmabuf->last_sg_trim =0 ; } -dma_buf_unmap_attachment (umem_dmabuf->attach, umem_dmabuf->sgt, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (umem_dmabuf->attach, umem_dmabuf->sgt, +DMA_BIDIRECTIONAL ); umem_dmabuf->sgt =NULL ; }@@ -143,7 +144,7 @@ struct ib_umem_dmabuf *ib_umem_dmabuf_get(struct ib_device *device,if (!ib_umem_num_pages (umem)) goto out_free_umem; - umem_dmabuf->attach = dma_buf_dynamic_attach( + umem_dmabuf->attach = dma_buf_dynamic_attach_unlocked( dmabuf, device->dma_device, ops,@@ -222,7 +223,7 @@ void ib_umem_dmabuf_release(struct ib_umem_dmabuf *umem_dmabuf)dma_buf_unpin (umem_dmabuf->attach);dma_resv_unlock (dmabuf->resv); -dma_buf_detach (dmabuf, umem_dmabuf->attach); +dma_buf_detach_unlocked (dmabuf, umem_dmabuf->attach);dma_buf_put (dmabuf);kfree (umem_dmabuf); }drivers/media/common/videobuf2/videobuf2-dma-contig.c +8
-7@@ -101,7 +101,7 @@ static void *vb2_dc_vaddr(struct vb2_buffer *vb, void *buf_priv)if (buf->db_attach) {struct iosys_map map; -if (!dma_buf_vmap (buf->db_attach->dmabuf, &map)) +if (!dma_buf_vmap_unlocked (buf->db_attach->dmabuf, &map)) buf->vaddr = map.vaddr;return buf->vaddr;@@ -711,7 +711,7 @@ static int vb2_dc_map_dmabuf(void *mem_priv) }/* get the associated scatterlist for this buffer */ - sgt =dma_buf_map_attachment (buf->db_attach, buf->dma_dir); + sgt =dma_buf_map_attachment_unlocked (buf->db_attach, buf->dma_dir);if (IS_ERR (sgt)) {pr_err ("Error getting dmabuf scatterlist\n" );return -EINVAL ;@@ -722,7 +722,8 @@ static int vb2_dc_map_dmabuf(void *mem_priv)if (contig_size < buf->size) {pr_err ("contiguous chunk is too small %lu/%lu\n" , contig_size, buf->size); -dma_buf_unmap_attachment (buf->db_attach, sgt, buf->dma_dir); +dma_buf_unmap_attachment_unlocked (buf->db_attach, sgt, + buf->dma_dir);return -EFAULT ; }@@ -750,10 +751,10 @@ static void vb2_dc_unmap_dmabuf(void *mem_priv) }if (buf->vaddr) { -dma_buf_vunmap (buf->db_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (buf->db_attach->dmabuf, &map); buf->vaddr =NULL ; } -dma_buf_unmap_attachment (buf->db_attach, sgt, buf->dma_dir); +dma_buf_unmap_attachment_unlocked (buf->db_attach, sgt, buf->dma_dir); buf->dma_addr =0 ; buf->dma_sgt =NULL ;@@ -768,7 +769,7 @@ static void vb2_dc_detach_dmabuf(void *mem_priv)vb2_dc_unmap_dmabuf (buf);/* detach this attachment */ -dma_buf_detach (buf->db_attach->dmabuf, buf->db_attach); +dma_buf_detach_unlocked (buf->db_attach->dmabuf, buf->db_attach);kfree (buf); }@@ -792,7 +793,7 @@ static void *vb2_dc_attach_dmabuf(struct vb2_buffer *vb, struct device *dev, buf->vb = vb;/* create attachment for the dmabuf with the user device */ - dba =dma_buf_attach (dbuf, buf->dev); + dba =dma_buf_attach_unlocked (dbuf, buf->dev);if (IS_ERR (dba)) {pr_err ("failed to attach dmabuf\n" );kfree (buf);drivers/media/common/videobuf2/videobuf2-dma-sg.c +6
-6@@ -309,7 +309,7 @@ static void *vb2_dma_sg_vaddr(struct vb2_buffer *vb, void *buf_priv)if (!buf->vaddr) {if (buf->db_attach) { - ret =dma_buf_vmap (buf->db_attach->dmabuf, &map); + ret =dma_buf_vmap_unlocked (buf->db_attach->dmabuf, &map); buf->vaddr = ret ?NULL : map.vaddr; }else { buf->vaddr =vm_map_ram (buf->pages, buf->num_pages,-1 );@@ -565,7 +565,7 @@ static int vb2_dma_sg_map_dmabuf(void *mem_priv) }/* get the associated scatterlist for this buffer */ - sgt =dma_buf_map_attachment (buf->db_attach, buf->dma_dir); + sgt =dma_buf_map_attachment_unlocked (buf->db_attach, buf->dma_dir);if (IS_ERR (sgt)) {pr_err ("Error getting dmabuf scatterlist\n" );return -EINVAL ;@@ -594,10 +594,10 @@ static void vb2_dma_sg_unmap_dmabuf(void *mem_priv) }if (buf->vaddr) { -dma_buf_vunmap (buf->db_attach->dmabuf, &map); +dma_buf_vunmap_unlocked (buf->db_attach->dmabuf, &map); buf->vaddr =NULL ; } -dma_buf_unmap_attachment (buf->db_attach, sgt, buf->dma_dir); +dma_buf_unmap_attachment_unlocked (buf->db_attach, sgt, buf->dma_dir); buf->dma_sgt =NULL ; }@@ -611,7 +611,7 @@ static void vb2_dma_sg_detach_dmabuf(void *mem_priv)vb2_dma_sg_unmap_dmabuf (buf);/* detach this attachment */ -dma_buf_detach (buf->db_attach->dmabuf, buf->db_attach); +dma_buf_detach_unlocked (buf->db_attach->dmabuf, buf->db_attach);kfree (buf); }@@ -633,7 +633,7 @@ static void *vb2_dma_sg_attach_dmabuf(struct vb2_buffer *vb, struct device *dev, buf->dev = dev;/* create attachment for the dmabuf with the user device */ - dba =dma_buf_attach (dbuf, buf->dev); + dba =dma_buf_attach_unlocked (dbuf, buf->dev);if (IS_ERR (dba)) {pr_err ("failed to attach dmabuf\n" );kfree (buf);drivers/media/common/videobuf2/videobuf2-vmalloc.c +3
-3@@ -376,7 +376,7 @@ static int vb2_vmalloc_map_dmabuf(void *mem_priv)struct iosys_map map;int ret; - ret =dma_buf_vmap (buf->dbuf, &map); + ret =dma_buf_vmap_unlocked (buf->dbuf, &map);if (ret)return -EFAULT ; buf->vaddr = map.vaddr;@@ -389,7 +389,7 @@ static void vb2_vmalloc_unmap_dmabuf(void *mem_priv)struct vb2_vmalloc_buf *buf = mem_priv;struct iosys_map map =IOSYS_MAP_INIT_VADDR (buf->vaddr); -dma_buf_vunmap (buf->dbuf, &map); +dma_buf_vunmap_unlocked (buf->dbuf, &map); buf->vaddr =NULL ; }@@ -399,7 +399,7 @@ static void vb2_vmalloc_detach_dmabuf(void *mem_priv)struct iosys_map map =IOSYS_MAP_INIT_VADDR (buf->vaddr);if (buf->vaddr) -dma_buf_vunmap (buf->dbuf, &map); +dma_buf_vunmap_unlocked (buf->dbuf, &map);kfree (buf); }drivers/media/platform/nvidia/tegra-vde/dmabuf-cache.c +6
-6@@ -38,8 +38,8 @@ static void tegra_vde_release_entry(struct tegra_vde_cache_entry *entry)if (entry->vde->domain)tegra_vde_iommu_unmap (entry->vde, entry->iova); -dma_buf_unmap_attachment (entry->a, entry->sgt, entry->dma_dir); -dma_buf_detach (dmabuf, entry->a); +dma_buf_unmap_attachment_unlocked (entry->a, entry->sgt, entry->dma_dir); +dma_buf_detach_unlocked (dmabuf, entry->a);dma_buf_put (dmabuf);list_del (&entry->list);@@ -95,14 +95,14 @@ int tegra_vde_dmabuf_cache_map(struct tegra_vde *vde, goto ref; } - attachment =dma_buf_attach (dmabuf, dev); + attachment =dma_buf_attach_unlocked (dmabuf, dev);if (IS_ERR (attachment)) {dev_err (dev,"Failed to attach dmabuf\n" ); err =PTR_ERR (attachment); goto err_unlock; } - sgt =dma_buf_map_attachment (attachment, dma_dir); + sgt =dma_buf_map_attachment_unlocked (attachment, dma_dir);if (IS_ERR (sgt)) {dev_err (dev,"Failed to get dmabufs sg_table\n" ); err =PTR_ERR (sgt);@@ -152,9 +152,9 @@ int tegra_vde_dmabuf_cache_map(struct tegra_vde *vde, err_free:kfree (entry); err_unmap: -dma_buf_unmap_attachment (attachment, sgt, dma_dir); +dma_buf_unmap_attachment_unlocked (attachment, sgt, dma_dir); err_detach: -dma_buf_detach (dmabuf, attachment); +dma_buf_detach_unlocked (dmabuf, attachment); err_unlock:mutex_unlock (&vde->map_lock);drivers/misc/fastrpc.c +6
-6@@ -310,9 +310,9 @@ static void fastrpc_free_map(struct kref *ref)return ; } } -dma_buf_unmap_attachment (map->attach, map->table, -DMA_BIDIRECTIONAL ); -dma_buf_detach (map->buf, map->attach); +dma_buf_unmap_attachment_unlocked (map->attach, map->table, +DMA_BIDIRECTIONAL ); +dma_buf_detach_unlocked (map->buf, map->attach);dma_buf_put (map->buf); }@@ -719,14 +719,14 @@ static int fastrpc_map_create(struct fastrpc_user *fl, int fd, goto get_err; } - map->attach =dma_buf_attach (map->buf, sess->dev); + map->attach =dma_buf_attach_unlocked (map->buf, sess->dev);if (IS_ERR (map->attach)) {dev_err (sess->dev,"Failed to attach dmabuf\n" ); err =PTR_ERR (map->attach); goto attach_err; } - map->table =dma_buf_map_attachment (map->attach,DMA_BIDIRECTIONAL ); + map->table =dma_buf_map_attachment_unlocked (map->attach,DMA_BIDIRECTIONAL );if (IS_ERR (map->table)) { err =PTR_ERR (map->table); goto map_err;@@ -763,7 +763,7 @@ static int fastrpc_map_create(struct fastrpc_user *fl, int fd,return 0 ; map_err: -dma_buf_detach (map->buf, map->attach); +dma_buf_detach_unlocked (map->buf, map->attach); attach_err:dma_buf_put (map->buf); get_err:drivers/xen/gntdev-dmabuf.c +7
-7@@ -592,7 +592,7 @@ dmabuf_imp_to_refs(struct gntdev_dmabuf_priv *priv, struct device *dev, gntdev_dmabuf->priv = priv; gntdev_dmabuf->fd = fd; - attach =dma_buf_attach (dma_buf, dev); + attach =dma_buf_attach_unlocked (dma_buf, dev);if (IS_ERR (attach)) { ret =ERR_CAST (attach); goto fail_free_obj;@@ -600,7 +600,7 @@ dmabuf_imp_to_refs(struct gntdev_dmabuf_priv *priv, struct device *dev, gntdev_dmabuf->u.imp.attach = attach; - sgt =dma_buf_map_attachment (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt)) { ret =ERR_CAST (sgt); goto fail_detach;@@ -658,9 +658,9 @@ dmabuf_imp_to_refs(struct gntdev_dmabuf_priv *priv, struct device *dev, fail_end_access:dmabuf_imp_end_foreign_access (gntdev_dmabuf->u.imp.refs, count); fail_unmap: -dma_buf_unmap_attachment (attach, sgt,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, sgt,DMA_BIDIRECTIONAL ); fail_detach: -dma_buf_detach (dma_buf, attach); +dma_buf_detach_unlocked (dma_buf, attach); fail_free_obj:dmabuf_imp_free_storage (gntdev_dmabuf); fail_put:@@ -708,10 +708,10 @@ static int dmabuf_imp_release(struct gntdev_dmabuf_priv *priv, u32 fd) attach = gntdev_dmabuf->u.imp.attach;if (gntdev_dmabuf->u.imp.sgt) -dma_buf_unmap_attachment (attach, gntdev_dmabuf->u.imp.sgt, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_unlocked (attach, gntdev_dmabuf->u.imp.sgt, +DMA_BIDIRECTIONAL ); dma_buf = attach->dmabuf; -dma_buf_detach (attach->dmabuf, attach); +dma_buf_detach_unlocked (attach->dmabuf, attach);dma_buf_put (dma_buf);dmabuf_imp_free_storage (gntdev_dmabuf);include/linux/dma-buf.h +19
-15@@ -601,14 +601,16 @@ dma_buf_attachment_is_dynamic(struct dma_buf_attachment *attach)return !!attach->importer_ops; } -struct dma_buf_attachment *dma_buf_attach (struct dma_buf *dmabuf, -struct device *dev); +struct dma_buf_attachment *dma_buf_attach_unlocked (struct dma_buf *dmabuf, +struct device *dev);struct dma_buf_attachment * -dma_buf_dynamic_attach (struct dma_buf *dmabuf,struct device *dev, -const struct dma_buf_attach_ops *importer_ops, -void *importer_priv); -void dma_buf_detach (struct dma_buf *dmabuf, -struct dma_buf_attachment *attach); +dma_buf_dynamic_attach_unlocked (struct dma_buf *dmabuf,struct device *dev, +const struct dma_buf_attach_ops *importer_ops, +void *importer_priv); + +void dma_buf_detach_unlocked (struct dma_buf *dmabuf, +struct dma_buf_attachment *attach); +int dma_buf_pin (struct dma_buf_attachment *attach);void dma_buf_unpin (struct dma_buf_attachment *attach);@@ -618,18 +620,20 @@ int dma_buf_fd(struct dma_buf *dmabuf, int flags);struct dma_buf *dma_buf_get (int fd);void dma_buf_put (struct dma_buf *dmabuf); -struct sg_table *dma_buf_map_attachment (struct dma_buf_attachment *, -enum dma_data_direction ); -void dma_buf_unmap_attachment (struct dma_buf_attachment *,struct sg_table *, -enum dma_data_direction ); +struct sg_table *dma_buf_map_attachment_unlocked (struct dma_buf_attachment *, +enum dma_data_direction ); +void dma_buf_unmap_attachment_unlocked (struct dma_buf_attachment *, +struct sg_table *, +enum dma_data_direction ); +void dma_buf_move_notify (struct dma_buf *dma_buf);int dma_buf_begin_cpu_access (struct dma_buf *dma_buf,enum dma_data_direction dir);int dma_buf_end_cpu_access (struct dma_buf *dma_buf,enum dma_data_direction dir); -int dma_buf_mmap (struct dma_buf *,struct vm_area_struct *, -unsigned long ); -int dma_buf_vmap (struct dma_buf *dmabuf,struct iosys_map *map); -void dma_buf_vunmap (struct dma_buf *dmabuf,struct iosys_map *map); +int dma_buf_mmap_unlocked (struct dma_buf *,struct vm_area_struct *, +unsigned long ); +int dma_buf_vmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map); +void dma_buf_vunmap_unlocked (struct dma_buf *dmabuf,struct iosys_map *map);#endif /* __DMA_BUF_H__ */
PATCH v2 2/5 drm/gem: Take reservation lock for vmap/vunmap operations
In reply to Dmitry OsipenkoThe new common dma-buf locking convention will require buffer importers to hold the reservation lock around mapping operations. Make DRM GEM core to take the lock around the vmapping operations and update QXL and i915 drivers to use the locked functions for the case where DRM core now holds the lock. This patch prepares DRM core and drivers to transition to the common dma-buf locking convention where vmapping of exported GEMs will be done under the held reservation lock.
--- drivers/gpu/drm/drm_client.c | 4 ++-- drivers/gpu/drm/drm_gem.c | 24 ++++++++++++++++++++ drivers/gpu/drm/drm_gem_framebuffer_helper.c | 6 ++--- drivers/gpu/drm/drm_prime.c | 4 ++-- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 2 +- drivers/gpu/drm/qxl/qxl_object.c | 17 +++++++------- drivers/gpu/drm/qxl/qxl_prime.c | 4 ++-- include/drm/drm_gem.h | 3 +++ 8 files changed, 46 insertions(+), 18 deletions(-)
drivers/gpu/drm/drm_client.c +2 -2
@@ -323,7 +323,7 @@ drm_client_buffer_vmap(struct drm_client_buffer *buffer,* fd_install step out of the driver backend hooks, to make that * final step optional for internal users. */ - ret =drm_gem_vmap (buffer->gem, map); + ret =drm_gem_vmap_unlocked (buffer->gem, map);if (ret)return ret;
@@ -345,7 +345,7 @@ void drm_client_buffer_vunmap(struct drm_client_buffer *buffer) {struct iosys_map *map = &buffer->map; -drm_gem_vunmap (buffer->gem, map); +drm_gem_vunmap_unlocked (buffer->gem, map); }EXPORT_SYMBOL (drm_client_buffer_vunmap);
drivers/gpu/drm/drm_gem.c +24 -0
@@ -1171,6 +1171,8 @@ int drm_gem_vmap(struct drm_gem_object *obj, struct iosys_map *map) {int ret; +dma_resv_assert_held (obj->resv); +if (!obj->funcs->vmap)return -EOPNOTSUPP ;
@@ -1186,6 +1188,8 @@ EXPORT_SYMBOL(drm_gem_vmap);void drm_gem_vunmap (struct drm_gem_object *obj,struct iosys_map *map) { +dma_resv_assert_held (obj->resv); +if (iosys_map_is_null (map))return ;
@@ -1197,6 +1201,26 @@ void drm_gem_vunmap(struct drm_gem_object *obj, struct iosys_map *map) }EXPORT_SYMBOL (drm_gem_vunmap); +int drm_gem_vmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map) +{ +int ret; + +dma_resv_lock (obj->resv,NULL ); + ret =drm_gem_vmap (obj, map); +dma_resv_unlock (obj->resv); + +return ret; +} +EXPORT_SYMBOL (drm_gem_vmap_unlocked); + +void drm_gem_vunmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map) +{ +dma_resv_lock (obj->resv,NULL ); +drm_gem_vunmap (obj, map); +dma_resv_unlock (obj->resv); +} +EXPORT_SYMBOL (drm_gem_vunmap_unlocked); +/** * drm_gem_lock_reservations - Sets up the ww context and acquires * the lock on an array of GEM objects.
drivers/gpu/drm/drm_gem_framebuffer_helper.c +3 -3
@@ -354,7 +354,7 @@ int drm_gem_fb_vmap(struct drm_framebuffer *fb, struct iosys_map *map, ret = -EINVAL ; goto err_drm_gem_vunmap; } - ret =drm_gem_vmap (obj, &map[i]); + ret =drm_gem_vmap_unlocked (obj, &map[i]);if (ret) goto err_drm_gem_vunmap; }
@@ -376,7 +376,7 @@ int drm_gem_fb_vmap(struct drm_framebuffer *fb, struct iosys_map *map, obj =drm_gem_fb_get_obj (fb, i);if (!obj)continue ; -drm_gem_vunmap (obj, &map[i]); +drm_gem_vunmap_unlocked (obj, &map[i]); }return ret; }
@@ -403,7 +403,7 @@ void drm_gem_fb_vunmap(struct drm_framebuffer *fb, struct iosys_map *map)continue ;if (iosys_map_is_null (&map[i]))continue ; -drm_gem_vunmap (obj, &map[i]); +drm_gem_vunmap_unlocked (obj, &map[i]); } }EXPORT_SYMBOL (drm_gem_fb_vunmap);
drivers/gpu/drm/drm_prime.c +2 -2
@@ -678,7 +678,7 @@ int drm_gem_dmabuf_vmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -return drm_gem_vmap (obj, map); +return drm_gem_vmap_unlocked (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vmap);
@@ -694,7 +694,7 @@ void drm_gem_dmabuf_vunmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -drm_gem_vunmap (obj, map); +drm_gem_vunmap_unlocked (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vunmap);
drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +1 -1
@@ -72,7 +72,7 @@ static int i915_gem_dmabuf_vmap(struct dma_buf *dma_buf,struct drm_i915_gem_object *obj =dma_buf_to_obj (dma_buf);void *vaddr; - vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB );if (IS_ERR (vaddr))return PTR_ERR (vaddr);
drivers/gpu/drm/qxl/qxl_object.c +9 -8
@@ -168,9 +168,16 @@ int qxl_bo_vmap_locked(struct qxl_bo *bo, struct iosys_map *map) bo->map_count++; goto out; } - r =ttm_bo_vmap (&bo->tbo, &bo->map); + + r =__qxl_bo_pin (bo);if (r)return r; + + r =ttm_bo_vmap (&bo->tbo, &bo->map); +if (r) { +__qxl_bo_unpin (bo); +return r; + } bo->map_count =1 ;/* TODO: Remove kptr in favor of map everywhere. */
@@ -192,12 +199,6 @@ int qxl_bo_vmap(struct qxl_bo *bo, struct iosys_map *map)if (r)return r; - r =__qxl_bo_pin (bo); -if (r) { -qxl_bo_unreserve (bo); -return r; - } - r =qxl_bo_vmap_locked (bo, map);qxl_bo_unreserve (bo);return r;
@@ -247,6 +248,7 @@ void qxl_bo_vunmap_locked(struct qxl_bo *bo)return ; bo->kptr =NULL ;ttm_bo_vunmap (&bo->tbo, &bo->map); +__qxl_bo_unpin (bo); }int qxl_bo_vunmap (struct qxl_bo *bo)
@@ -258,7 +260,6 @@ int qxl_bo_vunmap(struct qxl_bo *bo)return r;qxl_bo_vunmap_locked (bo); -__qxl_bo_unpin (bo);qxl_bo_unreserve (bo);return 0 ; }
drivers/gpu/drm/qxl/qxl_prime.c +2 -2
@@ -59,7 +59,7 @@ int qxl_gem_prime_vmap(struct drm_gem_object *obj, struct iosys_map *map)struct qxl_bo *bo =gem_to_qxl_bo (obj);int ret; - ret =qxl_bo_vmap (bo, map); + ret =qxl_bo_vmap_locked (bo, map);if (ret <0 )return ret;
@@ -71,5 +71,5 @@ void qxl_gem_prime_vunmap(struct drm_gem_object *obj, {struct qxl_bo *bo =gem_to_qxl_bo (obj); -qxl_bo_vunmap (bo); +qxl_bo_vunmap_locked (bo); }
include/drm/drm_gem.h +3 -0
@@ -420,4 +420,7 @@ void drm_gem_unlock_reservations(struct drm_gem_object **objs, int count,int drm_gem_dumb_map_offset (struct drm_file *file,struct drm_device *dev,u32 handle,u64 *offset); +int drm_gem_vmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map); +void drm_gem_vunmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map); +#endif /* __DRM_GEM_H__ */
Signature · 1 line
2.36.1
Re: [Linaro-mm-sig] [PATCH v2 2/5] drm/gem: Take reservation lock for vmap/vunmap operations
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 9 lines
The new common dma-buf locking convention will require buffer importers to hold the reservation lock around mapping operations. Make DRM GEM core to take the lock around the vmapping operations and update QXL and i915 drivers to use the locked functions for the case where DRM core now holds the lock. This patch prepares DRM core and drivers to transition to the common dma-buf locking convention where vmapping of exported GEMs will be done under the held reservation lock.
Signed-off-by Dmitry Osipenko <[email protected]>
Quoted 231 lines
--- drivers/gpu/drm/drm_client.c | 4 ++-- drivers/gpu/drm/drm_gem.c | 24 ++++++++++++++++++++ drivers/gpu/drm/drm_gem_framebuffer_helper.c | 6 ++--- drivers/gpu/drm/drm_prime.c | 4 ++-- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 2 +- drivers/gpu/drm/qxl/qxl_object.c | 17 +++++++------- drivers/gpu/drm/qxl/qxl_prime.c | 4 ++-- include/drm/drm_gem.h | 3 +++ 8 files changed, 46 insertions(+), 18 deletions(-)drivers/gpu/drm/drm_client.c +2
-2@@ -323,7 +323,7 @@ drm_client_buffer_vmap(struct drm_client_buffer *buffer,* fd_install step out of the driver backend hooks, to make that * final step optional for internal users. */ - ret =drm_gem_vmap (buffer->gem, map); + ret =drm_gem_vmap_unlocked (buffer->gem, map);if (ret)return ret;@@ -345,7 +345,7 @@ void drm_client_buffer_vunmap(struct drm_client_buffer *buffer) {struct iosys_map *map = &buffer->map; -drm_gem_vunmap (buffer->gem, map); +drm_gem_vunmap_unlocked (buffer->gem, map); }EXPORT_SYMBOL (drm_client_buffer_vunmap);drivers/gpu/drm/drm_gem.c +24
-0@@ -1171,6 +1171,8 @@ int drm_gem_vmap(struct drm_gem_object *obj, struct iosys_map *map) {int ret; +dma_resv_assert_held (obj->resv); +if (!obj->funcs->vmap)return -EOPNOTSUPP ;@@ -1186,6 +1188,8 @@ EXPORT_SYMBOL(drm_gem_vmap);void drm_gem_vunmap (struct drm_gem_object *obj,struct iosys_map *map) { +dma_resv_assert_held (obj->resv); +if (iosys_map_is_null (map))return ;@@ -1197,6 +1201,26 @@ void drm_gem_vunmap(struct drm_gem_object *obj, struct iosys_map *map) }EXPORT_SYMBOL (drm_gem_vunmap); +int drm_gem_vmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map) +{ +int ret; + +dma_resv_lock (obj->resv,NULL ); + ret =drm_gem_vmap (obj, map); +dma_resv_unlock (obj->resv); + +return ret; +} +EXPORT_SYMBOL (drm_gem_vmap_unlocked); + +void drm_gem_vunmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map) +{ +dma_resv_lock (obj->resv,NULL ); +drm_gem_vunmap (obj, map); +dma_resv_unlock (obj->resv); +} +EXPORT_SYMBOL (drm_gem_vunmap_unlocked); +/** * drm_gem_lock_reservations - Sets up the ww context and acquires * the lock on an array of GEM objects. drivers/gpu/drm/drm_gem_framebuffer_helper.c +3
-3@@ -354,7 +354,7 @@ int drm_gem_fb_vmap(struct drm_framebuffer *fb, struct iosys_map *map, ret = -EINVAL ; goto err_drm_gem_vunmap; } - ret =drm_gem_vmap (obj, &map[i]); + ret =drm_gem_vmap_unlocked (obj, &map[i]);if (ret) goto err_drm_gem_vunmap; }@@ -376,7 +376,7 @@ int drm_gem_fb_vmap(struct drm_framebuffer *fb, struct iosys_map *map, obj =drm_gem_fb_get_obj (fb, i);if (!obj)continue ; -drm_gem_vunmap (obj, &map[i]); +drm_gem_vunmap_unlocked (obj, &map[i]); }return ret; }@@ -403,7 +403,7 @@ void drm_gem_fb_vunmap(struct drm_framebuffer *fb, struct iosys_map *map)continue ;if (iosys_map_is_null (&map[i]))continue ; -drm_gem_vunmap (obj, &map[i]); +drm_gem_vunmap_unlocked (obj, &map[i]); } }EXPORT_SYMBOL (drm_gem_fb_vunmap);drivers/gpu/drm/drm_prime.c +2
-2@@ -678,7 +678,7 @@ int drm_gem_dmabuf_vmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -return drm_gem_vmap (obj, map); +return drm_gem_vmap_unlocked (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vmap);@@ -694,7 +694,7 @@ void drm_gem_dmabuf_vunmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -drm_gem_vunmap (obj, map); +drm_gem_vunmap_unlocked (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vunmap);drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +1
-1@@ -72,7 +72,7 @@ static int i915_gem_dmabuf_vmap(struct dma_buf *dma_buf,struct drm_i915_gem_object *obj =dma_buf_to_obj (dma_buf);void *vaddr; - vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB );if (IS_ERR (vaddr))return PTR_ERR (vaddr);drivers/gpu/drm/qxl/qxl_object.c +9
-8@@ -168,9 +168,16 @@ int qxl_bo_vmap_locked(struct qxl_bo *bo, struct iosys_map *map) bo->map_count++; goto out; } - r =ttm_bo_vmap (&bo->tbo, &bo->map); + + r =__qxl_bo_pin (bo);if (r)return r; + + r =ttm_bo_vmap (&bo->tbo, &bo->map); +if (r) { +__qxl_bo_unpin (bo); +return r; + } bo->map_count =1 ;/* TODO: Remove kptr in favor of map everywhere. */ @@ -192,12 +199,6 @@ int qxl_bo_vmap(struct qxl_bo *bo, struct iosys_map *map)if (r)return r; - r =__qxl_bo_pin (bo); -if (r) { -qxl_bo_unreserve (bo); -return r; - } - r =qxl_bo_vmap_locked (bo, map);qxl_bo_unreserve (bo);return r;@@ -247,6 +248,7 @@ void qxl_bo_vunmap_locked(struct qxl_bo *bo)return ; bo->kptr =NULL ;ttm_bo_vunmap (&bo->tbo, &bo->map); +__qxl_bo_unpin (bo); }int qxl_bo_vunmap (struct qxl_bo *bo)@@ -258,7 +260,6 @@ int qxl_bo_vunmap(struct qxl_bo *bo)return r;qxl_bo_vunmap_locked (bo); -__qxl_bo_unpin (bo);qxl_bo_unreserve (bo);return 0 ; }drivers/gpu/drm/qxl/qxl_prime.c +2
-2@@ -59,7 +59,7 @@ int qxl_gem_prime_vmap(struct drm_gem_object *obj, struct iosys_map *map)struct qxl_bo *bo =gem_to_qxl_bo (obj);int ret; - ret =qxl_bo_vmap (bo, map); + ret =qxl_bo_vmap_locked (bo, map);if (ret <0 )return ret;@@ -71,5 +71,5 @@ void qxl_gem_prime_vunmap(struct drm_gem_object *obj, {struct qxl_bo *bo =gem_to_qxl_bo (obj); -qxl_bo_vunmap (bo); +qxl_bo_vunmap_locked (bo); }include/drm/drm_gem.h +3
-0@@ -420,4 +420,7 @@ void drm_gem_unlock_reservations(struct drm_gem_object **objs, int count,int drm_gem_dumb_map_offset (struct drm_file *file,struct drm_device *dev,u32 handle,u64 *offset); +int drm_gem_vmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map); +void drm_gem_vunmap_unlocked (struct drm_gem_object *obj,struct iosys_map *map); +#endif /* __DRM_GEM_H__ */
PATCH v2 3/5 dma-buf: Move all dma-bufs to dynamic locking specification
In reply to Dmitry OsipenkoThis patch moves the non-dynamic dma-buf users over to the dynamic locking specification. The strict locking convention prevents deadlock situation for dma-buf importers and exporters.
Previously the "unlocked" versions of the dma-buf API functions weren't taking the reservation lock and this patch makes them to take the lock.
Intel and AMD GPU drivers already were mapping imported dma-bufs under the held lock, hence the "locked" variant of the functions are added for them and the drivers are updated to use the "locked" versions.
--- Documentation/driver-api/dma-buf.rst | 6 + drivers/dma-buf/dma-buf.c | 186 ++++++++++++++++----- drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c | 4 +- drivers/gpu/drm/drm_prime.c | 4 +- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 8 +- include/linux/dma-buf.h | 28 ++-- 6 files changed, 179 insertions(+), 57 deletions(-)
Documentation/driver-api/dma-buf.rst +6 -0
@@ -119,6 +119,12 @@ DMA Buffer ioctls .. kernel-doc:: include/uapi/linux/dma-buf.h +DMA-BUF locking convention +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +.. kernel-doc:: drivers/dma-buf/dma-buf.c + :doc: locking convention + Kernel Functions and Structures Reference ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
drivers/dma-buf/dma-buf.c +148 -38
339 lines not on this page · raw message
drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c +2 -2
@@ -882,7 +882,7 @@ static int amdgpu_ttm_backend_bind(struct ttm_device *bdev,struct sg_table *sgt; attach = gtt->gobj->import_attach; - sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_locked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt))return PTR_ERR (sgt);
@@ -1007,7 +1007,7 @@ static void amdgpu_ttm_backend_unbind(struct ttm_device *bdev,struct dma_buf_attachment *attach; attach = gtt->gobj->import_attach; -dma_buf_unmap_attachment_unlocked (attach, ttm->sg,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_locked (attach, ttm->sg,DMA_BIDIRECTIONAL ); ttm->sg =NULL ; }
drivers/gpu/drm/drm_prime.c +2 -2
@@ -678,7 +678,7 @@ int drm_gem_dmabuf_vmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -return drm_gem_vmap_unlocked (obj, map); +return drm_gem_vmap (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vmap);
@@ -694,7 +694,7 @@ void drm_gem_dmabuf_vunmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -drm_gem_vunmap_unlocked (obj, map); +drm_gem_vunmap (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vunmap);
drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +4 -4
@@ -241,8 +241,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)assert_object_held (obj); - pages =dma_buf_map_attachment_unlocked (obj->base.import_attach, -DMA_BIDIRECTIONAL ); + pages =dma_buf_map_attachment_locked (obj->base.import_attach, +DMA_BIDIRECTIONAL );if (IS_ERR (pages))return PTR_ERR (pages);
@@ -270,8 +270,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)static void i915_gem_object_put_pages_dmabuf (struct drm_i915_gem_object *obj,struct sg_table *pages) { -dma_buf_unmap_attachment_unlocked (obj->base.import_attach, pages, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_locked (obj->base.import_attach, pages, +DMA_BIDIRECTIONAL ); }static const struct drm_i915_gem_object_ops i915_gem_object_dmabuf_ops = {
include/linux/dma-buf.h +17 -11
@@ -46,7 +46,7 @@ struct dma_buf_ops {/** * @attach: * -* This is called from dma_buf_attach() to make sure that a given +* This is called from dma_buf_attach_unlocked() to make sure that a given * &dma_buf_attachment.dev can access the provided &dma_buf. Exporters * which support buffer objects in special locations like VRAM or * device-specific carveout areas should check whether the buffer could
@@ -74,7 +74,7 @@ struct dma_buf_ops {/** * @detach: * -* This is called by dma_buf_detach() to release a &dma_buf_attachment. +* This is called by dma_buf_detach_unlocked() to release a &dma_buf_attachment. * Provided so that exporters can clean up any housekeeping for an * &dma_buf_attachment. *
@@ -94,7 +94,7 @@ struct dma_buf_ops {* exclusive with @cache_sgt_mapping. * * This is called automatically for non-dynamic importers from -* dma_buf_attach(). +* dma_buf_attach_unlocked(). * * Note that similar to non-dynamic exporters in their @map_dma_buf * callback the driver must guarantee that the memory is available for
@@ -124,8 +124,8 @@ struct dma_buf_ops {/** * @map_dma_buf: * -* This is called by dma_buf_map_attachment() and is used to map a -* shared &dma_buf into device address space, and it is mandatory. It +* This is called by dma_buf_map_attachment_locked() and is used to map +* a shared &dma_buf into device address space, and it is mandatory. It * can only be called if @attach has been called successfully. * * This call may sleep, e.g. when the backing storage first needs to be
@@ -181,8 +181,8 @@ struct dma_buf_ops {/** * @unmap_dma_buf: * -* This is called by dma_buf_unmap_attachment() and should unmap and -* release the &sg_table allocated in @map_dma_buf, and it is mandatory. +* This is called by dma_buf_unmap_attachment_locked() and should unmap +* and release the &sg_table allocated in @map_dma_buf, and it is mandatory. * For static dma_buf handling this might also unpin the backing * storage if this is the last mapping of the DMA buffer. */
@@ -509,10 +509,10 @@ struct dma_buf_attach_ops {* and its user device(s). The list contains one attachment struct per device * attached to the buffer. * -* An attachment is created by calling dma_buf_attach(), and released again by -* calling dma_buf_detach(). The DMA mapping itself needed to initiate a -* transfer is created by dma_buf_map_attachment() and freed again by calling -* dma_buf_unmap_attachment(). +* An attachment is created by calling dma_buf_attach_unlocked(), and released +* again by calling dma_buf_detach_unlocked(). The DMA mapping itself needed to +* initiate a transfer is created by dma_buf_map_attachment_locked() and freed +* again by calling dma_buf_unmap_attachment_locked(). */ struct dma_buf_attachment {struct dma_buf *dmabuf;
@@ -626,6 +626,12 @@ void dma_buf_unmap_attachment_unlocked(struct dma_buf_attachment *, struct sg_table *, enum dma_data_direction); +struct sg_table *dma_buf_map_attachment_locked (struct dma_buf_attachment *, +enum dma_data_direction ); +void dma_buf_unmap_attachment_locked (struct dma_buf_attachment *attach, +struct sg_table *sg_table, +enum dma_data_direction direction); +void dma_buf_move_notify (struct dma_buf *dma_buf);int dma_buf_begin_cpu_access (struct dma_buf *dma_buf,enum dma_data_direction dir);
Signature · 1 line
2.36.1
Re: [Linaro-mm-sig] [PATCH v2 3/5] dma-buf: Move all dma-bufs to dynamic locking specification
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 10 lines
This patch moves the non-dynamic dma-buf users over to the dynamic locking specification. The strict locking convention prevents deadlock situation for dma-buf importers and exporters.
Previously the "unlocked" versions of the dma-buf API functions weren't taking the reservation lock and this patch makes them to take the lock.
Intel and AMD GPU drivers already were mapping imported dma-bufs under the held lock, hence the "locked" variant of the functions are added for them and the drivers are updated to use the "locked" versions.
In general "Yes, please", but that won't be that easy.
You not only need to change amdgpu and i915, but all drivers implementing the map_dma_buf(), unmap_dma_buf() callbacks.
Auditing all that code is a huge bunch of work.
Quoted 61 lines
Signed-off-by Dmitry Osipenko <[email protected]>--- Documentation/driver-api/dma-buf.rst | 6 + drivers/dma-buf/dma-buf.c | 186 ++++++++++++++++----- drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c | 4 +- drivers/gpu/drm/drm_prime.c | 4 +- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 8 +- include/linux/dma-buf.h | 28 ++-- 6 files changed, 179 insertions(+), 57 deletions(-)Documentation/driver-api/dma-buf.rst +6
-0@@ -119,6 +119,12 @@ DMA Buffer ioctls .. kernel-doc:: include/uapi/linux/dma-buf.h +DMA-BUF locking convention +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +.. kernel-doc:: drivers/dma-buf/dma-buf.c + :doc: locking convention + Kernel Functions and Structures Reference ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~drivers/dma-buf/dma-buf.c +8
-3@@ -559,7 +559,7 @@ static struct file *dma_buf_getfile(struct dma_buf *dmabuf, int flags)* 2. Userspace passes this file-descriptors to all drivers it wants this buffer * to share with: First the file descriptor is converted to a &dma_buf using * dma_buf_get(). Then the buffer is attached to the device using -* dma_buf_attach(). +* dma_buf_attach_unlocked(). * * Up to this stage the exporter is still free to migrate or reallocate the * backing storage. @@ -569,8 +569,8 @@ static struct file *dma_buf_getfile(struct dma_buf *dmabuf, int flags)* dma_buf_map_attachment() and dma_buf_unmap_attachment(). * * 4. Once a driver is done with a shared buffer it needs to call -* dma_buf_detach() (after cleaning up any mappings) and then release the -* reference acquired with dma_buf_get() by calling dma_buf_put(). +* dma_buf_detach_unlocked() (after cleaning up any mappings) and then +* release the reference acquired with dma_buf_get() by calling dma_buf_put(). * * For the detailed semantics exporters are expected to implement see * &dma_buf_ops. @@ -794,6 +794,63 @@ static struct sg_table * __map_dma_buf(struct dma_buf_attachment *attach,return sg_table; } +/** +* DOC: locking convention +* +* In order to avoid deadlock situations between dma-buf exports and importers, +* all dma-buf API users must follow the common dma-buf locking convention.
drivers/dma-buf/dma-buf.c static struct sg_table * __map_dma_buf(struct dma_buf_attachment *attach, · line 811
Quoted 10 lines
drivers/dma-buf/dma-buf.c +9
-0+* +* Convention for importers +* +* 1. Importers must hold the dma-buf reservation lock when calling these +* functions: +* +* - dma_buf_pin() +* - dma_buf_unpin() +* - dma_buf_move_notify()
This one is called by the exporter, not the importer.
Regards,
Christian.
Quoted 473 lines
drivers/dma-buf/dma-buf.c +43
-0+* - dma_buf_map_attachment_locked() +* - dma_buf_unmap_attachment_locked() +* +* 2. Importers must not hold the dma-buf reservation lock when calling these +* functions: +* +* - dma_buf_attach_unlocked() +* - dma_buf_dynamic_attach_unlocked() +* - dma_buf_detach_unlocked() +* - dma_buf_export( +* - dma_buf_fd() +* - dma_buf_get() +* - dma_buf_put() +* - dma_buf_begin_cpu_access() +* - dma_buf_end_cpu_access() +* - dma_buf_map_attachment_unlocked() +* - dma_buf_unmap_attachment_unlocked() +* - dma_buf_vmap_unlocked() +* - dma_buf_vunmap_unlocked() +* +* Convention for exporters +* +* 1. These &dma_buf_ops callbacks are invoked with unlocked dma-buf +* reservation and exporter can take the lock: +* +* - &dma_buf_ops.attach() +* - &dma_buf_ops.detach() +* - &dma_buf_ops.release() +* - &dma_buf_ops.begin_cpu_access() +* - &dma_buf_ops.end_cpu_access() +* +* 2. These &dma_buf_ops callbacks are invoked with locked dma-buf +* reservation and exporter can't take the lock: +* +* - &dma_buf_ops.pin() +* - &dma_buf_ops.unpin() +* - &dma_buf_ops.map_dma_buf() +* - &dma_buf_ops.unmap_dma_buf() +* - &dma_buf_ops.mmap() +* - &dma_buf_ops.vmap() +* - &dma_buf_ops.vunmap() +*/ +/** * dma_buf_dynamic_attach_unlocked - Add the device to dma_buf's attachments list * @dmabuf: [in] buffer to attach device to.
drivers/dma-buf/dma-buf.c +88
-35@@ -802,7 +859,7 @@ static struct sg_table * __map_dma_buf(struct dma_buf_attachment *attach,* @importer_priv: [in] importer private pointer for the attachment * * Returns struct dma_buf_attachment pointer for this attachment. Attachments -* must be cleaned up by calling dma_buf_detach(). +* must be cleaned up by calling dma_buf_detach_unlocked(). * * Optionally this calls &dma_buf_ops.attach to allow device-specific attach * functionality. @@ -858,8 +915,8 @@ dma_buf_dynamic_attach_unlocked(struct dma_buf *dmabuf, struct device *dev, dma_buf_is_dynamic(dmabuf)) {struct sg_table *sgt; +dma_resv_lock (attach->dmabuf->resv,NULL );if (dma_buf_is_dynamic (attach->dmabuf)) { -dma_resv_lock (attach->dmabuf->resv,NULL ); ret = dmabuf->ops->pin (attach);if (ret) goto err_unlock;@@ -872,8 +929,7 @@ dma_buf_dynamic_attach_unlocked(struct dma_buf *dmabuf, struct device *dev, ret =PTR_ERR (sgt); goto err_unpin; } -if (dma_buf_is_dynamic (attach->dmabuf)) -dma_resv_unlock (attach->dmabuf->resv); +dma_resv_unlock (attach->dmabuf->resv); attach->sgt = sgt; attach->dir =DMA_BIDIRECTIONAL ; }@@ -889,8 +945,7 @@ dma_buf_dynamic_attach_unlocked(struct dma_buf *dmabuf, struct device *dev, dmabuf->ops->unpin (attach); err_unlock: -if (dma_buf_is_dynamic (attach->dmabuf)) -dma_resv_unlock (attach->dmabuf->resv); +dma_resv_unlock (attach->dmabuf->resv);dma_buf_detach_unlocked (dmabuf, attach);return ERR_PTR (ret);@@ -927,7 +982,7 @@ static void __unmap_dma_buf(struct dma_buf_attachment *attach,* @dmabuf: [in] buffer to detach from. * @attach: [in] attachment to be detached; is free'd after this call. * -* Clean up a device attachment obtained by calling dma_buf_attach(). +* Clean up a device attachment obtained by calling dma_buf_attach_unlocked(). * * Optionally this calls &dma_buf_ops.detach for device-specific detach. */ @@ -937,21 +992,19 @@ void dma_buf_detach_unlocked(struct dma_buf *dmabuf,if (WARN_ON (!dmabuf || !attach))return ; +dma_resv_lock (attach->dmabuf->resv,NULL ); +if (attach->sgt) { -if (dma_buf_is_dynamic (attach->dmabuf)) -dma_resv_lock (attach->dmabuf->resv,NULL );__unmap_dma_buf (attach, attach->sgt, attach->dir); -if (dma_buf_is_dynamic (attach->dmabuf)) { +if (dma_buf_is_dynamic (attach->dmabuf)) dmabuf->ops->unpin (attach); -dma_resv_unlock (attach->dmabuf->resv); - } } - -dma_resv_lock (dmabuf->resv,NULL );list_del (&attach->node); +dma_resv_unlock (dmabuf->resv); +if (dmabuf->ops->detach) dmabuf->ops->detach (dmabuf, attach);@@ -1030,10 +1083,11 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_unpin, DMA_BUF);* * Important: Dynamic importers must wait for the exclusive fence of the struct * dma_resv attached to the DMA-BUF first. +* +* Importer is responsible for holding dmabuf's reservation lock. */ -struct sg_table * -dma_buf_map_attachment_unlocked (struct dma_buf_attachment *attach, -enum dma_data_direction direction) +struct sg_table *dma_buf_map_attachment_locked (struct dma_buf_attachment *attach, +enum dma_data_direction direction) {struct sg_table *sg_table;int r;@@ -1043,8 +1097,7 @@ dma_buf_map_attachment_unlocked(struct dma_buf_attachment *attach,if (WARN_ON (!attach || !attach->dmabuf))return ERR_PTR (-EINVAL ); -if (dma_buf_attachment_is_dynamic (attach)) -dma_resv_assert_held (attach->dmabuf->resv); +dma_resv_assert_held (attach->dmabuf->resv);if (attach->sgt) {/* @@ -1059,7 +1112,6 @@ dma_buf_map_attachment_unlocked(struct dma_buf_attachment *attach, }if (dma_buf_is_dynamic (attach->dmabuf)) { -dma_resv_assert_held (attach->dmabuf->resv);if (!IS_ENABLED (CONFIG_DMABUF_MOVE_NOTIFY )) { r = attach->dmabuf->ops->pin (attach);if (r)@@ -1099,10 +1151,38 @@ dma_buf_map_attachment_unlocked(struct dma_buf_attachment *attach,#endif /* CONFIG_DMA_API_DEBUG */ return sg_table; } +EXPORT_SYMBOL_NS_GPL (dma_buf_map_attachment_locked,DMA_BUF ); + +/** +* dma_buf_map_attachment_unlocked - Returns the scatterlist table of the attachment; +* mapped into _device_ address space. Is a wrapper for map_dma_buf() of the +* dma_buf_ops. +* @attach: [in] attachment whose scatterlist is to be returned +* @direction: [in] direction of DMA transfer +* +* Unlocked variant of dma_buf_map_attachment_locked(). +*/ +struct sg_table * +dma_buf_map_attachment_unlocked (struct dma_buf_attachment *attach, +enum dma_data_direction direction) +{ +struct sg_table *sg_table; + +might_sleep (); + +if (WARN_ON (!attach || !attach->dmabuf)) +return ERR_PTR (-EINVAL ); + +dma_resv_lock (attach->dmabuf->resv,NULL ); + sg_table =dma_buf_map_attachment_locked (attach, direction); +dma_resv_unlock (attach->dmabuf->resv); + +return sg_table; +}EXPORT_SYMBOL_NS_GPL (dma_buf_map_attachment_unlocked,DMA_BUF );/** -* dma_buf_unmap_attachment_unlocked - unmaps and decreases usecount of the buffer;might +* dma_buf_unmap_attachment_locked - unmaps and decreases usecount of the buffer;might * deallocate the scatterlist associated. Is a wrapper for unmap_dma_buf() of * dma_buf_ops. * @attach: [in] attachment to unmap buffer from @@ -1110,31 +1190,51 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_map_attachment_unlocked, DMA_BUF);* @direction: [in] direction of DMA transfer * * This unmaps a DMA mapping for @attached obtained by dma_buf_map_attachment(). +* +* Importer is responsible for holding dmabuf's reservation lock. */ -void dma_buf_unmap_attachment_unlocked (struct dma_buf_attachment *attach, -struct sg_table *sg_table, -enum dma_data_direction direction) +void dma_buf_unmap_attachment_locked (struct dma_buf_attachment *attach, +struct sg_table *sg_table, +enum dma_data_direction direction) {might_sleep (); -if (WARN_ON (!attach || !attach->dmabuf || !sg_table)) -return ; - -if (dma_buf_attachment_is_dynamic (attach)) -dma_resv_assert_held (attach->dmabuf->resv); +dma_resv_assert_held (attach->dmabuf->resv);if (attach->sgt == sg_table)return ; -if (dma_buf_is_dynamic (attach->dmabuf)) -dma_resv_assert_held (attach->dmabuf->resv); -__unmap_dma_buf (attach, sg_table, direction);if (dma_buf_is_dynamic (attach->dmabuf) && !IS_ENABLED (CONFIG_DMABUF_MOVE_NOTIFY ))dma_buf_unpin (attach); } +EXPORT_SYMBOL_NS_GPL (dma_buf_unmap_attachment_locked,DMA_BUF ); + +/** +* dma_buf_unmap_attachment_unlocked - unmaps and decreases usecount of the buffer;might +* deallocate the scatterlist associated. Is a wrapper for unmap_dma_buf() of +* dma_buf_ops. +* @attach: [in] attachment to unmap buffer from +* @sg_table: [in] scatterlist info of the buffer to unmap +* @direction: [in] direction of DMA transfer +* +* Unlocked variant of dma_buf_unmap_attachment_locked(). +*/ +void dma_buf_unmap_attachment_unlocked (struct dma_buf_attachment *attach, +struct sg_table *sg_table, +enum dma_data_direction direction) +{ +might_sleep (); + +if (WARN_ON (!attach || !attach->dmabuf || !sg_table)) +return ; + +dma_resv_lock (attach->dmabuf->resv,NULL ); +dma_buf_unmap_attachment_locked (attach, sg_table, direction); +dma_resv_unlock (attach->dmabuf->resv); +}EXPORT_SYMBOL_NS_GPL (dma_buf_unmap_attachment_unlocked,DMA_BUF );/** @@ -1174,8 +1274,8 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_move_notify, DMA_BUF);* * Interfaces:: * -* void \*dma_buf_vmap(struct dma_buf \*dmabuf, struct iosys_map \*map) -* void dma_buf_vunmap(struct dma_buf \*dmabuf, struct iosys_map \*map) +* void \*dma_buf_vmap_unlocked(struct dma_buf \*dmabuf, struct iosys_map \*map) +* void dma_buf_vunmap_unlocked(struct dma_buf \*dmabuf, struct iosys_map \*map) * * The vmap call can fail if there is no vmap support in the exporter, or if * it runs out of vmalloc space. Note that the dma-buf layer keeps a reference @@ -1348,6 +1448,8 @@ EXPORT_SYMBOL_NS_GPL(dma_buf_end_cpu_access, DMA_BUF);int dma_buf_mmap_unlocked (struct dma_buf *dmabuf,struct vm_area_struct *vma,unsigned long pgoff) { +int ret; +if (WARN_ON (!dmabuf || !vma))return -EINVAL ;@@ -1368,7 +1470,11 @@ int dma_buf_mmap_unlocked(struct dma_buf *dmabuf, struct vm_area_struct *vma,vma_set_file (vma, dmabuf->file); vma->vm_pgoff = pgoff; -return dmabuf->ops->mmap (dmabuf, vma); +dma_resv_lock (dmabuf->resv,NULL ); + ret = dmabuf->ops->mmap (dmabuf, vma); +dma_resv_unlock (dmabuf->resv); + +return ret; }EXPORT_SYMBOL_NS_GPL (dma_buf_mmap_unlocked,DMA_BUF );@@ -1401,6 +1507,7 @@ int dma_buf_vmap_unlocked(struct dma_buf *dmabuf, struct iosys_map *map)if (!dmabuf->ops->vmap)return -EINVAL ; +dma_resv_lock (dmabuf->resv,NULL );mutex_lock (&dmabuf->lock);if (dmabuf->vmapping_counter) { dmabuf->vmapping_counter++;@@ -1422,6 +1529,7 @@ int dma_buf_vmap_unlocked(struct dma_buf *dmabuf, struct iosys_map *map) out_unlock:mutex_unlock (&dmabuf->lock); +dma_resv_unlock (dmabuf->resv);return ret; }EXPORT_SYMBOL_NS_GPL (dma_buf_vmap_unlocked,DMA_BUF );@@ -1440,6 +1548,7 @@ void dma_buf_vunmap_unlocked(struct dma_buf *dmabuf, struct iosys_map *map)BUG_ON (dmabuf->vmapping_counter ==0 );BUG_ON (!iosys_map_is_equal (&dmabuf->vmap_ptr, map)); +dma_resv_lock (dmabuf->resv,NULL );mutex_lock (&dmabuf->lock);if (--dmabuf->vmapping_counter ==0 ) {if (dmabuf->ops->vunmap)@@ -1447,6 +1556,7 @@ void dma_buf_vunmap_unlocked(struct dma_buf *dmabuf, struct iosys_map *map)iosys_map_clear (&dmabuf->vmap_ptr); }mutex_unlock (&dmabuf->lock); +dma_resv_unlock (dmabuf->resv); }EXPORT_SYMBOL_NS_GPL (dma_buf_vunmap_unlocked,DMA_BUF );drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c +2
-2@@ -882,7 +882,7 @@ static int amdgpu_ttm_backend_bind(struct ttm_device *bdev,struct sg_table *sgt; attach = gtt->gobj->import_attach; - sgt =dma_buf_map_attachment_unlocked (attach,DMA_BIDIRECTIONAL ); + sgt =dma_buf_map_attachment_locked (attach,DMA_BIDIRECTIONAL );if (IS_ERR (sgt))return PTR_ERR (sgt);@@ -1007,7 +1007,7 @@ static void amdgpu_ttm_backend_unbind(struct ttm_device *bdev,struct dma_buf_attachment *attach; attach = gtt->gobj->import_attach; -dma_buf_unmap_attachment_unlocked (attach, ttm->sg,DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_locked (attach, ttm->sg,DMA_BIDIRECTIONAL ); ttm->sg =NULL ; }drivers/gpu/drm/drm_prime.c +2
-2@@ -678,7 +678,7 @@ int drm_gem_dmabuf_vmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -return drm_gem_vmap_unlocked (obj, map); +return drm_gem_vmap (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vmap);@@ -694,7 +694,7 @@ void drm_gem_dmabuf_vunmap(struct dma_buf *dma_buf, struct iosys_map *map) {struct drm_gem_object *obj = dma_buf->priv; -drm_gem_vunmap_unlocked (obj, map); +drm_gem_vunmap (obj, map); }EXPORT_SYMBOL (drm_gem_dmabuf_vunmap);drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +4
-4@@ -241,8 +241,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)assert_object_held (obj); - pages =dma_buf_map_attachment_unlocked (obj->base.import_attach, -DMA_BIDIRECTIONAL ); + pages =dma_buf_map_attachment_locked (obj->base.import_attach, +DMA_BIDIRECTIONAL );if (IS_ERR (pages))return PTR_ERR (pages);@@ -270,8 +270,8 @@ static int i915_gem_object_get_pages_dmabuf(struct drm_i915_gem_object *obj)static void i915_gem_object_put_pages_dmabuf (struct drm_i915_gem_object *obj,struct sg_table *pages) { -dma_buf_unmap_attachment_unlocked (obj->base.import_attach, pages, -DMA_BIDIRECTIONAL ); +dma_buf_unmap_attachment_locked (obj->base.import_attach, pages, +DMA_BIDIRECTIONAL ); }static const struct drm_i915_gem_object_ops i915_gem_object_dmabuf_ops = {include/linux/dma-buf.h +17
-11@@ -46,7 +46,7 @@ struct dma_buf_ops {/** * @attach: * -* This is called from dma_buf_attach() to make sure that a given +* This is called from dma_buf_attach_unlocked() to make sure that a given * &dma_buf_attachment.dev can access the provided &dma_buf. Exporters * which support buffer objects in special locations like VRAM or * device-specific carveout areas should check whether the buffer could @@ -74,7 +74,7 @@ struct dma_buf_ops {/** * @detach: * -* This is called by dma_buf_detach() to release a &dma_buf_attachment. +* This is called by dma_buf_detach_unlocked() to release a &dma_buf_attachment. * Provided so that exporters can clean up any housekeeping for an * &dma_buf_attachment. * @@ -94,7 +94,7 @@ struct dma_buf_ops {* exclusive with @cache_sgt_mapping. * * This is called automatically for non-dynamic importers from -* dma_buf_attach(). +* dma_buf_attach_unlocked(). * * Note that similar to non-dynamic exporters in their @map_dma_buf * callback the driver must guarantee that the memory is available for @@ -124,8 +124,8 @@ struct dma_buf_ops {/** * @map_dma_buf: * -* This is called by dma_buf_map_attachment() and is used to map a -* shared &dma_buf into device address space, and it is mandatory. It +* This is called by dma_buf_map_attachment_locked() and is used to map +* a shared &dma_buf into device address space, and it is mandatory. It * can only be called if @attach has been called successfully. * * This call may sleep, e.g. when the backing storage first needs to be @@ -181,8 +181,8 @@ struct dma_buf_ops {/** * @unmap_dma_buf: * -* This is called by dma_buf_unmap_attachment() and should unmap and -* release the &sg_table allocated in @map_dma_buf, and it is mandatory. +* This is called by dma_buf_unmap_attachment_locked() and should unmap +* and release the &sg_table allocated in @map_dma_buf, and it is mandatory. * For static dma_buf handling this might also unpin the backing * storage if this is the last mapping of the DMA buffer. */ @@ -509,10 +509,10 @@ struct dma_buf_attach_ops {* and its user device(s). The list contains one attachment struct per device * attached to the buffer. * -* An attachment is created by calling dma_buf_attach(), and released again by -* calling dma_buf_detach(). The DMA mapping itself needed to initiate a -* transfer is created by dma_buf_map_attachment() and freed again by calling -* dma_buf_unmap_attachment(). +* An attachment is created by calling dma_buf_attach_unlocked(), and released +* again by calling dma_buf_detach_unlocked(). The DMA mapping itself needed to +* initiate a transfer is created by dma_buf_map_attachment_locked() and freed +* again by calling dma_buf_unmap_attachment_locked(). */ struct dma_buf_attachment {struct dma_buf *dmabuf;@@ -626,6 +626,12 @@ void dma_buf_unmap_attachment_unlocked(struct dma_buf_attachment *, struct sg_table *, enum dma_data_direction); +struct sg_table *dma_buf_map_attachment_locked (struct dma_buf_attachment *, +enum dma_data_direction ); +void dma_buf_unmap_attachment_locked (struct dma_buf_attachment *attach, +struct sg_table *sg_table, +enum dma_data_direction direction); +void dma_buf_move_notify (struct dma_buf *dma_buf);int dma_buf_begin_cpu_access (struct dma_buf *dma_buf,enum dma_data_direction dir);
Re: [Linaro-mm-sig] [PATCH v2 3/5] dma-buf: Move all dma-bufs to dynamic locking specification
Quoted 12 lines · Christian König
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 10 lines
This patch moves the non-dynamic dma-buf users over to the dynamic locking specification. The strict locking convention prevents deadlock situation for dma-buf importers and exporters.
Previously the "unlocked" versions of the dma-buf API functions weren't taking the reservation lock and this patch makes them to take the lock.
Intel and AMD GPU drivers already were mapping imported dma-bufs under the held lock, hence the "locked" variant of the functions are added for them and the drivers are updated to use the "locked" versions.
Quoted 6 lines
In general "Yes, please", but that won't be that easy.
You not only need to change amdgpu and i915, but all drivers implementing the
map_dma_buf(),unmap_dma_buf()callbacks.Auditing all that code is a huge bunch of work.
Hm, neither of drivers take the resv lock in map_dma_buf/unmap_dma_buf. It's easy to audit them all and I did it. So either I'm missing something or it doesn't take much time to check them all. Am I really missing something?
https://elixir.bootlin.com/linux/latest/A/ident/map_dma_buf
Signature · 2 lines
Best regards, Dmitry
Christian König
maintainerRe: [Linaro-mm-sig] [PATCH v2 3/5] dma-buf: Move all dma-bufs to dynamic locking specification
Am 10.08.22 um 19:49 schrieb Dmitry Osipenko:
Quoted 14 lines · Christian König
Quoted 13 lines
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 10 lines
This patch moves the non-dynamic dma-buf users over to the dynamic locking specification. The strict locking convention prevents deadlock situation for dma-buf importers and exporters.
Previously the "unlocked" versions of the dma-buf API functions weren't taking the reservation lock and this patch makes them to take the lock.
Intel and AMD GPU drivers already were mapping imported dma-bufs under the held lock, hence the "locked" variant of the functions are added for them and the drivers are updated to use the "locked" versions.
In general "Yes, please", but that won't be that easy.
Quoted 8 lines
Quoted 4 lines
You not only need to change amdgpu and i915, but all drivers implementing the
map_dma_buf(),unmap_dma_buf()callbacks.Auditing all that code is a huge bunch of work.
Hm, neither of drivers take the resv lock in map_dma_buf/unmap_dma_buf. It's easy to audit them all and I did it. So either I'm missing something or it doesn't take much time to check them all. Am I really missing something?
Ok, so this is only changing map/unmap now?
In this case please separate this from the documentation change.
I would also drop the _locked postfix from the function name, just having _unlocked on all functions which are supposed to be called with the lock held should be sufficient.
Thanks for looking into this,
Christian.
Re: [Linaro-mm-sig] [PATCH v2 3/5] dma-buf: Move all dma-bufs to dynamic locking specification
Quoted 18 lines · Christian König
Am 10.08.22 um 19:49 schrieb Dmitry Osipenko:
Quoted 17 lines · Christian König
Quoted 16 lines
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 10 lines
This patch moves the non-dynamic dma-buf users over to the dynamic locking specification. The strict locking convention prevents deadlock situation for dma-buf importers and exporters.
Previously the "unlocked" versions of the dma-buf API functions weren't taking the reservation lock and this patch makes them to take the lock.
Intel and AMD GPU drivers already were mapping imported dma-bufs under the held lock, hence the "locked" variant of the functions are added for them and the drivers are updated to use the "locked" versions.
In general "Yes, please", but that won't be that easy.
You not only need to change amdgpu and i915, but all drivers implementing the
map_dma_buf(),unmap_dma_buf()callbacks.
Quoted 7 lines
Quoted 5 lines
Quoted 1 line
Auditing all that code is a huge bunch of work.
Hm, neither of drivers take the resv lock in map_dma_buf/unmap_dma_buf. It's easy to audit them all and I did it. So either I'm missing something or it doesn't take much time to check them all. Am I really missing something?
Ok, so this is only changing map/unmap now?
It also vmap/vunmap and attach/detach: In the previous patch I added the _unlocked postfix to the func names and in this patch I made them all to actually take the lock.
Quoted 1 line
In this case please separate this from the documentation change.
I'll factor out the doc in the v3.
Quoted 3 lines
I would also drop the
_lockedpostfix from the function name, just having_unlockedon all functions which are supposed to be called with the lock held should be sufficient.
Noted for the v3.
Quoted 2 lines
Thanks for looking into this,
Christian.
Thank you for the review.
Signature · 2 lines
Best regards, Dmitry
Re: [Linaro-mm-sig] [PATCH v2 3/5] dma-buf: Move all dma-bufs to dynamic locking specification
Am 10.08.22 um 20:53 schrieb Dmitry Osipenko:
Quoted 20 lines · Christian König
Quoted 19 lines
Am 10.08.22 um 19:49 schrieb Dmitry Osipenko:
Quoted 18 lines · Christian König
Quoted 17 lines
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 10 lines
This patch moves the non-dynamic dma-buf users over to the dynamic locking specification. The strict locking convention prevents deadlock situation for dma-buf importers and exporters.
Previously the "unlocked" versions of the dma-buf API functions weren't taking the reservation lock and this patch makes them to take the lock.
Intel and AMD GPU drivers already were mapping imported dma-bufs under the held lock, hence the "locked" variant of the functions are added for them and the drivers are updated to use the "locked" versions.
In general "Yes, please", but that won't be that easy.
You not only need to change amdgpu and i915, but all drivers implementing the
map_dma_buf(),unmap_dma_buf()callbacks.Auditing all that code is a huge bunch of work.
Quoted 8 lines
Quoted 5 lines
Quoted 4 lines
Hm, neither of drivers take the resv lock in map_dma_buf/unmap_dma_buf. It's easy to audit them all and I did it. So either I'm missing something or it doesn't take much time to check them all. Am I really missing something?
Ok, so this is only changing map/unmap now?
It also vmap/vunmap and attach/detach: In the previous patch I added the
_unlockedpostfix to the func names and in this patch I made them all to actually take the lock.
Take your patch "[PATCH v2 2/5] drm/gem: Take reservation lock for vmap/vunmap operations" as a blueprint on how to approach it.
E.g. one callback at a time and then document the result in the end.
Regards,
Christian.
Quoted 13 lines
Quoted 2 lines
In this case please separate this from the documentation change.
I'll factor out the doc in the v3.
Quoted 3 lines
I would also drop the
_lockedpostfix from the function name, just having_unlockedon all functions which are supposed to be called with the lock held should be sufficient.Noted for the v3.
Quoted 2 lines
Thanks for looking into this,
Christian.Thank you for the review.
Re: [Linaro-mm-sig] [PATCH v2 3/5] dma-buf: Move all dma-bufs to dynamic locking specification
Quoted 37 lines · Christian König
Am 10.08.22 um 20:53 schrieb Dmitry Osipenko:
Quoted 24 lines · Christian König
Quoted 23 lines
Am 10.08.22 um 19:49 schrieb Dmitry Osipenko:
Quoted 22 lines · Christian König
Quoted 21 lines
Am 25.07.22 um 17:18 schrieb Dmitry Osipenko:
Quoted 10 lines
This patch moves the non-dynamic dma-buf users over to the dynamic locking specification. The strict locking convention prevents deadlock
situation for dma-buf importers and exporters.Previously the "unlocked" versions of the dma-buf API functions weren't
taking the reservation lock and this patch makes them to take the lock.Quoted 4 lines
Intel and AMD GPU drivers already were mapping imported dma-bufs under
the held lock, hence the "locked" variant of the functions are added for them and the drivers are updated to use the "locked" versions.In general "Yes, please", but that won't be that easy.
You not only need to change amdgpu and i915, but all drivers implementing the
map_dma_buf(),unmap_dma_buf()callbacks.Auditing all that code is a huge bunch of work.
Quoted 8 lines
Quoted 5 lines
Quoted 4 lines
Hm, neither of drivers take the resv lock in map_dma_buf/unmap_dma_buf. It's easy to audit them all and I did it. So either I'm missing something or it doesn't take much time to check them all. Am I really missing something?
Ok, so this is only changing map/unmap now?
It also vmap/vunmap and attach/detach: In the previous patch I added the
_unlockedpostfix to the func names and in this patch I made them all to actually take the lock.
Quoted 4 lines
Take your patch "[PATCH v2 2/5] drm/gem: Take reservation lock for vmap/vunmap operations" as a blueprint on how to approach it.
E.g. one callback at a time and then document the result in the end.
Yeah, I'll do it for v3. I'm vaguely recalling that there was a problem when I wanted to split this patch in the past, but don't remember what it was.. maybe that problem is gone now, will see :)
Signature · 2 lines
Best regards, Dmitry
Re: [Linaro-mm-sig] [PATCH v2 3/5] dma-buf: Move all dma-bufs to dynamic locking specification
In reply to Christian KönigQuoted 3 lines · Christian König
Quoted 1 line
+ * -
dma_buf_move_notify()This one is called by the exporter, not the importer.
Good catch, thank you!
Signature · 2 lines
Best regards, Dmitry
PATCH v2 4/5 media: videobuf2: Stop using internal dma-buf lock
In reply to Dmitry OsipenkoAll drivers that use dma-bufs have been moved to the updated locking specification and now dma-buf reservation is guaranteed to be locked by importers during the mapping operations. There is no need to take the internal dma-buf lock anymore. Remove locking from the videobuf2 memory allocators.
--- drivers/media/common/videobuf2/videobuf2-dma-contig.c | 11 +---------- drivers/media/common/videobuf2/videobuf2-dma-sg.c | 11 +---------- drivers/media/common/videobuf2/videobuf2-vmalloc.c | 11 +---------- 3 files changed, 3 insertions(+), 30 deletions(-)
drivers/media/common/videobuf2/videobuf2-dma-contig.c +1 -10
@@ -382,18 +382,12 @@ static struct sg_table *vb2_dc_dmabuf_ops_map( struct dma_buf_attachment *db_attach, enum dma_data_direction dma_dir) { struct vb2_dc_attachment *attach = db_attach->priv; -/* stealing dmabuf mutex to serialize map/unmap operations */ -struct mutex *lock = &db_attach->dmabuf->lock;struct sg_table *sgt; -mutex_lock (lock); - sgt = &attach->sgt;/* return previously mapped sg table */ -if (attach->dma_dir == dma_dir) { -mutex_unlock (lock); +if (attach->dma_dir == dma_dir)return sgt; - }/* release any previous cache */ if (attach->dma_dir !=DMA_NONE ) {
@@ -409,14 +403,11 @@ static struct sg_table *vb2_dc_dmabuf_ops_map(if (dma_map_sgtable (db_attach->dev, sgt, dma_dir,DMA_ATTR_SKIP_CPU_SYNC )) {pr_err ("failed to map scatterlist\n" ); -mutex_unlock (lock);return ERR_PTR (-EIO ); } attach->dma_dir = dma_dir; -mutex_unlock (lock); -return sgt; }
drivers/media/common/videobuf2/videobuf2-dma-sg.c +1 -10
@@ -424,18 +424,12 @@ static struct sg_table *vb2_dma_sg_dmabuf_ops_map( struct dma_buf_attachment *db_attach, enum dma_data_direction dma_dir) { struct vb2_dma_sg_attachment *attach = db_attach->priv; -/* stealing dmabuf mutex to serialize map/unmap operations */ -struct mutex *lock = &db_attach->dmabuf->lock;struct sg_table *sgt; -mutex_lock (lock); - sgt = &attach->sgt;/* return previously mapped sg table */ -if (attach->dma_dir == dma_dir) { -mutex_unlock (lock); +if (attach->dma_dir == dma_dir)return sgt; - }/* release any previous cache */ if (attach->dma_dir !=DMA_NONE ) {
@@ -446,14 +440,11 @@ static struct sg_table *vb2_dma_sg_dmabuf_ops_map(/* mapping to the client with new direction */ if (dma_map_sgtable (db_attach->dev, sgt, dma_dir,0 )) {pr_err ("failed to map scatterlist\n" ); -mutex_unlock (lock);return ERR_PTR (-EIO ); } attach->dma_dir = dma_dir; -mutex_unlock (lock); -return sgt; }
drivers/media/common/videobuf2/videobuf2-vmalloc.c +1 -10
@@ -267,18 +267,12 @@ static struct sg_table *vb2_vmalloc_dmabuf_ops_map( struct dma_buf_attachment *db_attach, enum dma_data_direction dma_dir) { struct vb2_vmalloc_attachment *attach = db_attach->priv; -/* stealing dmabuf mutex to serialize map/unmap operations */ -struct mutex *lock = &db_attach->dmabuf->lock;struct sg_table *sgt; -mutex_lock (lock); - sgt = &attach->sgt;/* return previously mapped sg table */ -if (attach->dma_dir == dma_dir) { -mutex_unlock (lock); +if (attach->dma_dir == dma_dir)return sgt; - }/* release any previous cache */ if (attach->dma_dir !=DMA_NONE ) {
@@ -289,14 +283,11 @@ static struct sg_table *vb2_vmalloc_dmabuf_ops_map(/* mapping to the client with new direction */ if (dma_map_sgtable (db_attach->dev, sgt, dma_dir,0 )) {pr_err ("failed to map scatterlist\n" ); -mutex_unlock (lock);return ERR_PTR (-EIO ); } attach->dma_dir = dma_dir; -mutex_unlock (lock); -return sgt; }
Signature · 1 line
2.36.1
PATCH v2 5/5 dma-buf: Remove internal lock
In reply to Dmitry OsipenkoThe internal dma-buf lock isn't needed anymore because the updated locking specification claims that dma-buf reservation must be locked by importers, and thus, the internal data is already protected by the reservation lock. Remove the obsoleted internal lock.
--- drivers/dma-buf/dma-buf.c | 5 ----- include/linux/dma-buf.h | 9 --------- 2 files changed, 14 deletions(-)
drivers/dma-buf/dma-buf.c +0 -5
@@ -656,7 +656,6 @@ struct dma_buf *dma_buf_export(const struct dma_buf_export_info *exp_info) dmabuf->file = file; -mutex_init (&dmabuf->lock);INIT_LIST_HEAD (&dmabuf->attachments);mutex_lock (&db_list.lock);
@@ -1508,7 +1507,6 @@ int dma_buf_vmap_unlocked(struct dma_buf *dmabuf, struct iosys_map *map)return -EINVAL ;dma_resv_lock (dmabuf->resv,NULL ); -mutex_lock (&dmabuf->lock);if (dmabuf->vmapping_counter) { dmabuf->vmapping_counter++;BUG_ON (iosys_map_is_null (&dmabuf->vmap_ptr));
@@ -1528,7 +1526,6 @@ int dma_buf_vmap_unlocked(struct dma_buf *dmabuf, struct iosys_map *map) *map = dmabuf->vmap_ptr; out_unlock: -mutex_unlock (&dmabuf->lock);dma_resv_unlock (dmabuf->resv);return ret; }
@@ -1549,13 +1546,11 @@ void dma_buf_vunmap_unlocked(struct dma_buf *dmabuf, struct iosys_map *map)BUG_ON (!iosys_map_is_equal (&dmabuf->vmap_ptr, map));dma_resv_lock (dmabuf->resv,NULL ); -mutex_lock (&dmabuf->lock);if (--dmabuf->vmapping_counter ==0 ) {if (dmabuf->ops->vunmap) dmabuf->ops->vunmap (dmabuf, map);iosys_map_clear (&dmabuf->vmap_ptr); } -mutex_unlock (&dmabuf->lock);dma_resv_unlock (dmabuf->resv); }EXPORT_SYMBOL_NS_GPL (dma_buf_vunmap_unlocked,DMA_BUF );
include/linux/dma-buf.h +0 -9
@@ -326,15 +326,6 @@ struct dma_buf {/** @ops: dma_buf_ops associated with this buffer object. */ const struct dma_buf_ops *ops; -/** -* @lock: -* -* Used internally to serialize list manipulation, attach/detach and -* vmap/unmap. Note that in many cases this is superseeded by -* dma_resv_lock() on @resv. -*/ -struct mutex lock; -/** * @vmapping_counter: *
Signature · 1 line
2.36.1
Patchwork
CI[Intel-gfx] ✗ Fi.CI.BUILD: failure for Move all drivers to a common dma-buf locking convention
In reply to Dmitry Osipenko== Series Details ==
== Series Details ==
Series: Move all drivers to a common dma-buf locking convention
URL : https://patchwork.freedesktop.org/series/106980/
State : failure
== Summary ==
Error: patch https://patchwork.freedesktop.org/api/1.0/series/106980/revisions/1/mbox/ not applied
Applying: dma-buf: Add _unlocked postfix to function names
Using index info to reconstruct a base tree...
M drivers/dma-buf/dma-buf.c
M drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c
M drivers/gpu/drm/armada/armada_gem.c
A drivers/gpu/drm/drm_gem_cma_helper.c
M drivers/gpu/drm/drm_gem_shmem_helper.c
Falling back to patching base and 3-way merge...
Auto-merging drivers/gpu/drm/drm_gem_shmem_helper.c
Auto-merging drivers/gpu/drm/drm_gem_dma_helper.c
CONFLICT (content): Merge conflict in drivers/gpu/drm/drm_gem_dma_helper.c Auto-merging drivers/gpu/drm/armada/armada_gem.c
Auto-merging drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c
Auto-merging drivers/dma-buf/dma-buf.c
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
Patch failed at 0001 dma-buf: Add _unlocked postfix to function names
When you have resolved this problem, run "git am --continue".
If you prefer to skip this patch, run "git am --skip" instead.
To restore the original branch and stop patching, run "git am --abort".