Skip to content

cover-letter: Allow MMIO regions to be exported through dmabuf

Wei Lin Guay dri-devel kvm linux-rdma 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest4 patches 14 repliesIn review

v2 from the cover letter

- Name the new file dma_buf.c
- Restore orig_nents before freeing
- Fix reversed logic around priv->revoked
- Set priv->index
- Rebased on v2 "Break up ioctl dispatch functions"
v1: https://lore.kernel.org/r/[email protected]

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/4vfio: Add vfio_device_get()drivers/vfio/vfio_main.c include/linux/vfio.h+7 -00 replies
2/4dma-buf: Add dma_buf_try_get()include/linux/dma-buf.h+13 -00 replies
3/4vfio/pci: Allow MMIO regions to be exported through dma-bufdrivers/vfio/pci/Makefile drivers/vfio/pci/dma_buf.c drivers/vfio/pci/vfio_pci_config.c +4 more+340 -80 replies
4/4vfio/pci: Allow export dmabuf without move_notify from importerdrivers/vfio/pci/dma_buf.c drivers/vfio/pci/vfio_pci_core.c drivers/vfio/pci/vfio_pci_priv.h+50 -50 replies

Reviews trailers per patch

All 4 patches have a Reviewed-by or Acked-by.

PatchDag MoxnesKeith BuschNic Viljoen
1/4R-b R-b R-b
2/4R-b R-b R-b
3/4R-b R-b R-b
4/4R-b R-b R-b

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 3 reviewers.

Read the v1 thread

Cover letter [PATCH 0/4] cover-letter: Allow MMIO regions to be exported through dmabuf

From: Wei Lin Guay <[email protected]>

This is another attempt to revive the patches posted by Jason Gunthorpe and Vivek Kasireddy, at
https://patchwork.kernel.org/project/linux-media/cover/[email protected]/
https://lwn.net/Articles/970751/

In addition to the initial proposal by Jason, another promising application is exposing memory from an AI accelerator (bound to VFIO) to an RDMA device. This would allow the RDMA device to directly access the accelerator's memory, thereby facilitating direct data transactions between the RDMA device and the accelerator.

Below is from the text/motivation from the orginal cover letter.

dma-buf has become a way to safely acquire a handle to non-struct page memory that can still have lifetime controlled by the exporter. Notably RDMA can now import dma-buf FDs and build them into MRs which allows for PCI P2P operations. Extend this to allow vfio-pci to export MMIO memory from PCI device BARs.

This series supports a use case for SPDK where a NVMe device will be owned by SPDK through VFIO but interacting with a RDMA device. The RDMA device may directly access the NVMe CMB or directly manipulate the NVMe device's doorbell using PCI P2P.

However, as a general mechanism, it can support many other scenarios with VFIO. I imagine this dmabuf approach to be usable by iommufd as well for generic and safe P2P mappings.

This series goes after the "Break up ioctl dispatch functions to one function per ioctl" series.

v2:
- Name the new file dma_buf.c
- Restore orig_nents before freeing
- Fix reversed logic around priv->revoked
- Set priv->index
- Rebased on v2 "Break up ioctl dispatch functions"
v1: https://lore.kernel.org/r/[email protected]

Cc Oded Gabbay <[email protected]>
Cc Christian König <[email protected]>
Cc Daniel Vetter <[email protected]>
Cc Leon Romanovsky <[email protected]>
Cc Maor Gottlieb <[email protected]>

Jason Gunthorpe (3):
vfio: Add vfio_device_get()
dma-buf: Add dma_buf_try_get()
vfio/pci: Allow MMIO regions to be exported through dma-buf

Wei Lin Guay (1):
vfio/pci: Allow export dmabuf without move_notify from importer

 drivers/vfio/pci/Makefile          |   1 +
 drivers/vfio/pci/dma_buf.c         | 291 +++++++++++++++++++++++++++++
 drivers/vfio/pci/vfio_pci_config.c |   8 +-
 drivers/vfio/pci/vfio_pci_core.c   |  44 ++++-
 drivers/vfio/pci/vfio_pci_priv.h   |  30 +++
 drivers/vfio/vfio_main.c           |   1 +
 include/linux/dma-buf.h            |  13 ++
 include/linux/vfio.h               |   6 +
 include/linux/vfio_pci_core.h      |   1 +
 include/uapi/linux/vfio.h          |  18 ++
 10 files changed, 405 insertions(+), 8 deletions(-)
 create mode 100644 drivers/vfio/pci/dma_buf.c

--
2.43.5