Skip to contentSkip to conversation

doc: add information to update dma entry limit

PATCH Superseded Nipun Gupta 2 participants 4 messages Jul 5, 2023 – Jul 20, 2023

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 doc: add information to update dma entry limit

VFIO module provides configurable dma_entry_limit parameter to store the DMA entries. By default this is 64K and if we are using --no-huge, we shall need to increase the value of dma_entry_limit. Add commands in linux_gsg document to change the dma_entry_limit.

---
 doc/guides/linux_gsg/linux_drivers.rst | 15 +++++++++++++++
 1 file changed, 15 insertions(+)
doc/guides/linux_gsg/linux_drivers.rst +15 -0
index 2cec1ebede..b729bb38a8 100644
@@ -180,6 +180,21 @@ VFIO module parameter ``dma_entry_limit`` with a default value of 64K.
 When application is out of DMA entries, these limits need to be adjusted to
 increase the allowed limit.
 
+When ``no-huge`` parameter is used, the page size used is of smaller size of
+``4K`` or ``64K`` and we shall need to increase ``dma_entry_limit``.
+To update the ``dma_entry_limit``, ``vfio_iommu_type1`` has to be loaded with
+additional module parameter:
+
+.. code-block:: console
+
+   modprobe vfio_iommu_type1 dma_entry_limit=512000
+
+Alternatively, one can also change this value in an already loaded kernel module:
+
+.. code-block:: console
+
+   echo 512000 > /sys/module/vfio_iommu_type1/parameters/dma_entry_limit
+
 Creating Virtual Functions using vfio-pci
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 
Signature · 1 line
2.17.1
#1 lore raw

05/07/2023 12:53, Nipun Gupta:

Quoted 17 lines

VFIO module provides configurable dma_entry_limit parameter to store the DMA entries. By default this is 64K and if we are using --no-huge, we shall need to increase the value of dma_entry_limit. Add commands in linux_gsg document to change the dma_entry_limit.

---
 doc/guides/linux_gsg/linux_drivers.rst | 15 +++++++++++++++
 1 file changed, 15 insertions(+)
doc/guides/linux_gsg/linux_drivers.rst +0 -0
index 2cec1ebede..b729bb38a8 100644

doc/guides/linux_gsg/linux_drivers.rst VFIO module parameter ``dma_entry_limit`` with a default value of 64K. · line 183

Quoted 4 lines
doc/guides/linux_gsg/linux_drivers.rst +1 -0
@@ -180,6 +180,21 @@ VFIO module parameter ``dma_entry_limit`` with a default value of 64K.
 When application is out of DMA entries, these limits need to be adjusted to
 increase the allowed limit.
 
+When ``no-huge`` parameter is used, the page size used is of smaller size of

I would add "--" to have the full option "--no-huge". By the way, this is an "option" in the shell language :-)

doc/guides/linux_gsg/linux_drivers.rst VFIO module parameter ``dma_entry_limit`` with a default value of 64K. · line 196

Quoted 13 lines
doc/guides/linux_gsg/linux_drivers.rst +13 -0
+``4K`` or ``64K`` and we shall need to increase ``dma_entry_limit``.
+To update the ``dma_entry_limit``, ``vfio_iommu_type1`` has to be loaded with
+additional module parameter:
+
+.. code-block:: console
+
+   modprobe vfio_iommu_type1 dma_entry_limit=512000
+
+Alternatively, one can also change this value in an already loaded kernel module:
+
+.. code-block:: console
+
+   echo 512000 > /sys/module/vfio_iommu_type1/parameters/dma_entry_limit

That looks good, thank you.

#2 lore raw

PATCH v2 1/1 doc: add information to update dma entry limit

In reply to Nipun Gupta

VFIO module provides configurable dma_entry_limit parameter to store the DMA entries. By default this is 64K and if we are using --no-huge, we shall need to increase the value of dma_entry_limit. Add commands in linux_gsg document to change the dma_entry_limit.

---

Changes v1->v2:
- updated param 'no-huge' to '--no-huge' in documentation

 doc/guides/linux_gsg/linux_drivers.rst | 15 +++++++++++++++
 1 file changed, 15 insertions(+)
doc/guides/linux_gsg/linux_drivers.rst +15 -0
index 2cec1ebede..b729bb38a8 100644
@@ -180,6 +180,21 @@ VFIO module parameter ``dma_entry_limit`` with a default value of 64K.
 When application is out of DMA entries, these limits need to be adjusted to
 increase the allowed limit.
 
+When ``--no-huge`` parameter is used, the page size used is of smaller size of
+``4K`` or ``64K`` and we shall need to increase ``dma_entry_limit``.
+To update the ``dma_entry_limit``, ``vfio_iommu_type1`` has to be loaded with
+additional module parameter:
+
+.. code-block:: console
+
+   modprobe vfio_iommu_type1 dma_entry_limit=512000
+
+Alternatively, one can also change this value in an already loaded kernel module:
+
+.. code-block:: console
+
+   echo 512000 > /sys/module/vfio_iommu_type1/parameters/dma_entry_limit
+
 Creating Virtual Functions using vfio-pci
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 
Signature · 1 line
2.17.1
#3 lore raw

05/07/2023 15:39, Nipun Gupta:

Quoted 8 lines

VFIO module provides configurable dma_entry_limit parameter to store the DMA entries. By default this is 64K and if we are using --no-huge, we shall need to increase the value of dma_entry_limit. Add commands in linux_gsg document to change the dma_entry_limit.

Applied, thanks.