iommu/amd: Add PPR overflow support
Subsystems (2)
Vasant Hegde
maintainerv3 cover iommu/amd: Add PPR overflow support
Current IOMMU driver is lacking PPR log overflow handling. Add logic to restart PPR log after an overflow has occurred.
Patches applies on top of iommu/next branch (commit a7a334076dd).
Changes from v2 -> v3
- Added Review-by from Joao.
V2 : https://lore.kernel.org/linux-iommu/[email protected]/
Changes from v1 -> v2:
- Updated patch description
- Added Review-by
v1: https://lore.kernel.org/linux-iommu/[email protected]/
Vasant Hegde (2):
iommu/amd: Generalize log overflow handling
iommu/amd: Handle PPR log overflow
Vasant Hegde (2):
iommu/amd: Generalize log overflow handling
iommu/amd: Handle PPR log overflow
drivers/iommu/amd/amd_iommu.h | 1 + drivers/iommu/amd/amd_iommu_types.h | 5 ++- drivers/iommu/amd/init.c | 60 ++++++++++++++++++++--------- drivers/iommu/amd/iommu.c | 13 +++++-- 4 files changed, 57 insertions(+), 22 deletions(-)
Signature · 1 line
2.31.1
Vasant Hegde
maintainerPATCH v3 1/2 iommu/amd: Generalize log overflow handling
Each IOMMU has three log buffers (Event, GA and PPR log). Once a buffer becomes full, IOMMU generates an interrupt with the corresponding overflow status bit, and stop processing the log. To handle an overflow, the IOMMU driver needs to disable the log, clear the overflow status bit, and re-enable the log. This procedure is same among all types of log buffer except it uses different overflow status bit and enabling bit.
Hence, to consolidate the log buffer restarting logic, introduce a helper function amd_iommu_restart_log(), which caller can specify parameters specific for each type of log buffer.
Also rename MMIO_STATUS_EVT_OVERFLOW_INT_MASK asMMIO_STATUS_EVT_OVERFLOW_MASK.
--- drivers/iommu/amd/amd_iommu_types.h | 3 +- drivers/iommu/amd/init.c | 51 ++++++++++++++++++----------- drivers/iommu/amd/iommu.c | 4 +-- 3 files changed, 36 insertions(+), 22 deletions(-)
drivers/iommu/amd/amd_iommu_types.h +2 -1
@@ -120,9 +120,10 @@#define PASID_MASK 0x0000ffff/* MMIO status bits */ -#define MMIO_STATUS_EVT_OVERFLOW_INT_MASK BIT(0) +#define MMIO_STATUS_EVT_OVERFLOW_MASK BIT(0)#define MMIO_STATUS_EVT_INT_MASK BIT(1)#define MMIO_STATUS_COM_WAIT_INT_MASK BIT(2) +#define MMIO_STATUS_EVT_RUN_MASK BIT(3)#define MMIO_STATUS_PPR_INT_MASK BIT(6)#define MMIO_STATUS_GALOG_RUN_MASK BIT(8)#define MMIO_STATUS_GALOG_OVERFLOW_MASK BIT(9)
drivers/iommu/amd/init.c +32 -19
70 lines not on this page · raw message
drivers/iommu/amd/iommu.c +2 -2
@@ -842,7 +842,7 @@ amd_iommu_set_pci_msi_domain(struct device *dev, struct amd_iommu *iommu) { }#endif /* !CONFIG_IRQ_REMAP */ #define AMD_IOMMU_INT_MASK \ - (MMIO_STATUS_EVT_OVERFLOW_INT_MASK | \ + (MMIO_STATUS_EVT_OVERFLOW_MASK | \ MMIO_STATUS_EVT_INT_MASK | \ MMIO_STATUS_PPR_INT_MASK | \ MMIO_STATUS_GALOG_OVERFLOW_MASK | \
@@ -881,7 +881,7 @@ irqreturn_t amd_iommu_int_thread(int irq, void *data) }#endif -if (status &MMIO_STATUS_EVT_OVERFLOW_INT_MASK ) { +if (status &MMIO_STATUS_EVT_OVERFLOW_MASK ) {pr_info_ratelimited ("IOMMU event log overflow\n" );amd_iommu_restart_event_logging (iommu); }
Signature · 1 line
2.31.1
Vasant Hegde
maintainerPATCH v3 2/2 iommu/amd: Handle PPR log overflow
In reply to Vasant HegdeSome ATS-capable peripherals can issue requests to the processor to service peripheral page requests using PCIe PRI (the Page Request Interface). IOMMU supports PRI using PPR log buffer. IOMMU writes PRI request to PPR log buffer and sends PPR interrupt to host. When there is no space in the PPR log buffer (PPR log overflow) it will set PprOverflow bit in 'MMIO Offset 2020h IOMMU Status Register'. When this happens PPR log needs to be restarted as specified in IOMMU spec [1] section 2.6.2.
When handling the event it just resumes the PPR log without resizing (similar to the way event and GA log overflow is handled).
Failing to handle PPR overflow means device may not work properly as IOMMU stops processing new PPR events from device.
[1] https://www.amd.com/system/files/TechDocs/48882_3.07_PUB.pdf
--- drivers/iommu/amd/amd_iommu.h | 1 + drivers/iommu/amd/amd_iommu_types.h | 2 ++ drivers/iommu/amd/init.c | 11 +++++++++++ drivers/iommu/amd/iommu.c | 9 ++++++++- 4 files changed, 22 insertions(+), 1 deletion(-)
drivers/iommu/amd/amd_iommu.h +1 -0
@@ -16,6 +16,7 @@ irqreturn_t amd_iommu_int_handler(int irq, void *data);void amd_iommu_apply_erratum_63 (struct amd_iommu *iommu,u16 devid);void amd_iommu_restart_event_logging (struct amd_iommu *iommu);void amd_iommu_restart_ga_log (struct amd_iommu *iommu); +void amd_iommu_restart_ppr_log (struct amd_iommu *iommu);int amd_iommu_init_devices (void );void amd_iommu_uninit_devices (void );void amd_iommu_init_notifier (void );
drivers/iommu/amd/amd_iommu_types.h +2 -0
@@ -124,7 +124,9 @@#define MMIO_STATUS_EVT_INT_MASK BIT(1)#define MMIO_STATUS_COM_WAIT_INT_MASK BIT(2)#define MMIO_STATUS_EVT_RUN_MASK BIT(3) +#define MMIO_STATUS_PPR_OVERFLOW_MASK BIT(5)#define MMIO_STATUS_PPR_INT_MASK BIT(6) +#define MMIO_STATUS_PPR_RUN_MASK BIT(7)#define MMIO_STATUS_GALOG_RUN_MASK BIT(8)#define MMIO_STATUS_GALOG_OVERFLOW_MASK BIT(9)#define MMIO_STATUS_GALOG_INT_MASK BIT(10)
drivers/iommu/amd/init.c +11 -0
@@ -799,6 +799,17 @@ void amd_iommu_restart_ga_log(struct amd_iommu *iommu) MMIO_STATUS_GALOG_OVERFLOW_MASK); } +/* +* This function restarts ppr logging in case the IOMMU experienced +* PPR log overflow. +*/ +void amd_iommu_restart_ppr_log (struct amd_iommu *iommu) +{ +amd_iommu_restart_log (iommu,"PPR" ,CONTROL_PPRINT_EN , +CONTROL_PPRLOG_EN ,MMIO_STATUS_PPR_RUN_MASK , +MMIO_STATUS_PPR_OVERFLOW_MASK ); +} +/* * This function resets the command buffer if the IOMMU stopped fetching * commands from it.
drivers/iommu/amd/iommu.c +8 -1
@@ -844,6 +844,7 @@ amd_iommu_set_pci_msi_domain(struct device *dev, struct amd_iommu *iommu) { }#define AMD_IOMMU_INT_MASK \ (MMIO_STATUS_EVT_OVERFLOW_MASK | \ MMIO_STATUS_EVT_INT_MASK | \ + MMIO_STATUS_PPR_OVERFLOW_MASK | \ MMIO_STATUS_PPR_INT_MASK | \ MMIO_STATUS_GALOG_OVERFLOW_MASK | \ MMIO_STATUS_GALOG_INT_MASK)
@@ -863,11 +864,17 @@ irqreturn_t amd_iommu_int_thread(int irq, void *data)iommu_poll_events (iommu); } -if (status &MMIO_STATUS_PPR_INT_MASK ) { +if (status & (MMIO_STATUS_PPR_INT_MASK | +MMIO_STATUS_PPR_OVERFLOW_MASK )) {pr_devel ("Processing IOMMU PPR Log\n" );iommu_poll_ppr_log (iommu); } +if (status &MMIO_STATUS_PPR_OVERFLOW_MASK ) { +pr_info_ratelimited ("IOMMU PPR log overflow\n" ); +amd_iommu_restart_ppr_log (iommu); + } +#ifdef CONFIG_IRQ_REMAP if (status & (MMIO_STATUS_GALOG_INT_MASK |MMIO_STATUS_GALOG_OVERFLOW_MASK )) {
Signature · 1 line
2.31.1
Quoted 9 lines · Vasant Hegde
Vasant Hegde (2):
iommu/amd: Generalize log overflow handling
iommu/amd: Handle PPR log overflowdrivers/iommu/amd/amd_iommu.h | 1 + drivers/iommu/amd/amd_iommu_types.h | 5 ++- drivers/iommu/amd/init.c | 60 ++++++++++++++++++++--------- drivers/iommu/amd/iommu.c | 13 +++++-- 4 files changed, 57 insertions(+), 22 deletions(-)
Applied, thanks.