iommufd: Fix bugs in eventq fops_read paths
cover iommufd: Fix bugs in eventq fops_read paths
Bugs were found in iommufd_veventq/fault_fops_read(), where userspace may:
- Receive a corrupted byte stream after a partial copy_to_user
- Spin in a poll/read loop when reading with an undersized buffer
- Miss notifications when the kernel cannot allocate a lost-events copy
- Receive duplicate faults with stale cookies after a mid-group failure
- Cause the kernel to retry the same failed copy_to_user indefinitely
Fix them, then add selftest coverage for the vEVENTQ count validation.
This is on github:
https://github.com/nicolinc/iommufd/commits/fix_eventq_read_bugs-v1
Rebased on Jason's for-next tree with the veventq_depth series applied.
Nicolin Chen (7):
iommufd: Rewind header length in done if iommufd_veventq_fops_read()
fails
iommufd: Reject invalid read count in iommufd_veventq_fops_read()
iommufd: Propagate allocation failure in
iommufd_veventq_deliver_fetch()
iommufd: Reject invalid read count in iommufd_fault_fops_read()
iommufd: Break the loop on failure in iommufd_fault_fops_read()
iommufd: Avoid partial fault group delivery in
iommufd_fault_fops_read()
iommufd/selftest: Cover invalid read counts on vEVENTQ FD
drivers/iommu/iommufd/eventq.c | 29 ++++++++++++++++++++++--- tools/testing/selftests/iommu/iommufd.c | 17 +++++++++++++++ 2 files changed, 43 insertions(+), 3 deletions(-)
base-commit: f25989c19028e8bf81e26e1133a99e3436c3afc2
Signature · 1 line
2.43.0
PATCH 1/7 iommufd: Rewind header length in done if iommufd_veventq_fops_read() fails
When the first event copy fails, rc = -EFAULT will not be reported as done is set to the length of the copied header.
Rewind it to report rc correctly.
--- drivers/iommu/iommufd/eventq.c | 1 + 1 file changed, 1 insertion(+)
drivers/iommu/iommufd/eventq.c +1 -0
@@ -336,6 +336,7 @@ static ssize_t iommufd_veventq_fops_read(struct file *filep, char __user *buf,if (cur->data_len &©_to_user (buf + done, cur->event_data, cur->data_len)) {iommufd_veventq_deliver_restore (veventq, cur); + done -=sizeof (*hdr); rc = -EFAULT ;break ; }
Signature · 1 line
2.43.0
Re: [PATCH v1 1/7] iommufd: Rewind header length in done if iommufd_veventq_fops_read() fails
Quoted 17 lines · Nicolin Chen
When the first event copy fails, rc =
-EFAULTwill not be reported as done is set to the length of the copied header.Rewind it to report rc correctly.
Fixes e36ba5ab808e ("iommufd: Add IOMMUFD_OBJ_VEVENTQ and IOMMUFD_CMD_VEVENTQ_ALLOC")Signed-off-by Nicolin Chen <[email protected]>--- drivers/iommu/iommufd/eventq.c | 1 + 1 file changed, 1 insertion(+)drivers/iommu/iommufd/eventq.c +0
-0
drivers/iommu/iommufd/eventq.c static ssize_t iommufd_veventq_fops_read(struct file *filep, char __user *buf, · line 342
Quoted 7 lines
drivers/iommu/iommufd/eventq.c +1
-0@@ -336,6 +336,7 @@ static ssize_t iommufd_veventq_fops_read(struct file *filep, char __user *buf,if (cur->data_len &©_to_user (buf + done, cur->event_data, cur->data_len)) {iommufd_veventq_deliver_restore (veventq, cur); + done -=sizeof (*hdr); rc = -EFAULT ;break ; }
Thanks,
Praan
PATCH 2/7 iommufd: Reject invalid read count in iommufd_veventq_fops_read()
In reply to Nicolin ChenThe read count must be large enough to hold a vEVENT header. For a normal vEVENT, it must also hold the trailing data following the header.
iommufd_veventq_fops_read() does not validate the count, but returns 0 as if the read had succeeded while leaving the pending event in the queue.
Return -EINVAL in both undersize cases.
--- drivers/iommu/iommufd/eventq.c | 6 ++++++ 1 file changed, 6 insertions(+)
drivers/iommu/iommufd/eventq.c +6 -0
@@ -310,6 +310,9 @@ static ssize_t iommufd_veventq_fops_read(struct file *filep, char __user *buf,if (*ppos)return -ESPIPE ; +/* Minimum read count is a vEVENT header */ +if (count <sizeof (*hdr)) +return -EINVAL ;while ((cur =iommufd_veventq_deliver_fetch (veventq))) {/* Validate the remaining bytes against the header size */
@@ -323,6 +326,9 @@ static ssize_t iommufd_veventq_fops_read(struct file *filep, char __user *buf,if (!vevent_for_lost_events_header (cur) &&sizeof (*hdr) + cur->data_len > count - done) {iommufd_veventq_deliver_restore (veventq, cur); +/* Read count doesn't fit a single normal vEVENT */ +if (done ==0 ) + rc = -EINVAL ;break ; }
Signature · 1 line
2.43.0
Re: [PATCH v1 2/7] iommufd: Reject invalid read count in iommufd_veventq_fops_read()
Quoted 11 lines · Nicolin Chen
The read count must be large enough to hold a vEVENT header. For a normal vEVENT, it must also hold the trailing data following the header.
iommufd_veventq_fops_read()does not validate the count, but returns 0 as if the read had succeeded while leaving the pending event in the queue.Return
-EINVALin both undersize cases.Fixes e36ba5ab808e ("iommufd: Add IOMMUFD_OBJ_VEVENTQ and IOMMUFD_CMD_VEVENTQ_ALLOC")Signed-off-by Nicolin Chen <[email protected]>
Thanks,
Praan
PATCH 3/7 iommufd: Propagate allocation failure in iommufd_veventq_deliver_fetch()
In reply to Nicolin ChenWhen the kzalloc_obj() fails in iommufd_veventq_deliver_fetch(), it returns NULL, falsely advertising to userspace that the queue is empty.
Propagate the -ENOMEM properly to the caller.
--- drivers/iommu/iommufd/eventq.c | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-)
drivers/iommu/iommufd/eventq.c +9 -1
@@ -264,8 +264,10 @@ iommufd_veventq_deliver_fetch(struct iommufd_veventq *veventq)/* Make a copy of the lost_events_header for copy_to_user */ if (next == &veventq->lost_events_header) { vevent =kzalloc_obj (*vevent,GFP_ATOMIC ); -if (!vevent) +if (!vevent) { + vevent =ERR_PTR (-ENOMEM ); goto out_unlock; + } }list_del (&next->node);if (vevent)
@@ -315,6 +317,12 @@ static ssize_t iommufd_veventq_fops_read(struct file *filep, char __user *buf,return -EINVAL ;while ((cur =iommufd_veventq_deliver_fetch (veventq))) { +if (IS_ERR (cur)) { +if (done ==0 ) + rc =PTR_ERR (cur); +break ; + } +/* Validate the remaining bytes against the header size */ if (done >= count ||sizeof (*hdr) > count - done) {iommufd_veventq_deliver_restore (veventq, cur);
Signature · 1 line
2.43.0
Re: [PATCH v1 3/7] iommufd: Propagate allocation failure in iommufd_veventq_deliver_fetch()
Quoted 8 lines · Nicolin Chen
When the
kzalloc_obj()fails iniommufd_veventq_deliver_fetch(), it returns NULL, falsely advertising to userspace that the queue is empty.Propagate the
-ENOMEMproperly to the caller.Fixes e36ba5ab808e ("iommufd: Add IOMMUFD_OBJ_VEVENTQ and IOMMUFD_CMD_VEVENTQ_ALLOC")Signed-off-by Nicolin Chen <[email protected]>
Thanks,
Praan
PATCH 4/7 iommufd: Reject invalid read count in iommufd_fault_fops_read()
In reply to Nicolin ChenThe read count must be large enough to hold one fault or a group's faults.
iommufd_fault_fops_read() does not validate the count, but returns 0 as if the read had succeeded while leaving the pending fault in the queue.
Return -EINVAL in the undersize cases.
--- drivers/iommu/iommufd/eventq.c | 3 +++ 1 file changed, 3 insertions(+)
drivers/iommu/iommufd/eventq.c +3 -0
@@ -142,6 +142,9 @@ static ssize_t iommufd_fault_fops_read(struct file *filep, char __user *buf,if (done >= count || group->fault_count * fault_size > count - done) {iommufd_fault_deliver_restore (fault, group); +/* Read count doesn't fit the first fault group */ +if (done ==0 ) + rc = -EINVAL ;break ; }
Signature · 1 line
2.43.0
Re: [PATCH v1 4/7] iommufd: Reject invalid read count in iommufd_fault_fops_read()
Quoted 10 lines · Nicolin Chen
The read count must be large enough to hold one fault or a group's faults.
iommufd_fault_fops_read()does not validate the count, but returns 0 as if the read had succeeded while leaving the pending fault in the queue.Return
-EINVALin the undersize cases.Fixes 07838f7fd529 ("iommufd: Add iommufd fault object")Signed-off-by Nicolin Chen <[email protected]>
Thanks,
Praan
PATCH 5/7 iommufd: Break the loop on failure in iommufd_fault_fops_read()
In reply to Nicolin ChenOn a copy_to_user() failure inside the inner list_for_each_entry, only the inner loop breaks; the outer while re-fetches the just-restored fault group and retries the failing copy_to_user() forever, spinning the reader at 100% CPU with fault->mutex held.
Check rc after the inner loop and break the outer while as well.
--- drivers/iommu/iommufd/eventq.c | 2 ++ 1 file changed, 2 insertions(+)
drivers/iommu/iommufd/eventq.c +2 -0
@@ -168,6 +168,8 @@ static ssize_t iommufd_fault_fops_read(struct file *filep, char __user *buf, } done += fault_size; } +if (rc) +break ; }mutex_unlock (&fault->mutex);
Signature · 1 line
2.43.0
Re: [PATCH v1 5/7] iommufd: Break the loop on failure in iommufd_fault_fops_read()
Quoted 19 lines · Nicolin Chen
On a
copy_to_user()failure inside the innerlist_for_each_entry, only the inner loop breaks; the outer while re-fetches the just-restored fault group and retries the failingcopy_to_user()forever, spinning the reader at 100% CPU withfault->mutexheld.Check rc after the inner loop and break the outer while as well.
Fixes 07838f7fd529 ("iommufd: Add iommufd fault object")Signed-off-by Nicolin Chen <[email protected]>--- drivers/iommu/iommufd/eventq.c | 2 ++ 1 file changed, 2 insertions(+)drivers/iommu/iommufd/eventq.c +0
-0
drivers/iommu/iommufd/eventq.c static ssize_t iommufd_fault_fops_read(struct file *filep, char __user *buf, · line 175
Quoted 8 lines
drivers/iommu/iommufd/eventq.c +2
-0@@ -168,6 +168,8 @@ static ssize_t iommufd_fault_fops_read(struct file *filep, char __user *buf, } done += fault_size; } +if (rc) +break ; }mutex_unlock (&fault->mutex);
Thanks,
Praan
PATCH 6/7 iommufd: Avoid partial fault group delivery in iommufd_fault_fops_read()
In reply to Nicolin ChenThe cookie returned by xa_alloc() in iommufd_fault_fops_read() is per fault group, but the inner copy_to_user() runs per fault inside the group. If a copy fails mid-group, xa_erase clears the cookie and the group is restored to the deliver list, yet done is not rolled back. The function returns the partial byte count, with the successfully copied faults sitting at offsets below done carrying the now-erased cookie. The next read() then re-fetches the group, allocates a fresh cookie, and re-delivers every fault including the ones already copied; userspace sees duplicates carrying the new cookie, and a stale cookie that can never be responded to.
Use a local group_done variable that tracks the per-group progress inside the inner loop, and only commit done = group_done after the inner loop has finished successfully. On a copy_to_user failure the outer break skips the commit, so done remains at its prior start-of-group baseline; the partial bytes already written past done are undefined to userspace per the read(2) contract, and the next read re-delivers the whole group atomically.
--- drivers/iommu/iommufd/eventq.c | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-)
drivers/iommu/iommufd/eventq.c +5 -2
@@ -139,6 +139,8 @@ static ssize_t iommufd_fault_fops_read(struct file *filep, char __user *buf,mutex_lock (&fault->mutex);while ((group =iommufd_fault_deliver_fetch (fault))) { +size_t group_done = done; +if (done >= count || group->fault_count * fault_size > count - done) {iommufd_fault_deliver_restore (fault, group);
@@ -160,16 +162,17 @@ static ssize_t iommufd_fault_fops_read(struct file *filep, char __user *buf,iommufd_compose_fault_message (&iopf->fault, &data, idev, group->cookie); -if (copy_to_user (buf + done, &data, fault_size)) { +if (copy_to_user (buf + group_done, &data, fault_size)) {xa_erase (&fault->response, group->cookie);iommufd_fault_deliver_restore (fault, group); rc = -EFAULT ;break ; } - done += fault_size; + group_done += fault_size; }if (rc)break ; + done = group_done; }mutex_unlock (&fault->mutex);
Signature · 1 line
2.43.0
Re: [PATCH v1 6/7] iommufd: Avoid partial fault group delivery in iommufd_fault_fops_read()
Quoted 17 lines · Nicolin Chen
The cookie returned by
xa_alloc()iniommufd_fault_fops_read()is per fault group, but the innercopy_to_user()runs per fault inside the group. If a copy fails mid-group,xa_eraseclears the cookie and the group is restored to the deliver list, yet done is not rolled back. The function returns the partial byte count, with the successfully copied faults sitting at offsets below done carrying the now-erased cookie. The nextread()then re-fetches the group, allocates a fresh cookie, and re-delivers every fault including the ones already copied; userspace sees duplicates carrying the new cookie, and a stale cookie that can never be responded to.Use a local
group_donevariable that tracks the per-group progress inside the inner loop, and only commit done =group_doneafter the inner loop has finished successfully. On acopy_to_userfailure the outer break skips the commit, so done remains at its prior start-of-group baseline; the partial bytes already written past done are undefined to userspace per the read(2) contract, and the next read re-delivers the whole group atomically.
Quoted 4 lines
Fixes 07838f7fd529 ("iommufd: Add iommufd fault object")Assisted-by Claude:claude-opus-4-7Signed-off-by Nicolin Chen <[email protected]>
Thanks,
Praan
PATCH 7/7 iommufd/selftest: Cover invalid read counts on vEVENTQ FD
In reply to Nicolin ChenThe vEVENTQ file descriptor must reject reads whose buffer cannot hold even one event record. Add selftest coverage that exercises both the empty-queue path (the upfront size check) and the non-empty path (the in-loop check that fires only after an event is fetched).
For iommufd_veventq_fops_read():
- count == 0 and count < sizeof(header) on an empty vEVENTQ both return -EINVAL.
- count == 0 and count == sizeof(header) on a non-empty vEVENTQ (event has trailing payload) both return -EINVAL.
--- tools/testing/selftests/iommu/iommufd.c | 17 +++++++++++++++++ 1 file changed, 17 insertions(+)
tools/testing/selftests/iommu/iommufd.c +17 -0
@@ -2980,6 +2980,8 @@ TEST_F(iommufd_viommu, vdevice_alloc)uint32_t veventq_id;uint32_t veventq_fd;int prev_seq =-1 ; +size_t hdr_size =sizeof (struct iommufd_vevent_header ); +char vbuf[64 ];if (dev_id) {/* Must allocate vdevice before attaching to a nested hwpt */
@@ -3006,11 +3008,26 @@ TEST_F(iommufd_viommu, vdevice_alloc)test_err_veventq_alloc (EEXIST , viommu_id,IOMMU_VEVENTQ_TYPE_SELFTEST ,2 ,NULL ,NULL ); + +/* Invalid read counts on an empty vEVENTQ */ +ASSERT_EQ (-1 ,read (veventq_fd, vbuf,0 )); +ASSERT_EQ (EINVAL , errno); +ASSERT_EQ (-1 ,read (veventq_fd, vbuf, hdr_size -1 )); +ASSERT_EQ (EINVAL , errno); +/* Set vdev_id to 0x99, unset it, and set to 0x88 */ test_cmd_vdevice_alloc (viommu_id, dev_id,0x99 , &vdev_id);test_cmd_mock_domain_replace (self->stdev_id, self->nested_hwpt_id);test_cmd_trigger_vevents (dev_id,1 ); + +/* Invalid read counts on a non-empty vEVENTQ */ +ASSERT_EQ (-1 ,read (veventq_fd, vbuf,0 )); +ASSERT_EQ (EINVAL , errno); +/* header fits but the event's payload doesn't */ +ASSERT_EQ (-1 ,read (veventq_fd, vbuf, hdr_size)); +ASSERT_EQ (EINVAL , errno); +test_cmd_read_vevents (veventq_fd,1 ,0x99 , &prev_seq);test_err_vdevice_alloc (EEXIST , viommu_id, dev_id,0x99 , &vdev_id);
Signature · 1 line
2.43.0
Re: [PATCH v1 7/7] iommufd/selftest: Cover invalid read counts on vEVENTQ FD
Quoted 5 lines · Nicolin Chen
The vEVENTQ file descriptor must reject reads whose buffer cannot hold even one event record. Add selftest coverage that exercises both the empty-queue path (the upfront size check) and the non-empty path (the in-loop check that fires only after an event is fetched).
Quoted 8 lines
For
iommufd_veventq_fops_read():
- count == 0 and count < sizeof(header) on an empty vEVENTQ both return-EINVAL.
- count == 0 and count == sizeof(header) on a non-empty vEVENTQ (event has trailing payload) both return-EINVAL.Assisted-by Claude:claude-opus-4-7Signed-off-by Nicolin Chen <[email protected]>
Thanks,
Praan
Quoted 13 lines · Nicolin Chen
Bugs were found in iommufd_veventq/fault_fops_read(), where userspace may:
- Receive a corrupted byte stream after a partialcopy_to_user
- Spin in a poll/read loop when reading with an undersized buffer
- Miss notifications when the kernel cannot allocate a lost-events copy
- Receive duplicate faults with stale cookies after a mid-group failure
- Cause the kernel to retry the same failedcopy_to_userindefinitelyFix them, then add selftest coverage for the vEVENTQ count validation.
This is on github:
https://github.com/nicolinc/iommufd/commits/fix_eventq_read_bugs-v1Rebased on Jason's for-next tree with the
veventq_depthseries applied.
[...]
Quoted 1 line
base-commit:
f25989c19028e8bf81e26e1133a99e3436c3afc2
I realized that I sent this too fast, before Jason's for-next tree is available in linux-next. So maybe this is why Sashiko failed to review.
FWIW, I've done a local Sashiko review, which came out clean. But, maybe we can respin a v2 once it collects some comments and tags.
Thanks
Nicolin
Quoted 11 lines
From: Nicolin Chen <[email protected]>
Sent: Tuesday, June 2, 2026 4:43 AMBugs were found in iommufd_veventq/fault_fops_read(), where userspace may:
- Receive a corrupted byte stream after a partialcopy_to_user
- Spin in a poll/read loop when reading with an undersized buffer
- Miss notifications when the kernel cannot allocate a lost-events copy
- Receive duplicate faults with stale cookies after a mid-group failure
- Cause the kernel to retry the same failedcopy_to_userindefinitely
Quoted 2 lines
Fix them, then add selftest coverage for the vEVENTQ count validation.
for the whole series:
Quoted 11 lines · Nicolin Chen
Nicolin Chen (7):
iommufd: Rewind header length in done ifiommufd_veventq_fops_read()
fails
iommufd: Reject invalid read count iniommufd_veventq_fops_read()
iommufd: Propagate allocation failure in
iommufd_veventq_deliver_fetch()
iommufd: Reject invalid read count iniommufd_fault_fops_read()
iommufd: Break the loop on failure iniommufd_fault_fops_read()
iommufd: Avoid partial fault group delivery in
iommufd_fault_fops_read()
iommufd/selftest: Cover invalid read counts on vEVENTQ FD
Applied to for-next
Thanks,
Jason