sbitmap: Fix two issues in the per-bitmap wakeup counter code
Status from this message: Applied, thanks!
Get series with b4
b4 am [email protected]Versions newest first
Patches in v1 Applied
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/3 | sbitmap: Advance the queue index before waking up a queuelib/ | +8 | 0 replies | |
| 2/3 | wait: Return number of exclusive waiters awakeninclude/ kernel/ | +12 | 2 replies | |
| 3/3 | sbitmap: Try each queue to wake up at least one waiterlib/ | +12 | 1 reply |
Reviews trailers per patch
All 3 patches have a Reviewed-by or Acked-by.
| Patch | Jan Kara | Peter Zijlstra (Intel) |
|---|---|---|
| 1/3 | R-b | |
| 2/3 | R-b | A-b |
| 3/3 | R-b |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [PATCH 0/3] sbitmap: Fix two issues in the per-bitmap wakeup counter code
Jan reported two issues in the original thread.
The first is that wake_index was not updated after returning from sbq_wake_ptr which meant we'd have to empty the wq before moving to the next one. Patch 1/3 in this series reorders the code to avoid this condition, increasing fairness of queue selection and preventing starvation. I sent this patch already on the other thread and Jan reviewed it, but since it is a small one, and a dependency for the other, I'm resending it a along this series.
The second issue is trickier. When the selected queue is emptied after the waitqueue_active check and before wake_up_nr, there is no waiters to be awaken in that queue, even if other queues might have it. This causes us to loose one too many wakeups, and there might not be enough requests in flight to wake up every queued request.
The proposed fix, is to walk through every queue after doing the atomic update, such that we ensure any waiters already queued are candidates for awakening, and that we awake at least 1 waiter in any of the queues. The patch is a bit more complex than the suggestion since it avoids partial updates to wake_index, which measurably hurt performance unnecessarily.
It survived the same tests done on the original patch.
btw, I'm still missing the latency and utilisation reports. I haven't forgotten about it, but I didn't have a chance to collect them yet. Sorry. I will follow up with them for completeness, even if the original patch is already queued.
Gabriel Krisman Bertazi (3):
sbitmap: Advance the queue index before waking up a queue
wait: Return number of exclusive waiters awaken
sbitmap: Try each queue to wake up at least one waiter
include/linux/wait.h | 2 +- kernel/sched/wait.c | 18 +++++++++++------- lib/sbitmap.c | 36 +++++++++++++++++++----------------- 3 files changed, 31 insertions(+), 25 deletions(-)
Signature · 1 line
2.35.3