block: Fix blk_mq_try_issue_directly()
Subsystems (2)
PATCH 1/1 block: Fix blk_mq_try_issue_directly()
If blk_mq_try_issue_directly() returns BLK_STS*_RESOURCE that means that the request has not been queued and that the caller should retry to submit the request. Both blk_mq_request_bypass_insert() and blk_mq_sched_insert_request() guarantee that a request will be processed. Hence return BLK_STS_OK if one of these functions is called. This patch avoids that blk_mq_dispatch_rq_list() crashes when using dm-mpath.
--- block/blk-mq.c | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-)
block/blk-mq.c +2 -7
@@ -1859,16 +1859,11 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,case BLK_STS_RESOURCE :if (force) {blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return -* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; + ret =BLK_STS_OK ; }else if (!bypass) {blk_mq_sched_insert_request (rq, false, run_queue, false); + ret =BLK_STS_OK ; }break ;default :
Signature · 1 line
2.21.0.196.g041f5ea1cf98
Quoted 36 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that the request has not been queued and that the caller should retry to submit the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed. Hence returnBLK_STS_OKif one of these functions is called. This patch avoids thatblk_mq_dispatch_rq_list()crashes when using dm-mpath.Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Tested-by Laurence Oberman <[email protected]>Reviewed-by Laurence Oberman <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issue request directly") # v5.0.Cc <[email protected]>Signed-off-by Bart Van Assche <[email protected]>--- block/blk-mq.c | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-)block/blk-mq.c +0
-3@@ -1859,16 +1859,11 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,case BLK_STS_RESOURCE :if (force) {blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return
block/blk-mq.c blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx, · line 1867
Quoted 10 lines
block/blk-mq.c +2
-4-* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; + ret =BLK_STS_OK ; }else if (!bypass) {blk_mq_sched_insert_request (rq, false, run_queue, false); + ret =BLK_STS_OK ; }
This change itself is correct.
However, there is other issue introduced by 7f556a44e61d.
We need blk_insert_cloned_request() to pass back BLK_STS_RESOURCE/BLK_STS_RESOURCE to caller, so that dm-rq driver may see the underlying queue is busy, then tell blk-mq to deal with the busy condition from dm-rq queue, so that IO merge can get improved.
That is exactly what 396eaf21ee17c476e8f6 ("blk-mq: improve DM's blk-mq IO merging via blk_insert_cloned_request feedback") did.
There must be performance regression with 7f556a44e61d by cut the feedback.
So could you fix them all in one patch?
Thanks,
Ming
Quoted 35 lines · Ming Lei
Quoted 24 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that the request has not been queued and that the caller should retry to submit the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed. Hence returnBLK_STS_OKif one of these functions is called. This patch avoids thatblk_mq_dispatch_rq_list()crashes when using dm-mpath.Cc: Christoph Hellwig <[email protected]>>>Cc: Hannes Reinecke <[email protected]>>>Cc: James Smart <[email protected]>>>Cc: Ming Lei <[email protected]>>>Cc: Jianchao Wang <[email protected]>>>Cc: Keith Busch <[email protected]>>>Cc: Dongli Zhang <[email protected]>>>Cc: Laurence Oberman <[email protected]>>>Tested-by: Laurence Oberman <[email protected]>>>Reviewed-by: Laurence Oberman <[email protected]>>>Reported-by: Laurence Oberman <[email protected]>>>Fixes:
7f556a44e61d("blk-mq: refactor the code of issue request directly" #v5.0.
Cc: <[email protected]>>>Signed-off-by: Bart Van Assche <[email protected]>>>---block/blk-mq.c|9 +-+--------1 file changed, 2 insertions(+-), 7 deletions(-)block/blk-mq.c +1
-1--- a/block/blk-mq.c +-+-+- b/block/blk-mq.c@@-1859,16 +-1859,11 @@blk_status_t blk_mq_try_issue_directly(struct
blk_mq_hw_ctx*hctx,case BLK_STS_RESOURCE: if (force) {>> blk_mq_request_bypass_insert(rq, run_queue);>>- /*>>- *We have to return BLK_STS_OK for the DMblock/blk-mq.c +0
-5-*to avoid livelock. Otherwise, we return -*the real result to indicate whether the -*request is direct-issued successfully. -*/ - ret =bypass ? BLK_STS_OK : ret;>>+- ret =BLK_STS_OK;>> }else if (!bypass) {>> blk_mq_sched_insert_request(rq, false,Quoted 1 line
run_queue, false);>>+- ret =BLK_STS_OK;>> }>This change itself is correct.
However, there is other issue introduced by
7f556a44e61d.We need
blk_insert_cloned_request()to pass back BLK_STS_RESOURCE/BLK_STS_RESOURCE to caller, so that dm-rq driver may see the underlying queue is busy, then tell blk-mq to deal with the busy condition from dm-rq queue, so that IO merge can get improved.
Quoted 6 lines
That is exactly what
396eaf21ee17c476e8f6("blk-mq: improve DM's blk-mq IO merging viablk_insert_cloned_requestfeedback" did.There must be performance regression with
7f556a44e61dby cut the feedback.So could you fix them all in one patch?
Since commit 7f556a44e61d introduced multiple problems and since fixing these is nontrivial, how about reverting that commit?
Thanks,
Bart.
Quoted 76 lines · Bart Van Assche
Quoted 66 lines · Ming Lei
Quoted 43 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that
the request has not been queued and that the caller should retry to submit
the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed.
Hence returnBLK_STS_OKif one of these functions is called. This patch
avoids thatblk_mq_dispatch_rq_list()crashes when using dm- mpath.Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Tested-by Laurence Oberman <[email protected]>Reviewed-by Laurence Oberman <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issue requestdirectly") # v5.0.
Cc <[email protected]>Signed-off-by Bart Van Assche <[email protected]>--- block/blk-mq.c | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-)block/blk-mq.c +0
-3@@ -1859,16 +1859,11 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx, case BLK_STS_RESOURCE: if (force) {blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return block/blk-mq.c blk_status_t · line 1868
Quoted 10 lines
block/blk-mq.c +2
-4-* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; + ret =BLK_STS_OK ; }else if (!bypass) {blk_mq_sched_insert_request (rq, false, run_queue, false); + ret =BLK_STS_OK ; }This change itself is correct.
However, there is other issue introduced by
7f556a44e61d.We need
blk_insert_cloned_request()to pass back BLK_STS_RESOURCE/BLK_STS_RESOURCE
to caller, so that dm-rq driver may see the underlying queue is busy, then tell
blk-mq to deal with the busy condition from dm-rq queue, so that IO merge can get improved.Quoted 8 lines
That is exactly what
396eaf21ee17c476e8f6("blk-mq: improve DM's blk-mq IO merging
viablk_insert_cloned_requestfeedback") did.There must be performance regression with
7f556a44e61dby cut the feedback.So could you fix them all in one patch?
Quoted 7 lines
Since commit
7f556a44e61dintroduced multiple problems and since fixing
these is nontrivial, how about reverting that commit?Thanks,
Bart.
When I bisected and got to that commit I was unable to revert it to test without it.
I showed that in an earlier update, had merge issues.
loberman@lobewsrhel linux_torvalds]$ git revert 7f556a44e61d
error: could not revert 7f556a4... blk-mq: refactor the code of issue request directly
hint: after resolving the conflicts, mark the corrected paths
hint: with 'git add <paths>' or 'git rm <paths>'
hint: and commit the result with 'git commit'
Quoted 10 lines · Laurence Oberman
When I bisected and got to that commit I was unable to revert it to test without it.
I showed that in an earlier update, had merge issues.loberman@lobewsrhel linux_torvalds]$git revert
7f556a44e61d
error: could not revert 7f556a4... blk-mq: refactor the code of issue request directly
hint: after resolving the conflicts, mark the corrected paths
hint: with 'git add <paths> or 'git rm <paths>
hint: and commit the result with 'git commit'
Hi Laurence,
On my setup the following commits revert cleanly if I revert them in the
following order:
*d6a51a97c0b2 ("blk-mq: replace and kill blk_mq_request_issue_directly" #v5.0. *5b7a6f128aad ("blk-mq: issue directly with bypass 'false' in blk_mq_sched_insert_requests" #v5.0. *7f556a44e61d ("blk-mq: refactor the code of issue request directly" #v5.0.
The result of these three reverts is the patch below. Test feedback for this patch would be appreciated.
Thanks,
Bart.
Subject: [PATCH]block: Revert recent blk_mq_request_issue_directly() changes
blk_mq_try_issue_directly() can return BLK_STS*_RESOURCE for requests that have been queued. If that happens when blk_mq_try_issue_directly() is called by the dm-mpath driver then the dm-mpath will try to resubmit a request that is already queued and a kernel crash follows. Since it is nontrivial to fix blk_mq_request_issue_directly(), revert the most recent blk_mq_request_issue_directly() changes.
This patch reverts the following commits:
*d6a51a97c0b2 ("blk-mq: replace and kill blk_mq_request_issue_directly" #v5.0. *5b7a6f128aad ("blk-mq: issue directly with bypass 'false' in blk_mq_sched_insert_requests" #v5.0. *7f556a44e61d ("blk-mq: refactor the code of issue request directly" #v5.0.
block/blk-core.c | 4 +-- block/blk-mq-sched.c | 8 +--- block/blk-mq.c |122 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+---------------------- block/blk-mq.h | 6 +--- 4 files changed, 71 insertions(+-), 69 deletions(-)
block/blk-core.c +0 -0
--- a/block/blk-core.c
+-+-+- b/block/blk-core.c
@@-1232,8 +-1232,6 @@static int blk_cloned_rq_check_limits(struct request_queue *q,
*/
blk_status_t blk_insert_cloned_request(struct request_queue *q, struct request *rq)
{- blk_qc_t unused;-
if (blk_cloned_rq_check_limits(q, rq))
return BLK_STS_IOERR;
@@-1249,7 +-1247,7 @@blk_status_t blk_insert_cloned_request(struct request_queue *q, struct request * *bypass a potential scheduler on the bottom device for
*insert.
*/
- return blk_mq_try_issue_directly(rq->mq_hctx, rq, &unused, true, true);+- return blk_mq_request_issue_directly(rq, true); } EXPORT_SYMBOL_GPL(blk_insert_cloned_request);
block/blk-mq-sched.c +0 -0
--- a/block/blk-mq-sched.c
+-+-+- b/block/blk-mq-sched.c
@@-423,10 +-423,12 @@void blk_mq_sched_insert_requests(struct blk_mq_hw_ctx *hctx,
*busy in case of 'none' scheduler, and this way may save
*us one extra enqueue &dequeue to sw queue.
*/
- if (!hctx->dispatch_busy &&!e &&!run_queue_async)
+- if (!hctx->dispatch_busy &&!e &&!run_queue_async) { blk_mq_try_issue_list_directly(hctx, list);- else
- blk_mq_insert_requests(hctx, ctx, list);+- if (list_empty(list))
+- return;+- }+- blk_mq_insert_requests(hctx, ctx, list); }
blk_mq_run_hw_queue(hctx, run_queue_async);diff --git a/block/blk-mq.c b/block/blk-mq.c
index 652d0c6d5945..403984a557bb 100644
--- a/block/blk-mq.c
+-+-+- b/block/blk-mq.c
@@-1808,74 +-1808,76 @@static blk_status_t __blk_mq_issue_directly(struct blk_mq_hw_ctx *hctx,
return ret; }
-blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,
+-static blk_status_t __blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,
struct request *rq,
blk_qc_t *cookie,
- bool bypass, bool last)
+- bool bypass_insert, bool last)
{ struct request_queue *q =rq->q; bool run_queue =true;- blk_status_t ret =BLK_STS_RESOURCE;- int srcu_idx;- bool force =false;
- hctx_lock(hctx, &srcu_idx); /*- *hctx_lock is needed before checking quiesced flag.
+- *RCU or SRCU read lock is needed before checking quiesced flag.
*- *When queue is stopped or quiesced, ignore 'bypass', insert
- *and return BLK_STS_OK to caller, and avoid driver to try to
- *dispatch again.
+- *When queue is stopped or quiesced, ignore 'bypass_insert' from +- *blk_mq_request_issue_directly(), and return BLK_STS_OK to caller, +- *and avoid driver to try to dispatch again.
*/
- if (unlikely(blk_mq_hctx_stopped(hctx) ||blk_queue_quiesced(q))) {+- if (blk_mq_hctx_stopped(hctx) ||blk_queue_quiesced(q)) { run_queue =false;- bypass =false;- goto out_unlock;+- bypass_insert =false;+- goto insert; }
- if (unlikely(q->elevator &&!bypass))
- goto out_unlock;+- if (q->elevator &&!bypass_insert)
+- goto insert;
if (!blk_mq_get_dispatch_budget(hctx))
- goto out_unlock;+- goto insert;
if (!blk_mq_get_driver_tag(rq)) { blk_mq_put_dispatch_budget(hctx);- goto out_unlock;+- goto insert; }
- /*- *Always add a request that has been through
- *queue_rq() to the hardware dispatch list.
- */
- force =true;- ret =__blk_mq_issue_directly(hctx, rq, cookie, last);-out_unlock:
+- return __blk_mq_issue_directly(hctx, rq, cookie, last);+-insert:
+- if (bypass_insert)
+- return BLK_STS_RESOURCE;+-
+- blk_mq_request_bypass_insert(rq, run_queue);+- return BLK_STS_OK;+-}+-
+-static void blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,
+- struct request *rq, blk_qc_t *cookie)
+-{+- blk_status_t ret;+- int srcu_idx;+-
+- might_sleep_if(hctx->flags &BLK_MQ_F_BLOCKING);+-
+- hctx_lock(hctx, &srcu_idx);+-
+- ret =__blk_mq_try_issue_directly(hctx, rq, cookie, false, true);+- if (ret ==BLK_STS_RESOURCE ||ret ==BLK_STS_DEV_RESOURCE)
+- blk_mq_request_bypass_insert(rq, true);+- else if (ret !=BLK_STS_OK)
+- blk_mq_end_request(rq, ret);+-
+- hctx_unlock(hctx, srcu_idx);+-}+-
+-blk_status_t blk_mq_request_issue_directly(struct request *rq, bool last)
+-{+- blk_status_t ret;+- int srcu_idx;+- blk_qc_t unused_cookie;+- struct blk_mq_hw_ctx *hctx =rq->mq_hctx;+-
+- hctx_lock(hctx, &srcu_idx);+- ret =__blk_mq_try_issue_directly(hctx, rq, &unused_cookie, true, last); hctx_unlock(hctx, srcu_idx);- switch (ret) {- case BLK_STS_OK:- break;- case BLK_STS_DEV_RESOURCE:
- case BLK_STS_RESOURCE:
- if (force) {- blk_mq_request_bypass_insert(rq, run_queue);- /*- *We have to return BLK_STS_OK for the DM
- *to avoid livelock. Otherwise, we return
- *the real result to indicate whether the
- *request is direct-issued successfully.
- */
- ret =bypass ? BLK_STS_OK : ret;- }else if (!bypass) {- blk_mq_sched_insert_request(rq, false,
- run_queue, false);- }- break;- default:
- if (!bypass)
- blk_mq_end_request(rq, ret);- break;- }
return ret; }@@-1883,20 +-1885,22 @@blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,
void blk_mq_try_issue_list_directly(struct blk_mq_hw_ctx *hctx,
struct list_head *list)
{- blk_qc_t unused;- blk_status_t ret =BLK_STS_OK;-
while (!list_empty(list)) {+- blk_status_t ret; struct request *rq =list_first_entry(list, struct request,
queuelist);
list_del_init(&rq->queuelist);- if (ret ==BLK_STS_OK)
- ret =blk_mq_try_issue_directly(hctx, rq, &unused,
- false,
+- ret =blk_mq_request_issue_directly(rq, list_empty(list));+- if (ret !=BLK_STS_OK) {+- if (ret ==BLK_STS_RESOURCE ||+- ret ==BLK_STS_DEV_RESOURCE) {+- blk_mq_request_bypass_insert(rq,
list_empty(list));- else
- blk_mq_sched_insert_request(rq, false, true, false);+- break;+- }+- blk_mq_end_request(rq, ret);+- } }
/*@@-1904,7 +-1908,7 @@void blk_mq_try_issue_list_directly(struct blk_mq_hw_ctx *hctx,
*the driver there was more coming, but that turned out to
*be a lie.
*/
- if (ret !=BLK_STS_OK &&hctx->queue->mq_ops->commit_rqs)
+- if (!list_empty(list) &&hctx->queue->mq_ops->commit_rqs)
hctx->queue->mq_ops->commit_rqs(hctx); }
@@-2017,13 +-2021,13 @@static blk_qc_t blk_mq_make_request(struct request_queue *q, struct bio *bio)
if (same_queue_rq) { data.hctx =same_queue_rq->mq_hctx; blk_mq_try_issue_directly(data.hctx, same_queue_rq,
- &cookie, false, true);+- &cookie); } }else if ((q->nr_hw_queues >1 &&is_sync) ||(!q->elevator && !data.hctx->dispatch_busy)) { blk_mq_put_ctx(data.ctx); blk_mq_bio_to_request(rq, bio);- blk_mq_try_issue_directly(data.hctx, rq, &cookie, false, true);+- blk_mq_try_issue_directly(data.hctx, rq, &cookie); }else { blk_mq_put_ctx(data.ctx); blk_mq_bio_to_request(rq, bio);diff --git a/block/blk-mq.h b/block/blk-mq.h
index d704fc7766f4..423ea88ab6fb 100644
--- a/block/blk-mq.h
+-+-+- b/block/blk-mq.h
@@-70,10 +-70,8 @@void blk_mq_request_bypass_insert(struct request *rq, bool run_queue); void blk_mq_insert_requests(struct blk_mq_hw_ctx *hctx, struct blk_mq_ctx *ctx,
struct list_head *list);
-blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,
- struct request *rq,
- blk_qc_t *cookie,
- bool bypass, bool last);+-/*Used by blk_insert_cloned_request() to issue request directly */
+-blk_status_t blk_mq_request_issue_directly(struct request *rq, bool last); void blk_mq_try_issue_list_directly(struct blk_mq_hw_ctx *hctx,
struct list_head *list);
Quoted 347 lines · Bart Van Assche
Quoted 11 lines · Laurence Oberman
When I bisected and got to that commit I was unable to revert it to test without it.
I showed that in an earlier update, had merge issues.loberman@lobewsrhel linux_torvalds]$ git revert
7f556a44e61d
error: could not revert 7f556a4... blk-mq: refactor the code of issue
request directly
hint: after resolving the conflicts, mark the corrected paths
hint: with 'git add <paths>' or 'git rm <paths>'
hint: and commit the result with 'git commit'Hi Laurence,
On my setup the following commits revert cleanly if I revert them in the
following order:
*d6a51a97c0b2("blk-mq: replace and killblk_mq_request_issue_directly") # v5.0.
*5b7a6f128aad("blk-mq: issue directly with bypass 'false' inblk_mq_sched_insert_requests") # v5.0.
*7f556a44e61d("blk-mq: refactor the code of issue request
directly") # v5.0.The result of these three reverts is the patch below. Test feedback for
this patch would be appreciated.Thanks,
Bart.
Subject: [PATCH] block: Revert recent
blk_mq_request_issue_directly()changes
blk_mq_try_issue_directly()can return BLK_STS*_RESOURCE for requests that
have been queued. If that happens whenblk_mq_try_issue_directly()is called
by the dm-mpath driver then the dm-mpath will try to resubmit a request that
is already queued and a kernel crash follows. Since it is nontrivial to fixblk_mq_request_issue_directly(), revert the most recentblk_mq_request_issue_directly()changes.This patch reverts the following commits:
*d6a51a97c0b2("blk-mq: replace and killblk_mq_request_issue_directly") # v5.0.
*5b7a6f128aad("blk-mq: issue directly with bypass 'false' inblk_mq_sched_insert_requests") # v5.0.
*7f556a44e61d("blk-mq: refactor the code of issue request directly") # v5.0.Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Cc <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issue requestdirectly") # v5.0.
Signed-off-by Bart Van Assche <[email protected]>--- block/blk-core.c | 4 +- block/blk-mq-sched.c | 8 +-- block/blk-mq.c | 122 ++++++++++++++++++++++------------------- -- block/blk-mq.h | 6 +-- 4 files changed, 71 insertions(+), 69 deletions(-)block/blk-core.c +0
-2@@ -1232,8 +1232,6 @@ static int blk_cloned_rq_check_limits(structrequest_queue *q, */ blk_status_t blk_insert_cloned_request (struct request_queue *q,struct request *rq) { -blk_qc_t unused; -if (blk_cloned_rq_check_limits (q, rq))block/blk-core.c +0
-0return BLK_STS_IOERR ;@@ -1249,7 +1247,7 @@ blk_status_t blk_insert_cloned_request(struct
request_queue*q, struct request *block/blk-core.c +0
-1* bypass a potential scheduler on the bottom device for * insert. */ - return blk_mq_try_issue_directly(rq->mq_hctx, rq, &unused,true, true);
block/blk-core.c +1
-0+return blk_mq_request_issue_directly (rq, true); }EXPORT_SYMBOL_GPL (blk_insert_cloned_request);block/blk-mq-sched.c +0
-0@@ -423,10 +423,12 @@ void blk_mq_sched_insert_requests(structblk_mq_hw_ctx *hctx, * busy in case of 'none' scheduler, and this way maysave
block/blk-mq-sched.c +5
-3* us one extra enqueue & dequeue to sw queue. */ -if (!hctx->dispatch_busy && !e && !run_queue_async) +if (!hctx->dispatch_busy && !e && !run_queue_async) {blk_mq_try_issue_list_directly (hctx, list); -else -blk_mq_insert_requests (hctx, ctx, list); +if (list_empty (list)) +return ; + } +blk_mq_insert_requests (hctx, ctx, list); }blk_mq_run_hw_queue (hctx, run_queue_async);block/blk-mq.c +3
-7@@ -1808,74 +1808,76 @@ static blk_status_t __blk_mq_issue_directly(struct blk_mq_hw_ctx *hctx, return ret; } -blk_status_t blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx, +static blk_status_t __blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx,struct request *rq,blk_qc_t *cookie, -bool bypass,bool last) +bool bypass_insert,bool last) {struct request_queue *q = rq->q;bool run_queue = true; -blk_status_t ret =BLK_STS_RESOURCE ; -int srcu_idx; -bool force = false; -hctx_lock (hctx, &srcu_idx);/* -* hctx_lock is needed before checking quiesced flag. +* RCU or SRCU read lock is needed before checking quiesced flag.
block/blk-mq.c +1
-3* -* When queue is stopped or quiesced, ignore 'bypass', insert -* and return BLK_STS_OK to caller, and avoid driver to try to -* dispatch again. +* When queue is stopped or quiesced, ignore 'bypass_insert' from
block/blk-mq.c +1
-0+* blk_mq_request_issue_directly(), and return BLK_STS_OK to caller,
block/blk-mq.c +1
-1+* and avoid driver to try to dispatch again. */ - if (unlikely(blk_mq_hctx_stopped(hctx) ||
blk_queue_quiesced(q))) {block/blk-mq.c +27
-13+if (blk_mq_hctx_stopped (hctx) ||blk_queue_quiesced (q)) { run_queue = false; - bypass = false; - goto out_unlock; + bypass_insert = false; + goto insert; } -if (unlikely (q->elevator && !bypass)) - goto out_unlock; +if (q->elevator && !bypass_insert) + goto insert;if (!blk_mq_get_dispatch_budget (hctx)) - goto out_unlock; + goto insert;if (!blk_mq_get_driver_tag (rq)) {blk_mq_put_dispatch_budget (hctx); - goto out_unlock; + goto insert; } -/* -* Always add a request that has been through -*.queue_rq() to the hardware dispatch list. -*/ - force = true; - ret =__blk_mq_issue_directly (hctx, rq, cookie, last); -out_unlock: +return __blk_mq_issue_directly (hctx, rq, cookie, last); +insert: +if (bypass_insert) +return BLK_STS_RESOURCE ; + +blk_mq_request_bypass_insert (rq, run_queue); +return BLK_STS_OK ; +} + +static void blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx, +struct request *rq,blk_qc_t *cookie) +{ +blk_status_t ret; +int srcu_idx; + +might_sleep_if (hctx->flags &BLK_MQ_F_BLOCKING ); + +hctx_lock (hctx, &srcu_idx); + + ret = __blk_mq_try_issue_directly(hctx, rq, cookie, false,true);
block/blk-mq.c +9
-0+if (ret ==BLK_STS_RESOURCE || ret ==BLK_STS_DEV_RESOURCE ) +blk_mq_request_bypass_insert (rq, true); +else if (ret !=BLK_STS_OK ) +blk_mq_end_request (rq, ret); + +hctx_unlock (hctx, srcu_idx); +} + +blk_status_t blk_mq_request_issue_directly(struct request *rq, boollast)
block/blk-mq.c +8
-0+{ +blk_status_t ret; +int srcu_idx; +blk_qc_t unused_cookie; +struct blk_mq_hw_ctx *hctx = rq->mq_hctx; + +hctx_lock (hctx, &srcu_idx); + ret = __blk_mq_try_issue_directly(hctx, rq, &unused_cookie,true, last);
block/blk-mq.c +6
-32hctx_unlock (hctx, srcu_idx); -switch (ret) { -case BLK_STS_OK : -break ; -case BLK_STS_DEV_RESOURCE : -case BLK_STS_RESOURCE : -if (force) { -blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return -* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; - }else if (!bypass) { -blk_mq_sched_insert_request (rq, false, - run_queue, false); - } -break ; -default : -if (!bypass) -blk_mq_end_request (rq, ret); -break ; - }return ret; }@@ -1883,20 +1885,22 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx, void blk_mq_try_issue_list_directly(struct blk_mq_hw_ctx *hctx, struct list_head *list) { - blk_qc_t unused; -blk_status_t ret =BLK_STS_OK ; -while (!list_empty (list)) { +blk_status_t ret; struct request *rq = list_first_entry(list, struct request, queuelist);list_del_init (&rq->queuelist); -if (ret ==BLK_STS_OK ) - ret =blk_mq_try_issue_directly (hctx, rq, &unused, - false, + ret =blk_mq_request_issue_directly (rq,list_empty (list)); +if (ret !=BLK_STS_OK ) { +if (ret ==BLK_STS_RESOURCE || + ret ==BLK_STS_DEV_RESOURCE ) { +blk_mq_request_bypass_insert (rq,list_empty (list )); - else - blk_mq_sched_insert_request(rq, false, true,false);
block/blk-mq.c +7
-3+break ; + } +blk_mq_end_request (rq, ret); + } }/* @@ -1904,7 +1908,7 @@ void blk_mq_try_issue_list_directly(structblk_mq_hw_ctx *hctx, * the driver there was more coming, but that turned out to * be a lie. */ -if (ret !=BLK_STS_OK && hctx->queue->mq_ops->commit_rqs) +if (!list_empty (list) && hctx->queue->mq_ops->commit_rqs) hctx->queue->mq_ops->commit_rqs (hctx); }@@ -2017,13 +2021,13 @@ static blk_qc_t blk_mq_make_request(struct request_queue *q, struct bio *bio) if (same_queue_rq) { data.hctx = same_queue_rq->mq_hctx;blk_mq_try_issue_directly (data.hctx, same_queue_rq, - &cookie, false, true); + &cookie); } } else if ((q->nr_hw_queues > 1 && is_sync) || (!q->elevator && !data.hctx->dispatch_busy)) {blk_mq_put_ctx (data.ctx);blk_mq_bio_to_request (rq, bio); -blk_mq_try_issue_directly (data.hctx, rq, &cookie, false, true); +blk_mq_try_issue_directly (data.hctx, rq, &cookie);block/blk-mq.c +0
-0}else {blk_mq_put_ctx (data.ctx);blk_mq_bio_to_request (rq, bio);block/blk-mq.h +2
-4@@ -70,10 +70,8 @@ void blk_mq_request_bypass_insert(struct request *rq, bool run_queue);void blk_mq_insert_requests (struct blk_mq_hw_ctx *hctx,struct blk_mq_ctx *ctx,struct list_head *list); -blk_status_t blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx, -struct request *rq, -blk_qc_t *cookie, -bool bypass,bool last); +/* Used by blk_insert_cloned_request() to issue request directly */ +blk_status_t blk_mq_request_issue_directly(struct request *rq, bool
Quoted 5 lines
last);
void blk_mq_try_issue_list_directly(structblk_mq_hw_ctx*hctx,
structlist_head*list);
Doing that now
back with test results
Laurence Oberman
Tested-byQuoted 347 lines · Bart Van Assche
Quoted 11 lines · Laurence Oberman
When I bisected and got to that commit I was unable to revert it to test without it.
I showed that in an earlier update, had merge issues.loberman@lobewsrhel linux_torvalds]$ git revert
7f556a44e61d
error: could not revert 7f556a4... blk-mq: refactor the code of issue
request directly
hint: after resolving the conflicts, mark the corrected paths
hint: with 'git add <paths>' or 'git rm <paths>'
hint: and commit the result with 'git commit'Hi Laurence,
On my setup the following commits revert cleanly if I revert them in the
following order:
*d6a51a97c0b2("blk-mq: replace and killblk_mq_request_issue_directly") # v5.0.
*5b7a6f128aad("blk-mq: issue directly with bypass 'false' inblk_mq_sched_insert_requests") # v5.0.
*7f556a44e61d("blk-mq: refactor the code of issue request
directly") # v5.0.The result of these three reverts is the patch below. Test feedback for
this patch would be appreciated.Thanks,
Bart.
Subject: [PATCH] block: Revert recent
blk_mq_request_issue_directly()changes
blk_mq_try_issue_directly()can return BLK_STS*_RESOURCE for requests that
have been queued. If that happens whenblk_mq_try_issue_directly()is called
by the dm-mpath driver then the dm-mpath will try to resubmit a request that
is already queued and a kernel crash follows. Since it is nontrivial to fixblk_mq_request_issue_directly(), revert the most recentblk_mq_request_issue_directly()changes.This patch reverts the following commits:
*d6a51a97c0b2("blk-mq: replace and killblk_mq_request_issue_directly") # v5.0.
*5b7a6f128aad("blk-mq: issue directly with bypass 'false' inblk_mq_sched_insert_requests") # v5.0.
*7f556a44e61d("blk-mq: refactor the code of issue request directly") # v5.0.Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Cc <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issue requestdirectly") # v5.0.
Signed-off-by Bart Van Assche <[email protected]>--- block/blk-core.c | 4 +- block/blk-mq-sched.c | 8 +-- block/blk-mq.c | 122 ++++++++++++++++++++++------------------- -- block/blk-mq.h | 6 +-- 4 files changed, 71 insertions(+), 69 deletions(-)block/blk-core.c +0
-2@@ -1232,8 +1232,6 @@ static int blk_cloned_rq_check_limits(structrequest_queue *q, */ blk_status_t blk_insert_cloned_request (struct request_queue *q,struct request *rq) { -blk_qc_t unused; -if (blk_cloned_rq_check_limits (q, rq))block/blk-core.c +0
-0return BLK_STS_IOERR ;@@ -1249,7 +1247,7 @@ blk_status_t blk_insert_cloned_request(struct
request_queue*q, struct request *block/blk-core.c +0
-1* bypass a potential scheduler on the bottom device for * insert. */ - return blk_mq_try_issue_directly(rq->mq_hctx, rq, &unused,true, true);
block/blk-core.c +1
-0+return blk_mq_request_issue_directly (rq, true); }EXPORT_SYMBOL_GPL (blk_insert_cloned_request);block/blk-mq-sched.c +0
-0@@ -423,10 +423,12 @@ void blk_mq_sched_insert_requests(structblk_mq_hw_ctx *hctx, * busy in case of 'none' scheduler, and this way maysave
block/blk-mq-sched.c +5
-3* us one extra enqueue & dequeue to sw queue. */ -if (!hctx->dispatch_busy && !e && !run_queue_async) +if (!hctx->dispatch_busy && !e && !run_queue_async) {blk_mq_try_issue_list_directly (hctx, list); -else -blk_mq_insert_requests (hctx, ctx, list); +if (list_empty (list)) +return ; + } +blk_mq_insert_requests (hctx, ctx, list); }blk_mq_run_hw_queue (hctx, run_queue_async);block/blk-mq.c +3
-7@@ -1808,74 +1808,76 @@ static blk_status_t __blk_mq_issue_directly(struct blk_mq_hw_ctx *hctx, return ret; } -blk_status_t blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx, +static blk_status_t __blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx,struct request *rq,blk_qc_t *cookie, -bool bypass,bool last) +bool bypass_insert,bool last) {struct request_queue *q = rq->q;bool run_queue = true; -blk_status_t ret =BLK_STS_RESOURCE ; -int srcu_idx; -bool force = false; -hctx_lock (hctx, &srcu_idx);/* -* hctx_lock is needed before checking quiesced flag. +* RCU or SRCU read lock is needed before checking quiesced flag.
block/blk-mq.c +1
-3* -* When queue is stopped or quiesced, ignore 'bypass', insert -* and return BLK_STS_OK to caller, and avoid driver to try to -* dispatch again. +* When queue is stopped or quiesced, ignore 'bypass_insert' from
block/blk-mq.c +1
-0+* blk_mq_request_issue_directly(), and return BLK_STS_OK to caller,
block/blk-mq.c +1
-1+* and avoid driver to try to dispatch again. */ - if (unlikely(blk_mq_hctx_stopped(hctx) ||
blk_queue_quiesced(q))) {block/blk-mq.c +27
-13+if (blk_mq_hctx_stopped (hctx) ||blk_queue_quiesced (q)) { run_queue = false; - bypass = false; - goto out_unlock; + bypass_insert = false; + goto insert; } -if (unlikely (q->elevator && !bypass)) - goto out_unlock; +if (q->elevator && !bypass_insert) + goto insert;if (!blk_mq_get_dispatch_budget (hctx)) - goto out_unlock; + goto insert;if (!blk_mq_get_driver_tag (rq)) {blk_mq_put_dispatch_budget (hctx); - goto out_unlock; + goto insert; } -/* -* Always add a request that has been through -*.queue_rq() to the hardware dispatch list. -*/ - force = true; - ret =__blk_mq_issue_directly (hctx, rq, cookie, last); -out_unlock: +return __blk_mq_issue_directly (hctx, rq, cookie, last); +insert: +if (bypass_insert) +return BLK_STS_RESOURCE ; + +blk_mq_request_bypass_insert (rq, run_queue); +return BLK_STS_OK ; +} + +static void blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx, +struct request *rq,blk_qc_t *cookie) +{ +blk_status_t ret; +int srcu_idx; + +might_sleep_if (hctx->flags &BLK_MQ_F_BLOCKING ); + +hctx_lock (hctx, &srcu_idx); + + ret = __blk_mq_try_issue_directly(hctx, rq, cookie, false,true);
block/blk-mq.c +9
-0+if (ret ==BLK_STS_RESOURCE || ret ==BLK_STS_DEV_RESOURCE ) +blk_mq_request_bypass_insert (rq, true); +else if (ret !=BLK_STS_OK ) +blk_mq_end_request (rq, ret); + +hctx_unlock (hctx, srcu_idx); +} + +blk_status_t blk_mq_request_issue_directly(struct request *rq, boollast)
block/blk-mq.c +8
-0+{ +blk_status_t ret; +int srcu_idx; +blk_qc_t unused_cookie; +struct blk_mq_hw_ctx *hctx = rq->mq_hctx; + +hctx_lock (hctx, &srcu_idx); + ret = __blk_mq_try_issue_directly(hctx, rq, &unused_cookie,true, last);
block/blk-mq.c +6
-32hctx_unlock (hctx, srcu_idx); -switch (ret) { -case BLK_STS_OK : -break ; -case BLK_STS_DEV_RESOURCE : -case BLK_STS_RESOURCE : -if (force) { -blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return -* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; - }else if (!bypass) { -blk_mq_sched_insert_request (rq, false, - run_queue, false); - } -break ; -default : -if (!bypass) -blk_mq_end_request (rq, ret); -break ; - }return ret; }@@ -1883,20 +1885,22 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx, void blk_mq_try_issue_list_directly(struct blk_mq_hw_ctx *hctx, struct list_head *list) { - blk_qc_t unused; -blk_status_t ret =BLK_STS_OK ; -while (!list_empty (list)) { +blk_status_t ret; struct request *rq = list_first_entry(list, struct request, queuelist);list_del_init (&rq->queuelist); -if (ret ==BLK_STS_OK ) - ret =blk_mq_try_issue_directly (hctx, rq, &unused, - false, + ret =blk_mq_request_issue_directly (rq,list_empty (list)); +if (ret !=BLK_STS_OK ) { +if (ret ==BLK_STS_RESOURCE || + ret ==BLK_STS_DEV_RESOURCE ) { +blk_mq_request_bypass_insert (rq,list_empty (list )); - else - blk_mq_sched_insert_request(rq, false, true,false);
block/blk-mq.c +7
-3+break ; + } +blk_mq_end_request (rq, ret); + } }/* @@ -1904,7 +1908,7 @@ void blk_mq_try_issue_list_directly(structblk_mq_hw_ctx *hctx, * the driver there was more coming, but that turned out to * be a lie. */ -if (ret !=BLK_STS_OK && hctx->queue->mq_ops->commit_rqs) +if (!list_empty (list) && hctx->queue->mq_ops->commit_rqs) hctx->queue->mq_ops->commit_rqs (hctx); }@@ -2017,13 +2021,13 @@ static blk_qc_t blk_mq_make_request(struct request_queue *q, struct bio *bio) if (same_queue_rq) { data.hctx = same_queue_rq->mq_hctx;blk_mq_try_issue_directly (data.hctx, same_queue_rq, - &cookie, false, true); + &cookie); } } else if ((q->nr_hw_queues > 1 && is_sync) || (!q->elevator && !data.hctx->dispatch_busy)) {blk_mq_put_ctx (data.ctx);blk_mq_bio_to_request (rq, bio); -blk_mq_try_issue_directly (data.hctx, rq, &cookie, false, true); +blk_mq_try_issue_directly (data.hctx, rq, &cookie);block/blk-mq.c +0
-0}else {blk_mq_put_ctx (data.ctx);blk_mq_bio_to_request (rq, bio);block/blk-mq.h +2
-4@@ -70,10 +70,8 @@ void blk_mq_request_bypass_insert(struct request *rq, bool run_queue);void blk_mq_insert_requests (struct blk_mq_hw_ctx *hctx,struct blk_mq_ctx *ctx,struct list_head *list); -blk_status_t blk_mq_try_issue_directly (struct blk_mq_hw_ctx *hctx, -struct request *rq, -blk_qc_t *cookie, -bool bypass,bool last); +/* Used by blk_insert_cloned_request() to issue request directly */ +blk_status_t blk_mq_request_issue_directly(struct request *rq, bool
Quoted 5 lines
last);
void blk_mq_try_issue_list_directly(structblk_mq_hw_ctx*hctx,
structlist_head*list);
Hello Bart
I can conform, reverting those 3 in order also resolves the panic I was seeing. I have 3 reboot tests of the srpt server allowing the client ot remain stable and try reconnect.
For the above patch:
Too many changes in code I am not familiar enough to review and comnment why reverting helps.
Thanks
Laurence
Quoted 8 lines · Laurence Oberman
I can conform, reverting those 3 in order also resolves the panic I was seeing. I have 3 reboot tests of the srpt server allowing the client ot remain stable and try reconnect.
For the above patch:
Tested-by Laurence Oberman <[email protected]>>Too many changes in code I am not familiar enough to review and comnment why reverting helps.
Thanks for the testing!
Bart.
Hi Bart
Quoted 6 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that the request has not been queued and that the caller should retry to submit the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed. Hence returnBLK_STS_OKif one of these functions is called. This patch avoids thatblk_mq_dispatch_rq_list()crashes when using dm-mpath.
Sorry, I seem to miss the original mail list that reported this issue. As your comment, it looks like that the request is handled again when the blk_mq_try_issue_directly return BLK_STS*_RESOURCE, right ?
The usage of this helper interface is,
if care about the return value and want to handle the request yourself when return BLK_STS*_RESOURCE, pass 'byass' as true.
otherwise, just pass 'bypass' as false, then blk_mq_try_issue_directly would take over all of the work including requeue or complete the request.
if dm-mpath case, the driver should only invoke dm_dispatch_clone_request, the 'bypass' parameter should only be true.
as the blk_mq_try_issue_directly,
it would return BLK_STS_OK when have to insert the request, otherwise, it would do nothing but return BLK_STS*_RESOURCE.
Would you please show the cause that the dm-mpath driver invoke blk_mq_try_issue_direclty with 'bypass == false' ?
Thanks
Jianchao
Quoted 43 lines
Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Tested-by Laurence Oberman <[email protected]>Reviewed-by Laurence Oberman <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issue request directly") # v5.0.Cc <[email protected]>Signed-off-by Bart Van Assche <[email protected]>--- block/blk-mq.c | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-)block/blk-mq.c +2
-7@@ -1859,16 +1859,11 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,case BLK_STS_RESOURCE :if (force) {blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return -* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; + ret =BLK_STS_OK ; }else if (!bypass) {blk_mq_sched_insert_request (rq, false, run_queue, false); + ret =BLK_STS_OK ; }break ;default :
Quoted 20 lines · jianchao.wang
Hi Bart
Quoted 6 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that the request has not been queued and that the caller should retry to submit the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed. Hence returnBLK_STS_OKif one of these functions is called. This patch avoids thatblk_mq_dispatch_rq_list()crashes when using dm-mpath.Sorry, I seem to miss the original mail list that reported this issue. As your comment, it looks like that the request is handled again when the
blk_mq_try_issue_directlyreturn BLK_STS*_RESOURCE, right ?The usage of this helper interface is,
if care about the return value and want to handle the request yourself when return BLK_STS*_RESOURCE, pass 'byass' as true.
otherwise, just pass 'bypass' as false, thenblk_mq_try_issue_directlywould take over all of the work including requeue or complete the request.
Quoted 9 lines
if dm-mpath case, the driver should only invoke
dm_dispatch_clone_request, the 'bypass' parameter should only be true.
as theblk_mq_try_issue_directly,
it would returnBLK_STS_OKwhen have to insert the request, otherwise, it would do nothing but return BLK_STS*_RESOURCE.Would you please show the cause that the dm-mpath driver invoke
blk_mq_try_issue_direcltywith 'bypass == false' ?
The issue seems to be here,
blk_mq_try_issue_directly
if (unlikely(blk_mq_hctx_stopped(hctx) || blk_queue_quiesced(q))) {
run_queue = false;
bypass = false; //------> HERE !!!
goto out_unlock;
}
case BLK_STS_RESOURCE:
if (force) {
blk_mq_request_bypass_insert(rq, run_queue);
ret = bypass ? BLK_STS_OK : ret;
} else if (!bypass) {
blk_mq_sched_insert_request(rq, false,
run_queue, false);
}
break;Then the request will be inserted and blk_mq_try_issue_dreictly returns BLK_STS_RESOURCE.
Could following patch fix the issue ?
block/blk-mq.c +1 -1
@@ -1813,7 +1813,7 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,*/ if (unlikely (blk_mq_hctx_stopped (hctx) ||blk_queue_quiesced (q))) { run_queue = false; - bypass = false; + force = true; goto out_unlock; }
Thanks
Jianchao
Quoted 45 lines
Quoted 44 lines
Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Tested-by Laurence Oberman <[email protected]>Reviewed-by Laurence Oberman <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issue request directly") # v5.0.Cc <[email protected]>Signed-off-by Bart Van Assche <[email protected]>--- block/blk-mq.c | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-)block/blk-mq.c +2
-7@@ -1859,16 +1859,11 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,case BLK_STS_RESOURCE :if (force) {blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return -* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; + ret =BLK_STS_OK ; }else if (!bypass) {blk_mq_sched_insert_request (rq, false, run_queue, false); + ret =BLK_STS_OK ; }break ;default :
Quoted 55 lines · jianchao.wang
Quoted 20 lines · jianchao.wang
Hi Bart
Quoted 6 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that the request has not been queued and that the caller should retry to submit the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed. Hence returnBLK_STS_OKif one of these functions is called. This patch avoids thatblk_mq_dispatch_rq_list()crashes when using dm-mpath.Sorry, I seem to miss the original mail list that reported this issue. As your comment, it looks like that the request is handled again when the
blk_mq_try_issue_directlyreturn BLK_STS*_RESOURCE, right ?The usage of this helper interface is,
if care about the return value and want to handle the request yourself when return BLK_STS*_RESOURCE, pass 'byass' as true.
otherwise, just pass 'bypass' as false, thenblk_mq_try_issue_directlywould take over all of the work including requeue or complete the request.Quoted 9 lines
if dm-mpath case, the driver should only invoke
dm_dispatch_clone_request, the 'bypass' parameter should only be true.
as theblk_mq_try_issue_directly,
it would returnBLK_STS_OKwhen have to insert the request, otherwise, it would do nothing but return BLK_STS*_RESOURCE.Would you please show the cause that the dm-mpath driver invoke
blk_mq_try_issue_direcltywith 'bypass == false' ?The issue seems to be here,
blk_mq_try_issue_directlyif (unlikely(blk_mq_hctx_stopped(hctx) || blk_queue_quiesced(q))) { run_queue = false; bypass = false; //------> HERE !!! goto out_unlock; } case BLK_STS_RESOURCE: if (force) { blk_mq_request_bypass_insert(rq, run_queue); ret = bypass ? BLK_STS_OK : ret; } else if (!bypass) { blk_mq_sched_insert_request(rq, false, run_queue, false); } break;
Quoted 4 lines
Then the request will be inserted and
blk_mq_try_issue_dreictlyreturnsBLK_STS_RESOURCE.Could following patch fix the issue ?
Hi Laurence
Would you please test this patch to see whether the issue could be fixed ?
Thanks
Jianchao
Quoted 63 lines
block/blk-mq.c +1
-1@@ -1813,7 +1813,7 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,*/ if (unlikely (blk_mq_hctx_stopped (hctx) ||blk_queue_quiesced (q))) { run_queue = false; - bypass = false; + force = true; goto out_unlock; }Thanks
JianchaoQuoted 45 lines
Quoted 44 lines
Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Tested-by Laurence Oberman <[email protected]>Reviewed-by Laurence Oberman <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issue request directly") # v5.0.Cc <[email protected]>Signed-off-by Bart Van Assche <[email protected]>--- block/blk-mq.c | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-)block/blk-mq.c +2
-7@@ -1859,16 +1859,11 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx,case BLK_STS_RESOURCE :if (force) {blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM -* to avoid livelock. Otherwise, we return -* the real result to indicate whether the -* request is direct-issued successfully. -*/ - ret = bypass ?BLK_STS_OK : ret; + ret =BLK_STS_OK ; }else if (!bypass) {blk_mq_sched_insert_request (rq, false, run_queue, false); + ret =BLK_STS_OK ; }break ;default :
Quoted 147 lines · jianchao.wang
Quoted 69 lines · jianchao.wang
Quoted 38 lines · jianchao.wang
Hi Bart
Quoted 11 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that
the request has not been queued and that the caller should retry to submit
the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed.
Hence returnBLK_STS_OKif one of these functions is called. This patch
avoids thatblk_mq_dispatch_rq_list()crashes when using dm- mpath.Sorry, I seem to miss the original mail list that reported this issue.
As your comment, it looks like that the request is handled again when
theblk_mq_try_issue_directlyreturn BLK_STS*_RESOURCE, right ?The usage of this helper interface is,
if care about the return value and want to handle the request yourself when
return BLK_STS*_RESOURCE, pass 'byass' as true. otherwise, just pass 'bypass' as false, thenblk_mq_try_issue_directlywould
take over all of the work including requeue or complete the request.if dm-mpath case, the driver should only invoke
dm_dispatch_clone_request,
the 'bypass' parameter should only be true.
as theblk_mq_try_issue_directly,
it would returnBLK_STS_OKwhen have to insert the request, otherwise,
it would do nothing but return BLK_STS*_RESOURCE.Quoted 4 lines
Would you please show the cause that the dm-mpath driver invoke
blk_mq_try_issue_direclty
with 'bypass == false' ?The issue seems to be here,
blk_mq_try_issue_directlyif (unlikely(blk_mq_hctx_stopped(hctx) || blk_queue_quiesced(q))) { run_queue = false; bypass = false; //------> HERE !!! goto out_unlock; } case BLK_STS_RESOURCE: if (force) { blk_mq_request_bypass_insert(rq, run_queue); ret = bypass ? BLK_STS_OK : ret; } else if (!bypass) { blk_mq_sched_insert_request(rq, false, run_queue, false); } break;Quoted 5 lines
Then the request will be inserted and
blk_mq_try_issue_dreictlyreturnsBLK_STS_RESOURCE.Could following patch fix the issue ?
Hi Laurence
Would you please test this patch to see whether the issue could be fixed ?
Thanks
JianchaoQuoted 63 lines
block/blk-mq.c +1
-1@@ -1813,7 +1813,7 @@ blk_status_t blk_mq_try_issue_directly(structblk_mq_hw_ctx *hctx, */ if (unlikely (blk_mq_hctx_stopped (hctx) ||blk_queue_quiesced (q))) { run_queue = false; - bypass = false; + force = true; goto out_unlock;}Thanks
JianchaoQuoted 44 lines
Quoted 44 lines
Cc Christoph Hellwig <[email protected]>Cc Hannes Reinecke <[email protected]>Cc James Smart <[email protected]>Cc Ming Lei <[email protected]>Cc Jianchao Wang <[email protected]>Cc Keith Busch <[email protected]>Cc Dongli Zhang <[email protected]>Cc Laurence Oberman <[email protected]>Tested-by Laurence Oberman <[email protected]>Reviewed-by Laurence Oberman <[email protected]>Reported-by Laurence Oberman <[email protected]>Fixes 7f556a44e61d ("blk-mq: refactor the code of issuerequest directly") # v5.0.
Cc <[email protected]>Signed-off-by Bart Van Assche <[email protected]>--- block/blk-mq.c | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-)block/blk-mq.c +0
-2@@ -1859,16 +1859,11 @@ blk_status_t blk_mq_try_issue_directly(struct blk_mq_hw_ctx *hctx, case BLK_STS_RESOURCE: if (force) {blk_mq_request_bypass_insert (rq, run_queue); -/* -* We have to return BLK_STS_OK for the DM
block/blk-mq.c +0
-1-* to avoid livelock. Otherwise, we return
block/blk-mq.c +0
-1-* the real result to indicate whether the
block/blk-mq.c +0
-1-* request is direct-issued successfully.
block/blk-mq.c +1
-2-*/ - ret = bypass ?BLK_STS_OK : ret; + ret =BLK_STS_OK ; }else if (!bypass) {
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
block/blk-mq.c
Quoted 8 lines
block/blk-mq.c +0
-0blk_mq_sched_insert_request(rq, false, run_queue,false);
block/blk-mq.c +1
-0+ ret =BLK_STS_OK ; }break ;default :
Hello Sir
I think Jens already took the revert patch though. I will try this when I gat a chance.
Need to wait until I can reboot the targetserver again. Regards
Laurence
Quoted 104 lines · Laurence Oberman
Quoted 103 lines · jianchao.wang
Quoted 69 lines · jianchao.wang
Quoted 38 lines · jianchao.wang
Hi Bart
Quoted 11 lines · Bart Van Assche
If
blk_mq_try_issue_directly()returns BLK_STS*_RESOURCE that means that
the request has not been queued and that the caller should retry to submit
the request. Bothblk_mq_request_bypass_insert()andblk_mq_sched_insert_request()guarantee that a request will be processed.
Hence returnBLK_STS_OKif one of these functions is called. This patch
avoids thatblk_mq_dispatch_rq_list()crashes when using dm- mpath.Sorry, I seem to miss the original mail list that reported this issue.
As your comment, it looks like that the request is handled again when
theblk_mq_try_issue_directlyreturn BLK_STS*_RESOURCE, right ?The usage of this helper interface is,
if care about the return value and want to handle the request yourself when
return BLK_STS*_RESOURCE, pass 'byass' as true. otherwise, just pass 'bypass' as false, thenblk_mq_try_issue_directlywould
take over all of the work including requeue or complete the request.if dm-mpath case, the driver should only invoke
dm_dispatch_clone_request,
the 'bypass' parameter should only be true.
as theblk_mq_try_issue_directly,
it would returnBLK_STS_OKwhen have to insert the request, otherwise,
it would do nothing but return BLK_STS*_RESOURCE.Quoted 4 lines
Would you please show the cause that the dm-mpath driver invoke
blk_mq_try_issue_direclty
with 'bypass == false' ?The issue seems to be here,
blk_mq_try_issue_directlyif (unlikely(blk_mq_hctx_stopped(hctx) || blk_queue_quiesced(q))) { run_queue = false; bypass = false; //------> HERE !!! goto out_unlock; } case BLK_STS_RESOURCE: if (force) { blk_mq_request_bypass_insert(rq, run_queue); ret = bypass ? BLK_STS_OK : ret; } else if (!bypass) { blk_mq_sched_insert_request(rq, false, run_queue, false); } break;Quoted 5 lines
Then the request will be inserted and
blk_mq_try_issue_dreictlyreturnsBLK_STS_RESOURCE.Could following patch fix the issue ?
Hi Laurence
Would you please test this patch to see whether the issue could be fixed ?
Thanks
JianchaoQuoted 19 lines
block/blk-mq.c +1
-1@@ -1813,7 +1813,7 @@ blk_status_t blk_mq_try_issue_directly(structblk_mq_hw_ctx *hctx, */ if (unlikely (blk_mq_hctx_stopped (hctx) ||blk_queue_quiesced (q))) { run_queue = false; - bypass = false; + force = true; goto out_unlock;}Thanks
Jianchao
...
Quoted 4 lines
Hello Sir
I think Jens already took the revert patch though. I will try this when I gat a chance.
Need to wait until I can reboot the targetserver again.
Thanks so much for your help. Please share the test result here. I will get the reverted patches back after that.
Thanks
Jianchao