RDMA/rxe: Generate async error for r_key violations
Subsystems (2)
PATCH 1/1 RDMA/rxe: Generate async error for r_key violations
Table 63 of the IBTA spec lists R_Key violations as a class C error. 9.9.3.1.3 Responder Class C Fault Behavior indicates an affiliated asynchronous error should be generated at the responder if the error can be associated to a QP but not a particular RX WQE.
Generate an affiliated asynchronous error upon Rkey violations if the opcode does not carry an immediate. This causes async events at the responder for all ops that generate R_Key violations except WRITE_WITH_IMM, where the error can ride in with the RX WQE.
---
drivers/infiniband/sw/rxe/rxe_resp.c | 56 ++++++++++++++++++++------- drivers/infiniband/sw/rxe/rxe_verbs.h | 1 + 2 files changed, 44 insertions(+), 13 deletions(-)
drivers/infiniband/sw/rxe/rxe_resp.c +43 -13
@@ -37,6 +37,7 @@ static char *resp_state_name[] = { [RESPST_ERR_MISSING_OPCODE_LAST_D1E] = "ERR_MISSING_OPCODE_LAST_D1E", [RESPST_ERR_TOO_MANY_RDMA_ATM_REQ] = "ERR_TOO_MANY_RDMA_ATM_REQ", [RESPST_ERR_RNR] = "ERR_RNR", + [RESPST_ERR_RKEY_VIOLATION_EVENT] = "ERR_RKEY_VIOLATION_EVENT", [RESPST_ERR_RKEY_VIOLATION] = "ERR_RKEY_VIOLATION", [RESPST_ERR_INVALIDATE_RKEY] = "ERR_INVALIDATE_RKEY_VIOLATION", [RESPST_ERR_LENGTH] = "ERR_LENGTH",
@@ -423,6 +424,19 @@ static void qp_resp_from_atmeth(struct rxe_qp *qp, struct rxe_pkt_info *pkt) qp->resp.resid =sizeof (u64); } +/* Transition to an rkey violation state. C9-222.1 requires an async event +* at the responder, but only if the error cannot be attached to an RX WQE. +* WRITE_WITH_IMM is the only op that might have that more precise RX WQE +* to pin the error on. +*/ +static enum resp_states get_rkey_violation_state (struct rxe_pkt_info *pkt) +{ +if (pkt->mask &RXE_IMMDT_MASK ) +return RESPST_ERR_RKEY_VIOLATION ; + +return RESPST_ERR_RKEY_VIOLATION_EVENT ; +} +/* resolve the packet rkey to qp->resp.mr or set qp->resp.mr to NULL * if an invalid rkey is received or the rdma length is zero. For middle * or last packets use the stored value of mr.
@@ -486,14 +500,14 @@ static enum resp_states check_rkey(struct rxe_qp *qp, mw =rxe_lookup_mw (qp, access, rkey);if (!mw) {rxe_dbg_qp (qp,"no MW matches rkey %#x\n" , rkey); - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; } mr = mw->mr;if (!mr) {rxe_dbg_qp (qp,"MW doesn't have an MR\n" ); - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; }
@@ -507,7 +521,7 @@ static enum resp_states check_rkey(struct rxe_qp *qp, mr =lookup_mr (qp->pd, access, rkey,RXE_LOOKUP_REMOTE );if (!mr) {rxe_dbg_qp (qp,"no MR matches rkey %#x\n" , rkey); - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; } }
@@ -521,7 +535,7 @@ static enum resp_states check_rkey(struct rxe_qp *qp, }if (mr_check_range (mr, va + qp->resp.offset, resid)) { - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; }
@@ -586,7 +600,7 @@ static enum resp_states write_data_in(struct rxe_qp *qp, err =rxe_mr_copy (qp->resp.mr, qp->resp.va + qp->resp.offset,payload_addr (pkt), data_len,RXE_TO_MR_OBJ );if (err) { - rc =RESPST_ERR_RKEY_VIOLATION ; + rc =get_rkey_violation_state (pkt); goto out; }
@@ -667,7 +681,7 @@ static enum resp_states process_flush(struct rxe_qp *qp,if (res->flush.type &IB_FLUSH_PERSISTENT ) {if (rxe_flush_pmem_iova (mr, start, length)) -return RESPST_ERR_RKEY_VIOLATION ; +return get_rkey_violation_state (pkt);/* Make data persistent. */ wmb (); }else if (res->flush.type &IB_FLUSH_GLOBAL ) {
@@ -1383,6 +1397,20 @@ static enum resp_states duplicate_request(struct rxe_qp *qp,return rc; } +static void do_qp_event (struct rxe_qp *qp,enum ib_event_type etype) +{ +struct ib_event event; +struct ib_qp *ibqp = &qp->ibqp; + + event.event = etype; + event.device = ibqp->device; + event.element.qp = ibqp; +if (ibqp->event_handler) { +rxe_dbg_qp (qp,"reporting QP event %d\n" , etype); + ibqp->event_handler (&event, ibqp->qp_context); + } +} +/* Process a class A or C. Both are treated the same in this implementation. */ static void do_class_ac_error (struct rxe_qp *qp,u8 syndrome,enum ib_wc_status status)
@@ -1476,14 +1504,9 @@ static void flush_recv_queue(struct rxe_qp *qp, bool notify)int err;if (qp->srq) { -if (notify && qp->ibqp.event_handler) { -struct ib_event ev; +if (notify && qp->ibqp.event_handler) +do_qp_event (qp,IB_EVENT_QP_LAST_WQE_REACHED ); - ev.device = qp->ibqp.device; - ev.element.qp = &qp->ibqp; - ev.event =IB_EVENT_QP_LAST_WQE_REACHED ; - qp->ibqp.event_handler (&ev, qp->ibqp.qp_context); - }return ; }
@@ -1613,6 +1636,13 @@ int rxe_receiver(struct rxe_qp *qp) state =RESPST_CLEANUP ;break ; +case RESPST_ERR_RKEY_VIOLATION_EVENT : +if (qp_type (qp) ==IB_QPT_RC ) +do_qp_event (qp,IB_EVENT_QP_ACCESS_ERR ); + + state =RESPST_ERR_RKEY_VIOLATION ; +break ; +case RESPST_ERR_RKEY_VIOLATION :if (qp_type (qp) ==IB_QPT_RC ) {/* Class C */
drivers/infiniband/sw/rxe/rxe_verbs.h +1 -0
@@ -154,6 +154,7 @@ enum resp_states {RESPST_ERR_MISSING_OPCODE_LAST_D1E ,RESPST_ERR_TOO_MANY_RDMA_ATM_REQ ,RESPST_ERR_RNR , +RESPST_ERR_RKEY_VIOLATION_EVENT ,RESPST_ERR_RKEY_VIOLATION ,RESPST_ERR_INVALIDATE_RKEY , RESPST_ERR_LENGTH,
Signature · 4 lines
2.47.3 base-commit: c22e26bd0906e9c8325462993f01adb16b8ea2c0 branch: 260211-rxe-async-linus
Quoted 4 lines · Evan Green
Table 63 of the IBTA spec lists
R_Keyviolations as a class C error. 9.9.3.1.3 Responder Class C Fault Behavior indicates an affiliated asynchronous error should be generated at the responder if the error can be associated to a QP but not a particular RX WQE.
This paragraph should be the descriptions in the commit log.
"C9-222.1.1: For an HCA responder using Reliable Connection service, for a Class C responder side error, the error shall be reported to the requester by generating the appropriate NAK code as specified in Table 63 Re- sponder Error Behavior Summary on page 448. If the error can be related to a particular QP but cannot be related to a particular WQE on that re- ceive queue (e.g. the error occurred while executing an RDMA Write Re- quest without immediate data), the error shall be reported to the responder’s client as an Affiliated Asynchronous error. See Section 10.10.2.3 Asynchronous Errors on page 576 for details. If the error can be related to a particular WQE on a given receive queue, the QP shall be placed into the error state and the error shall be reported to the re- sponder’s client as a Completion error. See Section 10.10.2.2 Completion Errors on page 575."
In this commit, a new asynchrounous event RESPST_ERR_RKEY_VIOLATION_EVENT is introduced and implemented based on 9.9.3.1.3. It is not a bug fix. As such, no FIXES tag.
I am fine with this. I am just wondering if this similar feature has already been implemented in iWARP driver or not.
Thanks,
Zhu Yanjun
Quoted 163 lines
Generate an affiliated asynchronous error upon Rkey violations if the opcode does not carry an immediate. This causes async events at the responder for all ops that generate
R_Keyviolations exceptWRITE_WITH_IMM, where the error can ride in with the RX WQE.Signed-off-by Evan Green <[email protected]>---
drivers/infiniband/sw/rxe/rxe_resp.c | 56 ++++++++++++++++++++------- drivers/infiniband/sw/rxe/rxe_verbs.h | 1 + 2 files changed, 44 insertions(+), 13 deletions(-)drivers/infiniband/sw/rxe/rxe_resp.c +43
-13@@ -37,6 +37,7 @@ static char *resp_state_name[] = { [RESPST_ERR_MISSING_OPCODE_LAST_D1E] = "ERR_MISSING_OPCODE_LAST_D1E", [RESPST_ERR_TOO_MANY_RDMA_ATM_REQ] = "ERR_TOO_MANY_RDMA_ATM_REQ", [RESPST_ERR_RNR] = "ERR_RNR", + [RESPST_ERR_RKEY_VIOLATION_EVENT] = "ERR_RKEY_VIOLATION_EVENT", [RESPST_ERR_RKEY_VIOLATION] = "ERR_RKEY_VIOLATION", [RESPST_ERR_INVALIDATE_RKEY] = "ERR_INVALIDATE_RKEY_VIOLATION", [RESPST_ERR_LENGTH] = "ERR_LENGTH",@@ -423,6 +424,19 @@ static void qp_resp_from_atmeth(struct rxe_qp *qp, struct rxe_pkt_info *pkt) qp->resp.resid =sizeof (u64); } +/* Transition to an rkey violation state. C9-222.1 requires an async event +* at the responder, but only if the error cannot be attached to an RX WQE. +* WRITE_WITH_IMM is the only op that might have that more precise RX WQE +* to pin the error on. +*/ +static enum resp_states get_rkey_violation_state (struct rxe_pkt_info *pkt) +{ +if (pkt->mask &RXE_IMMDT_MASK ) +return RESPST_ERR_RKEY_VIOLATION ; + +return RESPST_ERR_RKEY_VIOLATION_EVENT ; +} +/* resolve the packet rkey to qp->resp.mr or set qp->resp.mr to NULL * if an invalid rkey is received or the rdma length is zero. For middle * or last packets use the stored value of mr. @@ -486,14 +500,14 @@ static enum resp_states check_rkey(struct rxe_qp *qp, mw =rxe_lookup_mw (qp, access, rkey);if (!mw) {rxe_dbg_qp (qp,"no MW matches rkey %#x\n" , rkey); - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; } mr = mw->mr;if (!mr) {rxe_dbg_qp (qp,"MW doesn't have an MR\n" ); - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; }@@ -507,7 +521,7 @@ static enum resp_states check_rkey(struct rxe_qp *qp, mr =lookup_mr (qp->pd, access, rkey,RXE_LOOKUP_REMOTE );if (!mr) {rxe_dbg_qp (qp,"no MR matches rkey %#x\n" , rkey); - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; } }@@ -521,7 +535,7 @@ static enum resp_states check_rkey(struct rxe_qp *qp, }if (mr_check_range (mr, va + qp->resp.offset, resid)) { - state =RESPST_ERR_RKEY_VIOLATION ; + state =get_rkey_violation_state (pkt); goto err; }@@ -586,7 +600,7 @@ static enum resp_states write_data_in(struct rxe_qp *qp, err =rxe_mr_copy (qp->resp.mr, qp->resp.va + qp->resp.offset,payload_addr (pkt), data_len,RXE_TO_MR_OBJ );if (err) { - rc =RESPST_ERR_RKEY_VIOLATION ; + rc =get_rkey_violation_state (pkt); goto out; }@@ -667,7 +681,7 @@ static enum resp_states process_flush(struct rxe_qp *qp,if (res->flush.type &IB_FLUSH_PERSISTENT ) {if (rxe_flush_pmem_iova (mr, start, length)) -return RESPST_ERR_RKEY_VIOLATION ; +return get_rkey_violation_state (pkt);/* Make data persistent. */ wmb (); }else if (res->flush.type &IB_FLUSH_GLOBAL ) {@@ -1383,6 +1397,20 @@ static enum resp_states duplicate_request(struct rxe_qp *qp,return rc; } +static void do_qp_event (struct rxe_qp *qp,enum ib_event_type etype) +{ +struct ib_event event; +struct ib_qp *ibqp = &qp->ibqp; + + event.event = etype; + event.device = ibqp->device; + event.element.qp = ibqp; +if (ibqp->event_handler) { +rxe_dbg_qp (qp,"reporting QP event %d\n" , etype); + ibqp->event_handler (&event, ibqp->qp_context); + } +} +/* Process a class A or C. Both are treated the same in this implementation. */ static void do_class_ac_error (struct rxe_qp *qp,u8 syndrome,enum ib_wc_status status)@@ -1476,14 +1504,9 @@ static void flush_recv_queue(struct rxe_qp *qp, bool notify)int err;if (qp->srq) { -if (notify && qp->ibqp.event_handler) { -struct ib_event ev; +if (notify && qp->ibqp.event_handler) +do_qp_event (qp,IB_EVENT_QP_LAST_WQE_REACHED ); - ev.device = qp->ibqp.device; - ev.element.qp = &qp->ibqp; - ev.event =IB_EVENT_QP_LAST_WQE_REACHED ; - qp->ibqp.event_handler (&ev, qp->ibqp.qp_context); - }return ; }@@ -1613,6 +1636,13 @@ int rxe_receiver(struct rxe_qp *qp) state =RESPST_CLEANUP ;break ; +case RESPST_ERR_RKEY_VIOLATION_EVENT : +if (qp_type (qp) ==IB_QPT_RC ) +do_qp_event (qp,IB_EVENT_QP_ACCESS_ERR ); + + state =RESPST_ERR_RKEY_VIOLATION ; +break ; +case RESPST_ERR_RKEY_VIOLATION :if (qp_type (qp) ==IB_QPT_RC ) {/* Class C */ drivers/infiniband/sw/rxe/rxe_verbs.h +1
-0@@ -154,6 +154,7 @@ enum resp_states {RESPST_ERR_MISSING_OPCODE_LAST_D1E ,RESPST_ERR_TOO_MANY_RDMA_ATM_REQ ,RESPST_ERR_RNR , +RESPST_ERR_RKEY_VIOLATION_EVENT ,RESPST_ERR_RKEY_VIOLATION ,RESPST_ERR_INVALIDATE_RKEY , RESPST_ERR_LENGTH,
Hi Yanjun,
Quoted 14 lines · > On 2/12/26, 11:48 AM, "yanjun.zhu" <[email protected]…
Quoted 3 lines
Quoted 4 lines · Evan Green
Table 63 of the IBTA spec lists
R_Keyviolations as a class C error. 9.9.3.1.3 Responder Class C Fault Behavior indicates an affiliated asynchronous error should be generated at the responder if the error can be associated to a QP but not a particular RX WQE.This paragraph should be the descriptions in the commit log.
Quoted 13 lines
"C9-222.1.1: For an HCA responder using Reliable Connection service, for a Class C responder side error, the error shall be reported to the requester by generating the appropriate NAK code as specified in Table 63 Re- sponder Error Behavior Summary on page 448. If the error can be related to a particular QP but cannot be related to a particular WQE on that re- ceive queue (e.g. the error occurred while executing an RDMA Write Re- quest without immediate data), the error shall be reported to the responder’s client as an Affiliated Asynchronous error. See Section 10.10.2.3 Asynchronous Errors on page 576 for details. If the error can be related to a particular WQE on a given receive queue, the QP shall be placed into the error state and the error shall be reported to the re- sponder’s client as a Completion error. See Section 10.10.2.2 Completion Errors on page 575."
Apologies for the delayed response, I'm having an awful time setting up a mail client with proper formatting.
Sure, I'll add this and send a v2.
Quoted 9 lines
In this commit, a new asynchrounous event
RESPST_ERR_RKEY_VIOLATION_EVENTis introduced and implemented based on 9.9.3.1.3. It is not a bug fix. As such, no FIXES tag.I am fine with this. I am just wondering if this similar feature has already been implemented in iWARP driver or not.
I... can't tell, kind of? I see three places where QP_ACCESS_ERR events are generated in siw. They do look like R_Key violation scenarios, though I don’t see any any spots where SIW_WC_REM_ACCESS_ERR is produced as an error code.
Quoted 4 lines
Thanks,
Reviewed-by Zhu Yanjun <[email protected] <mailto:[email protected]>>
Thank you!
-Evan
Quoted 31 lines · Evan Green
Hi Yanjun,
Quoted 10 lines · > On 2/12/26, 11:48 AM, "yanjun.zhu" <[email protected]…
Quoted 4 lines · Evan Green
Table 63 of the IBTA spec lists
R_Keyviolations as a class C error. 9.9.3.1.3 Responder Class C Fault Behavior indicates an affiliated asynchronous error should be generated at the responder if the error can be associated to a QP but not a particular RX WQE.This paragraph should be the descriptions in the commit log.
Quoted 13 lines
"C9-222.1.1: For an HCA responder using Reliable Connection service, for a Class C responder side error, the error shall be reported to the requester by generating the appropriate NAK code as specified in Table 63 Re- sponder Error Behavior Summary on page 448. If the error can be related to a particular QP but cannot be related to a particular WQE on that re- ceive queue (e.g. the error occurred while executing an RDMA Write Re- quest without immediate data), the error shall be reported to the responder’s client as an Affiliated Asynchronous error. See Section 10.10.2.3 Asynchronous Errors on page 576 for details. If the error can be related to a particular WQE on a given receive queue, the QP shall be placed into the error state and the error shall be reported to the re- sponder’s client as a Completion error. See Section 10.10.2.2 Completion Errors on page 575."
Apologies for the delayed response, I'm having an awful time setting up a mail client with proper formatting.
Sure, I'll add this and send a v2.
Quoted 1 line
Quoted 8 lines
Quoted 7 lines
In this commit, a new asynchrounous event
RESPST_ERR_RKEY_VIOLATION_EVENTis introduced and implemented based on 9.9.3.1.3. It is not a bug fix. As such, no FIXES tag.I am fine with this. I am just wondering if this similar feature has already been implemented in iWARP driver or not.
I... can't tell, kind of? I see three places where
QP_ACCESS_ERRevents are generated in siw. They do look likeR_Keyviolation scenarios, though I don’t see any any spots whereSIW_WC_REM_ACCESS_ERRis produced as an error code.
Thank you very much. I’ve also looked into the iWARP driver and have similar thoughts to yours. If you’re interested in working on the iWARP driver, you’re welcome to implement this feature there as well—it’s entirely up to you. I simply hope that both iWARP and RXE continue to improve over time.
Thanks,
Yanjun.Zhu
Quoted 10 lines
Quoted 4 lines
Thanks,
Reviewed-by Zhu Yanjun <[email protected] <mailto:[email protected]>>Thank you!
-Evan
Signature · 2 lines
Best Regards, Yanjun.Zhu