RDMA/mana_ib: Prevent array underflow in mana_ib_create_qp_raw()
Subsystems (3)
PATCH 1/1 RDMA/mana_ib: Prevent array underflow in mana_ib_create_qp_raw()
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];
assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in mana_ib_create_qp_rss().
--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/infiniband/hw/mana/qp.c +1 -1
@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd,/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)return -EINVAL ;if (attr->cap.max_send_wr >MAX_SEND_BUFFERS_PER_QUEUE ) {
Signature · 1 line
2.35.1
Quoted 5 lines
Subject: [PATCH] RDMA/mana_ib: Prevent array underflow in
mana_ib_create_qp_raw()The "port" comes from the user and if it is zero then the:
Quoted 8 lines
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().Fixes 0266a177631d ("RDMA/mana_ib: Add a driver for Microsoft AzureNetwork Adapter")
Signed-off-by Dan Carpenter <[email protected]>
Thank you.
Quoted 20 lines
--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)drivers/infiniband/hw/mana/qp.c +1
-1@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp,struct ib_pd *ibpd,/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)return -EINVAL ;if (
attr->cap.max_send_wr>MAX_SEND_BUFFERS_PER_QUEUE) {
--
2.35.1
Quoted 19 lines · Dan Carpenter
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().Fixes 0266a177631d ("RDMA/mana_ib: Add a driver for Microsoft Azure Network Adapter")Signed-off-by Dan Carpenter <[email protected]>--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)drivers/infiniband/hw/mana/qp.c +0
-0
drivers/infiniband/hw/mana/qp.c static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd, · line 292
Quoted 5 lines
drivers/infiniband/hw/mana/qp.c +1
-1@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd,/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)
Why do I see port in mana_ib_create_qp? It should come from ib_qp_init_attr.
Thanks
Quoted 6 lines
drivers/infiniband/hw/mana/qp.c +0
-0return -EINVAL ;if (attr->cap.max_send_wr >MAX_SEND_BUFFERS_PER_QUEUE ) {Signature · 1 line
2.35.1
Quoted 21 lines · Leon Romanovsky
Quoted 20 lines · Dan Carpenter
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().Fixes 0266a177631d ("RDMA/mana_ib: Add a driver for Microsoft Azure Network Adapter")Signed-off-by Dan Carpenter <[email protected]>--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)drivers/infiniband/hw/mana/qp.c +0
-0@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd,
Quoted 6 lines
drivers/infiniband/hw/mana/qp.c static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd, · line 292
Quoted 4 lines
drivers/infiniband/hw/mana/qp.c +1
-1/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)Why do I see port in
mana_ib_create_qp? It should come fromib_qp_init_attr.
I am so confused by this question. Are you asking me? This is the _raw function. I'm now sure what mana_ib_create_qp() has to do with it.
The port comes from ib_copy_from_udata() which is just a wrapper around copy_from_user().
regards,
dan carpenter
Quoted 22 lines · Dan Carpenter
Quoted 21 lines · Leon Romanovsky
Quoted 20 lines · Dan Carpenter
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().Fixes 0266a177631d ("RDMA/mana_ib: Add a driver for Microsoft Azure Network Adapter")Signed-off-by Dan Carpenter <[email protected]>--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)drivers/infiniband/hw/mana/qp.c +0
-0@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd,
Quoted 8 lines
Quoted 6 lines
drivers/infiniband/hw/mana/qp.c static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd, · line 292
Quoted 4 lines
drivers/infiniband/hw/mana/qp.c +1
-1/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)Why do I see port in
mana_ib_create_qp? It should come fromib_qp_init_attr.I am so confused by this question. Are you asking me?
I asked *@microsoft folks.
Quoted 1 line
This is the
_rawfunction.
_raw comes from QP type, it is not raw (basic) in a sense you imagine.
Quoted 1 line
I'm now sure what
mana_ib_create_qp()has to do with it.
All create QP calls come through same verbs interface. ib_create_qp_user->create_qp->.create_qp->mana_ib_create_qp->mana_ib_create_qp_raw
Quoted 3 lines
The port comes from
ib_copy_from_udata()which is just a wrapper aroundcopy_from_user().
Right, and it shouldn't.
Quoted 4 lines
regards,
dan carpenter
Quoted 40 lines
Subject: Re: [PATCH] RDMA/mana_ib: Prevent array underflow in
mana_ib_create_qp_raw()Quoted 25 lines · Dan Carpenter
Quoted 24 lines · Leon Romanovsky
Quoted 23 lines · Dan Carpenter
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().Fixes 0266a177631d ("RDMA/mana_ib: Add a driver for MicrosoftAzure Network Adapter")
Signed-off-by Dan Carpenter <[email protected]>--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)(quoted diff) +0
-0
b/drivers/infiniband/hw/mana/qp.cindexea15ec77e321..54b61930a7fd100644drivers/infiniband/hw/mana/qp.c +0
-0@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd,Quoted 8 lines
Quoted 6 lines
drivers/infiniband/hw/mana/qp.c static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd, · line 292
Quoted 4 lines
drivers/infiniband/hw/mana/qp.c +1
-1/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)Why do I see port in
mana_ib_create_qp? It should come fromib_qp_init_attr.I am so confused by this question. Are you asking me?
I asked *@microsoft folks.
Quoted 9 lines
Quoted 1 line
This is the
_rawfunction.
_rawcomes from QP type, it is not raw (basic) in a sense you imagine.Quoted 1 line
I'm now sure what
mana_ib_create_qp()has to do with it.All create QP calls come through same verbs interface. ib_create_qp_user->create_qp->.create_qp->mana_ib_create_qp-
Quoted 1 line
mana_ib_create_qp_raw
MANA requires passing a port number when creating a RAW QP on a RDMA(Ethernet) port. At the hardware layer, the RDMA port and ethernet port share the same hardware resources, the port number needs to be known in advance when QP is created. If we don't' specify the port, the QP needs to take all the ports on the MANA device, some of them may have been assigned to Ethernet usage and can't be used for RDMA.
The reason is that unlike Nvidia CX hardware, MANA doesn't support bifurcation (for RAW QP) at the hardware level.
[https://www.dpdk.org/wp-content/uploads/sites/35/2018/06/Mellanox-bifurcated-driver-model.pdf]
To support RAW QP on a hardware port, we need to know the port number before configuring it on the hardware. And Ethernet can't use this port if a RAW QP is created on it. The coordination needs to be done in software.
In production environment, there are multiple ports on the same MANA device assigned to a VM. Customer can configure some of the ports for Ethernet and some for RDMA/DPDK.
I have investigated using the port_num in struct ib_qp_init_attr, but it seems it can't be used for this purpose because the port needs to be specified by the user-mode.
Thanks,
Long
Quoted 11 lines
Quoted 4 lines
The port comes from
ib_copy_from_udata()which is just a wrapper aroundcopy_from_user().Right, and it shouldn't.
Quoted 4 lines
regards,
dan carpenter
Quoted 61 lines · Long Li
Quoted 40 lines
Subject: Re: [PATCH] RDMA/mana_ib: Prevent array underflow in
mana_ib_create_qp_raw()Quoted 25 lines · Dan Carpenter
Quoted 24 lines · Leon Romanovsky
Quoted 23 lines · Dan Carpenter
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().Fixes 0266a177631d ("RDMA/mana_ib: Add a driver for MicrosoftAzure Network Adapter")
Signed-off-by Dan Carpenter <[email protected]>--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)(quoted diff) +0
-0
b/drivers/infiniband/hw/mana/qp.cindexea15ec77e321..54b61930a7fd100644drivers/infiniband/hw/mana/qp.c +0
-0@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd,Quoted 8 lines
Quoted 6 lines
drivers/infiniband/hw/mana/qp.c static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd, · line 292
Quoted 4 lines
drivers/infiniband/hw/mana/qp.c +1
-1/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)Why do I see port in
mana_ib_create_qp? It should come fromib_qp_init_attr.I am so confused by this question. Are you asking me?
I asked *@microsoft folks.
Quoted 9 lines
Quoted 1 line
This is the
_rawfunction.
_rawcomes from QP type, it is not raw (basic) in a sense you imagine.Quoted 1 line
I'm now sure what
mana_ib_create_qp()has to do with it.All create QP calls come through same verbs interface. ib_create_qp_user->create_qp->.create_qp->mana_ib_create_qp-
Quoted 1 line
mana_ib_create_qp_rawMANA requires passing a port number when creating a RAW QP on a RDMA(Ethernet) port. At the hardware layer, the RDMA port and ethernet port share the same hardware resources, the port number needs to be known in advance when QP is created. If we don't' specify the port, the QP needs to take all the ports on the MANA device, some of them may have been assigned to Ethernet usage and can't be used for RDMA.
The reason is that unlike Nvidia CX hardware, MANA doesn't support bifurcation (for RAW QP) at the hardware level.
[https://www.dpdk.org/wp-content/uploads/sites/35/2018/06/Mellanox-bifurcated-driver-model.pdf]
To support RAW QP on a hardware port, we need to know the port number before configuring it on the hardware. And Ethernet can't use this port if a RAW QP is created on it. The coordination needs to be done in software.
Quoted 5 lines
In production environment, there are multiple ports on the same MANA device assigned to a VM. Customer can configure some of the ports for Ethernet and some for RDMA/DPDK.
I have investigated using the
port_numin structib_qp_init_attr, but it seems it can't be used for this purpose because the port needs to be specified by the user-mode.
And this is the most problematic part for me. I don't think that it is RDMA user responsibility to dig in netdev port numbers.
Jason, what do you think? It looks like layering violation.
Thanks
Quoted 15 lines
Thanks,
LongQuoted 11 lines
Quoted 4 lines
The port comes from
ib_copy_from_udata()which is just a wrapper aroundcopy_from_user().Right, and it shouldn't.
Quoted 4 lines
regards,
dan carpenter
Quoted 62 lines · Leon Romanovsky
Quoted 61 lines · Long Li
Quoted 40 lines
Subject: Re: [PATCH] RDMA/mana_ib: Prevent array underflow in
mana_ib_create_qp_raw()Quoted 25 lines · Dan Carpenter
Quoted 24 lines · Leon Romanovsky
Quoted 23 lines · Dan Carpenter
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().Fixes 0266a177631d ("RDMA/mana_ib: Add a driver for MicrosoftAzure Network Adapter")
Signed-off-by Dan Carpenter <[email protected]>--- drivers/infiniband/hw/mana/qp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)(quoted diff) +0
-0
b/drivers/infiniband/hw/mana/qp.cindexea15ec77e321..54b61930a7fd100644drivers/infiniband/hw/mana/qp.c +0
-0@@ -289,7 +289,7 @@ static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd,Quoted 8 lines
Quoted 6 lines
drivers/infiniband/hw/mana/qp.c static int mana_ib_create_qp_raw(struct ib_qp *ibqp, struct ib_pd *ibpd, · line 292
Quoted 4 lines
drivers/infiniband/hw/mana/qp.c +1
-1/* IB ports start with 1, MANA Ethernet ports start with 0 */ port = ucmd.port; -if (ucmd.port > mc->num_ports) +if (port <1 || port > mc->num_ports)Why do I see port in
mana_ib_create_qp? It should come fromib_qp_init_attr.I am so confused by this question. Are you asking me?
I asked *@microsoft folks.
Quoted 9 lines
Quoted 1 line
This is the
_rawfunction.
_rawcomes from QP type, it is not raw (basic) in a sense you imagine.Quoted 1 line
I'm now sure what
mana_ib_create_qp()has to do with it.All create QP calls come through same verbs interface. ib_create_qp_user->create_qp->.create_qp->mana_ib_create_qp-
Quoted 1 line
mana_ib_create_qp_rawMANA requires passing a port number when creating a RAW QP on a RDMA(Ethernet) port. At the hardware layer, the RDMA port and ethernet port share the same hardware resources, the port number needs to be known in advance when QP is created. If we don't' specify the port, the QP needs to take all the ports on the MANA device, some of them may have been assigned to Ethernet usage and can't be used for RDMA.
The reason is that unlike Nvidia CX hardware, MANA doesn't support bifurcation (for RAW QP) at the hardware level.
[https://www.dpdk.org/wp-content/uploads/sites/35/2018/06/Mellanox-bifurcated-driver-model.pdf]
To support RAW QP on a hardware port, we need to know the port number before configuring it on the hardware. And Ethernet can't use this port if a RAW QP is created on it. The coordination needs to be done in software.
Quoted 8 lines
Quoted 5 lines
In production environment, there are multiple ports on the same MANA device assigned to a VM. Customer can configure some of the ports for Ethernet and some for RDMA/DPDK.
I have investigated using the
port_numin structib_qp_init_attr, but it seems it can't be used for this purpose because the port needs to be specified by the user-mode.And this is the most problematic part for me. I don't think that it is RDMA user responsibility to dig in netdev port numbers.
ok, I don't like it, but bug is here, let's fix it.
Quoted 20 lines
Jason, what do you think? It looks like layering violation.
Thanks
Quoted 15 lines
Thanks,
LongQuoted 11 lines
Quoted 4 lines
The port comes from
ib_copy_from_udata()which is just a wrapper aroundcopy_from_user().Right, and it shouldn't.
Quoted 4 lines
regards,
dan carpenter
Leon Romanovsky
AppliedQuoted 9 lines · Dan Carpenter
The "port" comes from the user and if it is zero then the:
ndev = mc->ports[port - 1];assignment does an out of bounds read. I have changed the if statement to fix this and to mirror how it is done in
mana_ib_create_qp_rss().[...]
Applied, thanks!
[1/1] RDMA/mana_ib: Prevent array underflow in mana_ib_create_qp_raw()
https://git.kernel.org/rdma/rdma/c/29419daf6c957f
Best regards,
Signature · 1 line
Leon Romanovsky <[email protected]>