Skip to contentSkip to conversation

nvme-tcp: support specifying the congestion-control

PATCH Superseded Mingbao Sun 2 participants 7 messages Mar 8, 2022 – Mar 10, 2022 NVMe

lore
Share & tools
lore
#0 lore raw

PATCH v2 2/2 nvme-tcp: support specifying the congestion-control

From: Mingbao Sun <[email protected]>

congestion-control could have a noticeable impaction on the performance of TCP-based communications. This is of course true to NVMe_over_TCP.

Different congestion-controls (e.g., cubic, dctcp) are suitable for different scenarios. Proper adoption of congestion control would benefit the performance. On the contrary, the performance could be destroyed.

Though we can specify the congestion-control of NVMe_over_TCP via writing '/proc/sys/net/ipv4/tcp_congestion_control', but this also changes the congestion-control of all the future TCP sockets that have not been explicitly assigned the congestion-control, thus bringing potential impaction on their performance.

So it makes sense to make NVMe_over_TCP support specifying the congestion-control. And this commit addresses the host side.

Implementation approach:
a new option called 'tcp_congestion' was created in fabrics opt_tokens for 'nvme connect' command to passed in the congestion-control specified by the user.
Then later in nvme_tcp_alloc_queue, the specified congestion-control would be applied to the relevant sockets of the host side.

---
 drivers/nvme/host/fabrics.c | 12 ++++++++++++
 drivers/nvme/host/fabrics.h |  2 ++
 drivers/nvme/host/tcp.c     | 20 +++++++++++++++++++-
 3 files changed, 33 insertions(+), 1 deletion(-)
drivers/nvme/host/fabrics.c +12 -0
index ee79a6d639b4..79d5f0dbafd3 100644
@@ -548,6 +548,7 @@ static const match_table_t opt_tokens = {
 	{ NVMF_OPT_TOS,			"tos=%d"		},
 	{ NVMF_OPT_FAIL_FAST_TMO,	"fast_io_fail_tmo=%d"	},
 	{ NVMF_OPT_DISCOVERY,		"discovery"		},
+	{ NVMF_OPT_TCP_CONGESTION,	"tcp_congestion=%s"	},
 	{ NVMF_OPT_ERR,			NULL			}
 };
 
@@ -829,6 +830,16 @@ static int nvmf_parse_options(struct nvmf_ctrl_options *opts,
 		case NVMF_OPT_DISCOVERY:
 			opts->discovery_nqn = true;
 			break;
+		case NVMF_OPT_TCP_CONGESTION:
+			p = match_strdup(args);
+			if (!p) {
+				ret = -ENOMEM;
+				goto out;
+			}
+
+			kfree(opts->tcp_congestion);
+			opts->tcp_congestion = p;
+			break;
 		default:
 			pr_warn("unknown parameter or missing value '%s' in ctrl creation request\n",
 				p);
@@ -947,6 +958,7 @@ void nvmf_free_options(struct nvmf_ctrl_options *opts)
 	kfree(opts->subsysnqn);
 	kfree(opts->host_traddr);
 	kfree(opts->host_iface);
+	kfree(opts->tcp_congestion);
 	kfree(opts);
 }
 EXPORT_SYMBOL_GPL(nvmf_free_options);
drivers/nvme/host/fabrics.h +2 -0
index c3203ff1c654..25fdc169949d 100644
@@ -68,6 +68,7 @@ enum {
 	NVMF_OPT_FAIL_FAST_TMO	= 1 << 20,
 	NVMF_OPT_HOST_IFACE	= 1 << 21,
 	NVMF_OPT_DISCOVERY	= 1 << 22,
+	NVMF_OPT_TCP_CONGESTION	= 1 << 23,
 };
 
 /**
@@ -117,6 +118,7 @@ struct nvmf_ctrl_options {
 	unsigned int		nr_io_queues;
 	unsigned int		reconnect_delay;
 	bool			discovery_nqn;
+	const char		*tcp_congestion;
 	bool			duplicate_connect;
 	unsigned int		kato;
 	struct nvmf_host	*host;
drivers/nvme/host/tcp.c +19 -1
index babbc14a4b76..3415e178a78b 100644
@@ -1403,6 +1403,8 @@ static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl,
 {
 	struct nvme_tcp_ctrl *ctrl = to_tcp_ctrl(nctrl);
 	struct nvme_tcp_queue *queue = &ctrl->queues[qid];
+	char ca_name[TCP_CA_NAME_MAX];
+	sockptr_t optval;
 	int ret, rcv_pdu_size;
 
 	mutex_init(&queue->queue_lock);
@@ -1447,6 +1449,21 @@ static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl,
 	if (nctrl->opts->tos >= 0)
 		ip_sock_set_tos(queue->sock->sk, nctrl->opts->tos);
 
+	if (nctrl->opts->mask & NVMF_OPT_TCP_CONGESTION) {
+		strncpy(ca_name, nctrl->opts->tcp_congestion,
+			TCP_CA_NAME_MAX-1);
+		optval = KERNEL_SOCKPTR(ca_name);
+		ret = sock_common_setsockopt(queue->sock, IPPROTO_TCP,
+					     TCP_CONGESTION, optval,
+					     strlen(ca_name));
+		if (ret) {
+			dev_err(nctrl->device,
+				"failed to set TCP congestion to %s: %d\n",
+				ca_name, ret);
+			goto err_sock;
+		}
+	}
+
 	/* Set 10 seconds timeout for icresp recvmsg */
 	queue->sock->sk->sk_rcvtimeo = 10 * HZ;
 
@@ -2610,7 +2627,8 @@ static struct nvmf_transport_ops nvme_tcp_transport = {
 			  NVMF_OPT_HOST_TRADDR | NVMF_OPT_CTRL_LOSS_TMO |
 			  NVMF_OPT_HDR_DIGEST | NVMF_OPT_DATA_DIGEST |
 			  NVMF_OPT_NR_WRITE_QUEUES | NVMF_OPT_NR_POLL_QUEUES |
-			  NVMF_OPT_TOS | NVMF_OPT_HOST_IFACE,
+			  NVMF_OPT_TOS | NVMF_OPT_HOST_IFACE |
+			  NVMF_OPT_TCP_CONGESTION,
 	.create_ctrl	= nvme_tcp_create_ctrl,
 };
 
Signature · 1 line
2.26.2
#1 lore raw

Per the comments from Christoph Hellwig, the calls to networking APIs in nvme-fabrics.ko were deleted.

Since the tcp_congestion passed in from the user-space could also get checked later within sock_common_setsockopt in nvme_tcp_alloc_queue. So this deletion brings no downside to command 'nvme connect'.

#2 lore raw
In reply to Mingbao Sun
Quoted 104 lines · Mingbao Sun

From: Mingbao Sun <[email protected]>

congestion-control could have a noticeable impaction on the performance of TCP-based communications. This is of course true to NVMe_over_TCP.

Different congestion-controls (e.g., cubic, dctcp) are suitable for different scenarios. Proper adoption of congestion control would benefit the performance. On the contrary, the performance could be destroyed.

Though we can specify the congestion-control of NVMe_over_TCP via writing '/proc/sys/net/ipv4/tcp_congestion_control', but this also changes the congestion-control of all the future TCP sockets that have not been explicitly assigned the congestion-control, thus bringing potential impaction on their performance.

So it makes sense to make NVMe_over_TCP support specifying the congestion-control. And this commit addresses the host side.

Implementation approach:
a new option called 'tcp_congestion' was created in fabrics opt_tokens for 'nvme connect' command to passed in the congestion-control specified by the user.
Then later in nvme_tcp_alloc_queue, the specified congestion-control would be applied to the relevant sockets of the host side.

---
 drivers/nvme/host/fabrics.c | 12 ++++++++++++
 drivers/nvme/host/fabrics.h |  2 ++
 drivers/nvme/host/tcp.c     | 20 +++++++++++++++++++-
 3 files changed, 33 insertions(+), 1 deletion(-)
drivers/nvme/host/fabrics.c +12 -0
index ee79a6d639b4..79d5f0dbafd3 100644
@@ -548,6 +548,7 @@ static const match_table_t opt_tokens = {
 	{ NVMF_OPT_TOS,			"tos=%d"		},
 	{ NVMF_OPT_FAIL_FAST_TMO,	"fast_io_fail_tmo=%d"	},
 	{ NVMF_OPT_DISCOVERY,		"discovery"		},
+	{ NVMF_OPT_TCP_CONGESTION,	"tcp_congestion=%s"	},
 	{ NVMF_OPT_ERR,			NULL			}
 };
 
@@ -829,6 +830,16 @@ static int nvmf_parse_options(struct nvmf_ctrl_options *opts,
 		case NVMF_OPT_DISCOVERY:
 			opts->discovery_nqn = true;
 			break;
+		case NVMF_OPT_TCP_CONGESTION:
+			p = match_strdup(args);
+			if (!p) {
+				ret = -ENOMEM;
+				goto out;
+			}
+
+			kfree(opts->tcp_congestion);
+			opts->tcp_congestion = p;
+			break;
 		default:
 			pr_warn("unknown parameter or missing value '%s' in ctrl creation request\n",
 				p);
@@ -947,6 +958,7 @@ void nvmf_free_options(struct nvmf_ctrl_options *opts)
 	kfree(opts->subsysnqn);
 	kfree(opts->host_traddr);
 	kfree(opts->host_iface);
+	kfree(opts->tcp_congestion);
 	kfree(opts);
 }
 EXPORT_SYMBOL_GPL(nvmf_free_options);
drivers/nvme/host/fabrics.h +2 -0
index c3203ff1c654..25fdc169949d 100644
@@ -68,6 +68,7 @@ enum {
 	NVMF_OPT_FAIL_FAST_TMO	= 1 << 20,
 	NVMF_OPT_HOST_IFACE	= 1 << 21,
 	NVMF_OPT_DISCOVERY	= 1 << 22,
+	NVMF_OPT_TCP_CONGESTION	= 1 << 23,
 };
 
 /**
@@ -117,6 +118,7 @@ struct nvmf_ctrl_options {
 	unsigned int		nr_io_queues;
 	unsigned int		reconnect_delay;
 	bool			discovery_nqn;
+	const char		*tcp_congestion;
 	bool			duplicate_connect;
 	unsigned int		kato;
 	struct nvmf_host	*host;
drivers/nvme/host/tcp.c +2 -0
index babbc14a4b76..3415e178a78b 100644
@@ -1403,6 +1403,8 @@ static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl,
 {
 	struct nvme_tcp_ctrl *ctrl = to_tcp_ctrl(nctrl);
 	struct nvme_tcp_queue *queue = &ctrl->queues[qid];
+	char ca_name[TCP_CA_NAME_MAX];
+	sockptr_t optval;
 	int ret, rcv_pdu_size;
 
 	mutex_init(&queue->queue_lock);

drivers/nvme/host/tcp.c static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl, · line 1458

Quoted 10 lines
drivers/nvme/host/tcp.c +7 -0
@@ -1447,6 +1449,21 @@ static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl,
 	if (nctrl->opts->tos >= 0)
 		ip_sock_set_tos(queue->sock->sk, nctrl->opts->tos);
 
+	if (nctrl->opts->mask & NVMF_OPT_TCP_CONGESTION) {
+		strncpy(ca_name, nctrl->opts->tcp_congestion,
+			TCP_CA_NAME_MAX-1);
+		optval = KERNEL_SOCKPTR(ca_name);
+		ret = sock_common_setsockopt(queue->sock, IPPROTO_TCP,
+					     TCP_CONGESTION, optval,
+					     strlen(ca_name));

This needs to use kernel_setsockopt. I also can see absolutely no need for the optval local variable, and I also don't really see why we need ca_name either - if we need to limit the length and terminate it (but why?) that can be done during option parsing.

#3 lore raw
Quoted 4 lines
Quoted 4 lines
drivers/nvme/host/tcp.c +0 -0
@@ -1447,6 +1449,21 @@ static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl,
 	if (nctrl->opts->tos >= 0)
 		ip_sock_set_tos(queue->sock->sk, nctrl->opts->tos);
 
Quoted 12 lines

drivers/nvme/host/tcp.c static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl, · line 1458

Quoted 7 lines
drivers/nvme/host/tcp.c +7 -0
+	if (nctrl->opts->mask & NVMF_OPT_TCP_CONGESTION) {
+		strncpy(ca_name, nctrl->opts->tcp_congestion,
+			TCP_CA_NAME_MAX-1);
+		optval = KERNEL_SOCKPTR(ca_name);
+		ret = sock_common_setsockopt(queue->sock, IPPROTO_TCP,
+					     TCP_CONGESTION, optval,
+					     strlen(ca_name));  

This needs to use kernel_setsockopt. I also can see absolutely no need for the optval local variable, and I also don't really see why we need ca_name either - if we need to limit the length and terminate it (but why?) that can be done during option parsing.

Well, actually at the beginning I did use kernel_setsockopt. But the compilation failed.

Then I found the API kernel_setsockopt disappeared from kernel v5.8. So I use sock_common_setsockopt instead.
The birth of variable ca_name and optval is just because of the the relevant definitions related to the prototype of sock_common_setsockopt.

But now through thinking your comments and investigating the story of the disappearance of kernel_setsockopt, I feel I should use tcp_set_congestion_control instead of sock_common_setsockopt. Just as target/tcp.c replaced kernel_setsockopt with ip_sock_set_tos.

As for the length limitation of the ca name, I will (if required) move them into the phase of option parsing in the next version.

#4 lore raw
Quoted 4 lines · On Wed, 9 Mar 2022 15:32:33 +0800 Mingbao Sun <[email protected]> wrote:
Quoted 4 lines
Quoted 4 lines
drivers/nvme/host/tcp.c +0 -0
@@ -1447,6 +1449,21 @@ static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl,
 	if (nctrl->opts->tos >= 0)
 		ip_sock_set_tos(queue->sock->sk, nctrl->opts->tos);
 
Quoted 12 lines
Quoted 4 lines
Quoted 4 lines
drivers/nvme/host/tcp.c +4 -0
+	if (nctrl->opts->mask & NVMF_OPT_TCP_CONGESTION) {
+		strncpy(ca_name, nctrl->opts->tcp_congestion,
+			TCP_CA_NAME_MAX-1);
+		optval = KERNEL_SOCKPTR(ca_name);
Quoted 8 lines

drivers/nvme/host/tcp.c static int nvme_tcp_alloc_queue(struct nvme_ctrl *nctrl, · line 1458

Quoted 3 lines
drivers/nvme/host/tcp.c +3 -0
+		ret = sock_common_setsockopt(queue->sock, IPPROTO_TCP,
+					     TCP_CONGESTION, optval,
+					     strlen(ca_name));    

This needs to use kernel_setsockopt. I also can see absolutely no need for the optval local variable, and I also don't really see why we need ca_name either - if we need to limit the length and terminate it (but why?) that can be done during option parsing.

Regards to the replacement of 'sock_common_setsockopt'.

Per the story of the deletion of 'kernel_setsockopt', users of this API should switch to small functions that implement setting a sockopt directly.

So I tried with 'tcp_set_congestion_control'.
But then I found this symbol is not exported yet. Then I applied ‘EXPORT_SYMBOL_GPL(tcp_set_congestion_control);’ in my local source, and it works well in the testing.

Then what should I do with this?

#5 lore raw
Quoted 6 lines · Mingbao Sun

So I tried with 'tcp_set_congestion_control'.
But then I found this symbol is not exported yet. Then I applied ‘EXPORT_SYMBOL_GPL(tcp_set_congestion_control);’ in my local source, and it works well in the testing.

Then what should I do with this?

Add the export in a separate, clearly documented, patch, and Cc the netdev list and maintainers to get their opinion on all list.

#6 lore raw
Quoted 10 lines · On Thu, 10 Mar 2022 09:19:08 +0100 Christoph Hellwig <[email protected]> wrote:
Quoted 6 lines · Mingbao Sun

So I tried with 'tcp_set_congestion_control'.
But then I found this symbol is not exported yet. Then I applied ‘EXPORT_SYMBOL_GPL(tcp_set_congestion_control);’ in my local source, and it works well in the testing.

Then what should I do with this?

Add the export in a separate, clearly documented, patch, and Cc the netdev list and maintainers to get their opinion on all list.

Got it.
Will do that soon.