splice: do not checksum AF_UNIX sockets
Subsystems (2)
PATCH 1/1 splice: do not checksum AF_UNIX sockets
When skb_splice_from_iter was introduced, it inadvertently added checksumming for AF_UNIX sockets. This resulted in significant slowdowns, as when using sendfile over unix sockets.
Using the test code [1] in my test setup (2G, single core x86_64 qemu), the client receives a 1000M file in:
- without the patch: 1577ms (+/- 36.1ms)
- with the patch: 725ms (+/- 28.3ms)
This commit skips addresses the issue by skipping checksumming when splice occurs a AF_UNIX socket.
[1] https://gist.github.com/deweerdt/a3ee2477d1d87524cf08618d3c179f06
--- net/core/skbuff.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
net/core/skbuff.c +1 -1
@@ -7233,7 +7233,7 @@ ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, goto out; } -if (skb->ip_summed ==CHECKSUM_NONE ) +if (skb->ip_summed ==CHECKSUM_NONE && skb->sk->sk_family !=AF_UNIX )skb_splice_csum_page (skb, page, off, part); off =0 ;
Signature · 1 line
2.44.1
Quoted 25 lines · Frederik Deweerdt
When
skb_splice_from_iterwas introduced, it inadvertently added checksumming forAF_UNIXsockets. This resulted in significant slowdowns, as when using sendfile over unix sockets.Using the test code [1] in my test setup (2G, single core
x86_64qemu), the client receives a 1000M file in:
- without the patch: 1577ms (+/- 36.1ms)
- with the patch: 725ms (+/- 28.3ms)This commit skips addresses the issue by skipping checksumming when splice occurs a
AF_UNIXsocket.[1] https://gist.github.com/deweerdt/a3ee2477d1d87524cf08618d3c179f06
Signed-off-by Frederik Deweerdt <[email protected]>Fixes 2e910b95329c ("net: Add a function to splice pages into an skbuff for MSG_SPLICE_PAGES")--- net/core/skbuff.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)net/core/skbuff.c +0
-0
net/core/skbuff.c ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, · line 7236
Quoted 5 lines
net/core/skbuff.c +1
-1@@ -7233,7 +7233,7 @@ ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, goto out; } -if (skb->ip_summed ==CHECKSUM_NONE ) +if (skb->ip_summed ==CHECKSUM_NONE && skb->sk->sk_family !=AF_UNIX )
Are you sure it is always safe to dereferene skb->sk here? I am not sure about the KCM socket case.
Instead of checking skb->sk->sk_family, why not just pass an additional boolean parameter to this function?
Thanks.
Quoted 29 lines · Cong Wang
Quoted 28 lines · Frederik Deweerdt
When
skb_splice_from_iterwas introduced, it inadvertently added checksumming forAF_UNIXsockets. This resulted in significant slowdowns, as when using sendfile over unix sockets.Using the test code [1] in my test setup (2G, single core
x86_64qemu), the client receives a 1000M file in:
- without the patch: 1577ms (+/- 36.1ms)
- with the patch: 725ms (+/- 28.3ms)This commit skips addresses the issue by skipping checksumming when splice occurs a
AF_UNIXsocket.[1] https://gist.github.com/deweerdt/a3ee2477d1d87524cf08618d3c179f06
Signed-off-by Frederik Deweerdt <[email protected]>Fixes 2e910b95329c ("net: Add a function to splice pages into an skbuff for MSG_SPLICE_PAGES")--- net/core/skbuff.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)net/core/skbuff.c +0
-0@@ -7233,7 +7233,7 @@ ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, goto out; }
Quoted 9 lines
net/core/skbuff.c ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, · line 7236
Quoted 2 lines
net/core/skbuff.c +1
-1-if (skb->ip_summed ==CHECKSUM_NONE ) +if (skb->ip_summed ==CHECKSUM_NONE && skb->sk->sk_family !=AF_UNIX )Are you sure it is always safe to dereferene
skb->skhere? I am not sure about the KCM socket case.Instead of checking
skb->sk->sk_family, why not just pass an additional boolean parameter to this function?
I saw that every caller was dereferrencing an sk, but you are right that that a boolean would be safer.
I'll resend an updated version.
Thanks,
Frederik
From: Cong Wang <[email protected]>
Quoted 31 lines
Sent: 30 November 2024 01:43
Quoted 28 lines · Frederik Deweerdt
When
skb_splice_from_iterwas introduced, it inadvertently added checksumming forAF_UNIXsockets. This resulted in significant slowdowns, as when using sendfile over unix sockets.Using the test code [1] in my test setup (2G, single core
x86_64qemu), the client receives a 1000M file in:
- without the patch: 1577ms (+/- 36.1ms)
- with the patch: 725ms (+/- 28.3ms)This commit skips addresses the issue by skipping checksumming when splice occurs a
AF_UNIXsocket.[1] https://gist.github.com/deweerdt/a3ee2477d1d87524cf08618d3c179f06
Signed-off-by Frederik Deweerdt <[email protected]>Fixes 2e910b95329c ("net: Add a function to splice pages into an skbuff for MSG_SPLICE_PAGES")--- net/core/skbuff.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)net/core/skbuff.c +0
-0@@ -7233,7 +7233,7 @@ ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, goto out; }
Quoted 8 lines
net/core/skbuff.c ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, · line 7236
Quoted 2 lines
net/core/skbuff.c +1
-1-if (skb->ip_summed ==CHECKSUM_NONE ) +if (skb->ip_summed ==CHECKSUM_NONE && skb->sk->sk_family !=AF_UNIX )Are you sure it is always safe to dereferene
skb->skhere? I am not sure about the KCM socket case.Instead of checking
skb->sk->sk_family, why not just pass an additional boolean parameter to this function?
A thought.
It is ever actually worth doing an 'early checksum' in software for either TCP or UDP?
Most modern ethernet hardware supports transmit checksum offload, so there is nothing to be gained by doing the checksum during a copy and everything to be lost because the copy is a lot slower.
I think the code always does a checksum when copying data in send() pretty much all the time it isn't needed.
The same is true for the delayed checksum of receive UDP. I'm not sure what the rational for that was (and Linus can't remember), my guess is a userspace NFS daemon.
But it seriously complicated the code.
David
-
Registered Address Lakeside, Bramley Road, Mount Farm, Milton Keynes, MK1 1PT, UK Registration No: 1397386 (Wales)
net/core/skbuff.c ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, · line 7237
Quoted 3 lines · Frederik Deweerdt
net/core/skbuff.c +1
-1-if (skb->ip_summed ==CHECKSUM_NONE ) +if (skb->ip_summed ==CHECKSUM_NONE && skb->sk->sk_family !=AF_UNIX )skb_splice_csum_page (skb, page, off, part);
Should AF_UNIX set some other CHECKSUM_* constant indicating that the checksum is unnecessary?
David
Quoted 9 lines · David Howells
net/core/skbuff.c ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, · line 7237
Quoted 3 lines · Frederik Deweerdt
net/core/skbuff.c +1
-1-if (skb->ip_summed ==CHECKSUM_NONE ) +if (skb->ip_summed ==CHECKSUM_NONE && skb->sk->sk_family !=AF_UNIX )skb_splice_csum_page (skb, page, off, part);Should
AF_UNIXset some other CHECKSUM_* constant indicating that the checksum is unnecessary?
It already means unnecessary on TX path:
* - %CHECKSUM_NONE
*
* The skb was already checksummed by the protocol, or a checksum is not
* required.
Thanks.
Quoted 11 lines · Cong Wang
Quoted 9 lines · David Howells
net/core/skbuff.c ssize_t skb_splice_from_iter(struct sk_buff *skb, struct iov_iter *iter, · line 7237
Quoted 3 lines · Frederik Deweerdt
net/core/skbuff.c +1
-1-if (skb->ip_summed ==CHECKSUM_NONE ) +if (skb->ip_summed ==CHECKSUM_NONE && skb->sk->sk_family !=AF_UNIX )skb_splice_csum_page (skb, page, off, part);Should
AF_UNIXset some other CHECKSUM_* constant indicating that the checksum is unnecessary?
Quoted 7 lines
It already means unnecessary on TX path:
* - %CHECKSUM_NONE
*
* The skb was already checksummed by the protocol, or a checksum is not
* required.
Looking back at the patch series that introduced the checksumming [1], it looks like ip_output.c::ip_append_page() was the only path doing checksumming, it had similar looking logic:
-
- if (skb->ip_summed == CHECKSUM_NONE) {
- __wsum csum;
- csum = csum_page(page, offset, len);
- skb->csum = csum_block_add(skb->csum, csum, skb->len);
- }
-
That code in turn has been like this since the git import. I'm not sure what that was for and how to test its intent.
Frederik
[1] https://patchwork.kernel.org/project/linux-mm/patch/[email protected]/