bpf, sockmap: fix return codes from tcp_bpf_recvmsg_parser()
Subsystems (5)
John Fastabend
maintainerPATCH 1/1 bpf, sockmap: fix return codes from tcp_bpf_recvmsg_parser()
Applications can be confused slightly because we do not always return the same error code as expected, e.g. what the TCP stack normally returns. For example on a sock err sk->sk_err instead of returning the sock_error we return EAGAIN. This usually means the application will 'try again' instead of aborting immediately. Another example, when a shutdown event is received we should immediately abort instead of waiting for data when the user provides a timeout.
These tend to not be fatal, applications usually recover, but introduces bogus errors to the user or introduces unexpected latency. Before 'c5d2177a72a16' we fell back to the TCP stack when no data was available so we managed to catch many of the cases here, although with the extra latency cost of calling tcp_msg_wait_data() first.
To fix lets duplicate the error handling in TCP stack into tcp_bpf so that we get the same error codes.
These were found in our CI tests that run applications against sockmap and do longer lived testing, at least compared to test_sockmap that does short-lived ping/pong tests, and in some of our test clusters we deploy.
Its non-trivial to do these in a shorter form CI tests that would be appropriate for BPF selftests, but we are looking into it so we can ensure this keeps working going forward. As a preview one idea is to pull in the packetdrill testing which catches some of this.
--- net/ipv4/tcp_bpf.c | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+)
net/ipv4/tcp_bpf.c +27 -0
@@ -196,12 +196,39 @@ static int tcp_bpf_recvmsg_parser(struct sock *sk,long timeo;int data; +if (sock_flag (sk,SOCK_DONE )) + goto out; + +if (sk->sk_err) { + copied =sock_error (sk); + goto out; + } + +if (sk->sk_shutdown &RCV_SHUTDOWN ) + goto out; + +if (sk->sk_state ==TCP_CLOSE ) { + copied = -ENOTCONN ; + goto out; + } + timeo =sock_rcvtimeo (sk, nonblock); +if (!timeo) { + copied = -EAGAIN ; + goto out; + } + +if (signal_pending (current)) { + copied =sock_intr_errno (timeo); + goto out; + } + data =tcp_msg_wait_data (sk, psock, timeo);if (data && !sk_psock_queue_empty (psock)) goto msg_bytes_ready; copied = -EAGAIN ; } +out:release_sock (sk);sk_psock_put (sk, psock);return copied;
Signature · 1 line
2.33.0
John Fastabend
maintainerQuoted 22 lines · John Fastabend
Applications can be confused slightly because we do not always return the same error code as expected, e.g. what the TCP stack normally returns. For example on a sock err
sk->sk_errinstead of returning thesock_errorwe return EAGAIN. This usually means the application will 'try again' instead of aborting immediately. Another example, when a shutdown event is received we should immediately abort instead of waiting for data when the user provides a timeout.These tend to not be fatal, applications usually recover, but introduces bogus errors to the user or introduces unexpected latency. Before '
c5d2177a72a16' we fell back to the TCP stack when no data was available so we managed to catch many of the cases here, although with the extra latency cost of callingtcp_msg_wait_data()first.To fix lets duplicate the error handling in TCP stack into
tcp_bpfso that we get the same error codes.These were found in our CI tests that run applications against sockmap and do longer lived testing, at least compared to
test_sockmapthat does short-lived ping/pong tests, and in some of our test clusters we deploy.
Quoted 8 lines
Its non-trivial to do these in a shorter form CI tests that would be appropriate for BPF selftests, but we are looking into it so we can ensure this keeps working going forward. As a preview one idea is to pull in the packetdrill testing which catches some of this.
Fixes c5d2177a72a16 ("bpf, sockmap: Fix race in ingress receive verdict with redirect to self")Signed-off-by John Fastabend <[email protected]>---
Forgot to add a note, I marked this for bpf-next given we are in rc8. It is a fix though, but assume we only want critical things at this point. Anyways it applies against bpf and bpf-next so can be applied in either place.
Thanks,
John
This patch was applied to bpf/bpf-next.git (master) by Daniel Borkmann <[email protected]>:
Hello:
This patch was applied to bpf/bpf-next.git (master) by Daniel Borkmann <[email protected]>:
Quoted 9 lines · On Tue, 4 Jan 2022 12:59:18 -0800 you wrote:
Applications can be confused slightly because we do not always return the same error code as expected, e.g. what the TCP stack normally returns. For example on a sock err
sk->sk_errinstead of returning thesock_errorwe return EAGAIN. This usually means the application will 'try again' instead of aborting immediately. Another example, when a shutdown event is received we should immediately abort instead of waiting for data when the user provides a timeout.[...]
Here is the summary with links:
- [bpf-next] bpf, sockmap: fix return codes from tcp_bpf_recvmsg_parser()
https://git.kernel.org/bpf/bpf-next/c/5b2c5540b811
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html