Make TCP_MD5 adopt the extra-option framework
Subsystems (5)
Christoph Paasch
cover Make TCP_MD5 adopt the extra-option framework
Tried to split it in several patches.
Here is the overview:
Patch 1 to 5: Solely TCP-level changes to prepare the stack. Mostly cosmetic,
besides #1 and #5. #1 should be ok, #5 is a bit more fundamental change but I think it's still ok.
Patch 6 to 11: Mat's patch, together with some more changes to it. My changes
should be merged into Mat's patch, but I let them out for now so that it's clear what I had to change.
Patch 12 to 14: Changes to TCP_MD5 to enable it to opt-in to the framework.
Should be all fairly straight-forward.
Patch 15: Here, I move all TCP_MD5-code to its own file.
Patch 16: I should probably move this to the patchset 12 to 14. Patch 17: Here, I start using the framework
Patch 18: Cleanup thanks to the use of the framework.
In particular, patch 18 shows how the framework allows to cleanup TCP from TCP_MD5-changes.
Some comments about the extra-option framework:
1) As already discussed, it would be good to have the callbacks on a per-socket basis. Basically, I think the list should be in tcp_sock where this list would simply be a list of structs:
struct tcp_extra_option {
struct list_head teo_list;
struct tcp_extra_options_opts *teo_ops;
};Users of this framework would allocate these elements like this (e.g., TCP_MD5):
struct tcp_md5_extra_option {
struct tcp_extra_option tcp_md5_eo;
struct tcp_md5sig_info __rcu *md5sig_info;
};This allows MD5 to store its state info inside there. We could nicely fit MPTCP into this.
2)
I chose to leave the extra_options at the end of tcp_syn_options.
This however means that we have to undo what TCP timestamps did in tcp_syn_options. Unsetting the flags is easy, but the nasty part is with:
+ /* Don't use TCP timestamps with TCP_MD5 */
+ if (opts->options & OPTION_TS)
+ ret -= TCPOLEN_TSTAMP_ALIGNED;
Yes, this is ugly. But, the only way from what I see if we want to fully remove TCP_MD5 out of TCP.
3) With request_socks now being full socks, the prepare and prepare_req callbacks could be merged.
4) We also need this framwork for time_wait_socks. So, in general, we could have the callback list in struct sock_common as well, that way tcp_sock, tcp_time_wait_sock and request_socks get it.
This implies that we need to initialize this in tcp_time_wait() and destroy it in tcp_twsk_destructor. That would allow to remove even more MD5-code out of TCP.
I can work on these changes to the extra-option framework.
Any thoughts? :)
Christoph Paasch (17):
tcp: Write options after the header has been fully done
tcp: Pass sock to tcp_options_write instead of tcp_sock
tcp: Pass skb in tcp_options_write
tcp: Pass sock to tcp_synack_options
tcp6: Prepare for maximum TCP option-space
tcp_extra_option: add_header callback for TCP extra options
tcp_extra_option: Add missing static branch for
tcp_extra_options_prepare
tcp_extra_option: Use sock instead of tcp_sock in
tcp_extra_options_parse/prepare/write
tcp_extra_option: Pass skb to tcp_extra_options_write
tcp_extra_option: Pass sock to prepare_req
tcp_md5: Detect key inside tcp_v4_send_ack instead of passing it as an
argument
tcp_md5: Detect key inside tcp_v6_send_response instead of passing it
as an argument
tcp_md5: Check for TCP_MD5 after TCP Timestamps in
tcp_established_options
tcp: Move TCP-MD5 code out of TCP itself
tcp_md5: Don't pass along md5-key
tcp_md5: Use tcp_extra_options in output path
tcp_md5: Cleanup TCP-code
Mat Martineau (1):
tcp: Register handlers for extra TCP options
drivers/infiniband/hw/cxgb4/cm.c | 2 +- include/linux/inet_diag.h | 1 + include/linux/tcp.h | 19 +- include/linux/tcp_md5.h | 109 ++++ include/net/tcp.h | 157 ++--- net/ipv4/Makefile | 1 + net/ipv4/syncookies.c | 2 +- net/ipv4/tcp.c | 219 +++---- net/ipv4/tcp_diag.c | 81 +-- net/ipv4/tcp_input.c | 54 +- net/ipv4/tcp_ipv4.c | 496 +--------------- net/ipv4/tcp_md5.c | 1169 ++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_minisocks.c | 35 +- net/ipv4/tcp_output.c | 139 ++--- net/ipv6/syncookies.c | 2 +- net/ipv6/tcp_ipv6.c | 352 +----------- 16 files changed, 1560 insertions(+), 1278 deletions(-) create mode 100644 include/linux/tcp_md5.h create mode 100644 net/ipv4/tcp_md5.c
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 1/18 tcp: Write options after the header has been fully done
This is needed later on for TCP_MD5, as we need the complete TCP-header to compute the TCP_MD5-hash.
--- net/ipv4/tcp_output.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
net/ipv4/tcp_output.c +2 -2
@@ -1073,7 +1073,6 @@ static int tcp_transmit_skb(struct sock *sk, struct sk_buff *skb, int clone_it, } } -tcp_options_write ((__be32 *)(th +1 ), tp, &opts);skb_shinfo (skb)->gso_type = sk->sk_gso_type;if (likely (!(tcb->tcp_flags &TCPHDR_SYN ))) { th->window =htons (tcp_select_window (sk));
@@ -1084,6 +1083,7 @@ static int tcp_transmit_skb(struct sock *sk, struct sk_buff *skb, int clone_it,*/ th->window =htons (min (tp->rcv_wnd,65535U )); } +tcp_options_write ((__be32 *)(th +1 ), tp, &opts);#ifdef CONFIG_TCP_MD5SIG /* Calculate the MD5 hash, as we have all we need now */ if (md5) {
@@ -3187,8 +3187,8 @@ struct sk_buff *tcp_make_synack(const struct sock *sk, struct dst_entry *dst,/* RFC1323: The window in SYN & SYN/ACK segments is never scaled. */ th->window =htons (min (req->rsk_rcv_wnd,65535U )); -tcp_options_write ((__be32 *)(th +1 ),NULL , &opts); th->doff = (tcp_header_size >>2 ); +tcp_options_write ((__be32 *)(th +1 ),NULL , &opts);__TCP_INC_STATS (sock_net (sk),TCP_MIB_OUTSEGS );#ifdef CONFIG_TCP_MD5SIG
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 2/18 tcp: Pass sock to tcp_options_write instead of tcp_sock
In reply to Christoph PaaschBecause, to write the extra-options, we need also the request-socket to properly write the correct info.
--- net/ipv4/tcp_output.c | 10 +++++++--- 1 file changed, 7 insertions(+), 3 deletions(-)
net/ipv4/tcp_output.c +7 -3
@@ -443,10 +443,14 @@ struct tcp_out_options {* At least SACK_PERM as the first option is known to lead to a disaster * (but it may well be that other scenarios fail similarly). */ -static void tcp_options_write (__be32 *ptr,struct tcp_sock *tp, +static void tcp_options_write (__be32 *ptr,struct sock *sk,struct tcp_out_options *opts) {u16 options = opts->options;/* mungable copy */ +struct tcp_sock *tp =NULL ; + +if (sk_fullsock (sk)) + tp =tcp_sk (sk);if (unlikely (OPTION_MD5 & options)) { *ptr++ = htonl((TCPOPT_NOP << 24) | (TCPOPT_NOP << 16) |
@@ -1083,7 +1087,7 @@ static int tcp_transmit_skb(struct sock *sk, struct sk_buff *skb, int clone_it,*/ th->window =htons (min (tp->rcv_wnd,65535U )); } -tcp_options_write ((__be32 *)(th +1 ), tp, &opts); +tcp_options_write ((__be32 *)(th +1 ), sk, &opts);#ifdef CONFIG_TCP_MD5SIG /* Calculate the MD5 hash, as we have all we need now */ if (md5) {
@@ -3188,7 +3192,7 @@ struct sk_buff *tcp_make_synack(const struct sock *sk, struct dst_entry *dst,/* RFC1323: The window in SYN & SYN/ACK segments is never scaled. */ th->window =htons (min (req->rsk_rcv_wnd,65535U )); th->doff = (tcp_header_size >>2 ); -tcp_options_write ((__be32 *)(th +1 ),NULL , &opts); +tcp_options_write ((__be32 *)(th +1 ),req_to_sk (req), &opts);__TCP_INC_STATS (sock_net (sk),TCP_MIB_OUTSEGS );#ifdef CONFIG_TCP_MD5SIG
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 3/18 tcp: Pass skb in tcp_options_write
In reply to Christoph PaaschWe will need it to allow TCP_MD5 to compute the hash.
--- net/ipv4/tcp_output.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
net/ipv4/tcp_output.c +3 -3
@@ -443,7 +443,7 @@ struct tcp_out_options {* At least SACK_PERM as the first option is known to lead to a disaster * (but it may well be that other scenarios fail similarly). */ -static void tcp_options_write (__be32 *ptr,struct sock *sk, +static void tcp_options_write (__be32 *ptr,struct sk_buff *skb,struct sock *sk,struct tcp_out_options *opts) {u16 options = opts->options;/* mungable copy */
@@ -1087,7 +1087,7 @@ static int tcp_transmit_skb(struct sock *sk, struct sk_buff *skb, int clone_it,*/ th->window =htons (min (tp->rcv_wnd,65535U )); } -tcp_options_write ((__be32 *)(th +1 ), sk, &opts); +tcp_options_write ((__be32 *)(th +1 ), skb, sk, &opts);#ifdef CONFIG_TCP_MD5SIG /* Calculate the MD5 hash, as we have all we need now */ if (md5) {
@@ -3192,7 +3192,7 @@ struct sk_buff *tcp_make_synack(const struct sock *sk, struct dst_entry *dst,/* RFC1323: The window in SYN & SYN/ACK segments is never scaled. */ th->window =htons (min (req->rsk_rcv_wnd,65535U )); th->doff = (tcp_header_size >>2 ); -tcp_options_write ((__be32 *)(th +1 ),req_to_sk (req), &opts); +tcp_options_write ((__be32 *)(th +1 ), skb,req_to_sk (req), &opts);__TCP_INC_STATS (sock_net (sk),TCP_MIB_OUTSEGS );#ifdef CONFIG_TCP_MD5SIG
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 4/18 tcp: Pass sock to tcp_synack_options
In reply to Christoph PaaschWill be needed by TCP_MD5
--- net/ipv4/tcp_output.c | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
net/ipv4/tcp_output.c +3 -2
@@ -611,7 +611,8 @@ static unsigned int tcp_syn_options(struct sock *sk, struct sk_buff *skb, }/* Set up TCP options for SYN-ACKs. */ -static unsigned int tcp_synack_options(struct request_sock *req, +static unsigned int tcp_synack_options(const struct sock *sk, + struct request_sock *req, unsigned int mss, struct sk_buff *skb, struct tcp_out_options *opts, const struct tcp_md5sig_key *md5,
@@ -3165,7 +3166,7 @@ struct sk_buff *tcp_make_synack(const struct sock *sk, struct dst_entry *dst, md5 =tcp_rsk (req)->af_specific->req_md5_lookup (sk,req_to_sk (req));#endif skb_set_hash (skb,tcp_rsk (req)->txhash,PKT_HASH_TYPE_L4 ); - tcp_header_size =tcp_synack_options (req, mss, skb, &opts, md5, foc) + + tcp_header_size =tcp_synack_options (sk, req, mss, skb, &opts, md5, foc) +sizeof (*th);skb_push (skb, tcp_header_size);
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 5/18 tcp6: Prepare for maximum TCP option-space
In reply to Christoph PaaschWith a generic TCP-option framework we don't know in advance how much space will be used. So, estimate the worst and allocate the maximum. Later on, we pull skb->tail back in again.
--- net/ipv6/tcp_ipv6.c | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-)
net/ipv6/tcp_ipv6.c +8 -8
@@ -784,17 +784,11 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct flowi6 fl6;struct net *net = sk ?sock_net (sk) :dev_net (skb_dst (skb)->dev);struct sock *ctl_sk = net->ipv6.tcp_sk; -unsigned int tot_len =sizeof (struct tcphdr ); +unsigned int tot_len =sizeof (struct tcphdr ) +MAX_TCP_OPTION_SPACE ; +unsigned int reduce =0 ;/* By how much to pull skb->tail back in? */ struct dst_entry *dst;__be32 *topt; -if (tsecr) - tot_len +=TCPOLEN_TSTAMP_ALIGNED ; -#ifdef CONFIG_TCP_MD5SIG -if (key) - tot_len +=TCPOLEN_MD5SIG_ALIGNED ; -#endif - buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)
@@ -823,6 +817,8 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 (TCPOPT_TIMESTAMP << 8) | TCPOLEN_TIMESTAMP); *topt++ =htonl (tsval); *topt++ =htonl (tsecr); + + reduce +=TCPOLEN_TSTAMP_ALIGNED ; }#ifdef CONFIG_TCP_MD5SIG
@@ -832,9 +828,13 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32tcp_v6_md5_hash_hdr ((__u8 *)topt, key, &ipv6_hdr (skb)->saddr, &ipv6_hdr (skb)->daddr, t1); + + reduce += TCPOLEN_MD5SIG_ALIGNED; }#endif + buff->tail -= reduce; +memset (&fl6,0 ,sizeof (fl6)); fl6.daddr =ipv6_hdr (skb)->saddr; fl6.saddr =ipv6_hdr (skb)->daddr;
Signature · 1 line
2.14.1
Mat Martineau
Re: [MPTCP] [PATCH 05/18] tcp6: Prepare for maximum TCP option-space
Quoted 3 lines · Christoph Paasch
With a generic TCP-option framework we don't know in advance how much space will be used. So, estimate the worst and allocate the maximum. Later on, we pull
skb->tailback in again.
v2 of the option registration patch will conflict with this. The prepare callback does figure out the number of option bytes required before writing to the outgoing skb, so that can happen before the alloc_skb().
Mat
Quoted 57 lines
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
net/ipv6/tcp_ipv6.c| 16 ++++++++--------1 file changed, 8 insertions(+), 8 deletions(-)net/ipv6/tcp_ipv6.c +8
-8@@ -784,17 +784,11 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct flowi6 fl6;struct net *net = sk ?sock_net (sk) :dev_net (skb_dst (skb)->dev);struct sock *ctl_sk = net->ipv6.tcp_sk; -unsigned int tot_len =sizeof (struct tcphdr ); +unsigned int tot_len =sizeof (struct tcphdr ) +MAX_TCP_OPTION_SPACE ; +unsigned int reduce =0 ;/* By how much to pull skb->tail back in? */ struct dst_entry *dst;__be32 *topt; -if (tsecr) - tot_len +=TCPOLEN_TSTAMP_ALIGNED ; -#ifdef CONFIG_TCP_MD5SIG -if (key) - tot_len +=TCPOLEN_MD5SIG_ALIGNED ; -#endif - buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -823,6 +817,8 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 (TCPOPT_TIMESTAMP << 8) | TCPOLEN_TIMESTAMP); *topt++ =htonl (tsval); *topt++ =htonl (tsecr); + + reduce +=TCPOLEN_TSTAMP_ALIGNED ; }#ifdef CONFIG_TCP_MD5SIG @@ -832,9 +828,13 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32tcp_v6_md5_hash_hdr ((__u8 *)topt, key, &ipv6_hdr (skb)->saddr, &ipv6_hdr (skb)->daddr, t1); + + reduce += TCPOLEN_MD5SIG_ALIGNED; }#endif + buff->tail -= reduce; +memset (&fl6,0 ,sizeof (fl6)); fl6.daddr =ipv6_hdr (skb)->saddr; fl6.saddr =ipv6_hdr (skb)->daddr;Signature · 1 line
2.14.1
--
Mat Martineau
Intel OTC
Christoph Paasch
Re: [MPTCP] [PATCH 05/18] tcp6: Prepare for maximum TCP option-space
Quoted 10 lines · Mat Martineau
Quoted 3 lines · Christoph Paasch
With a generic TCP-option framework we don't know in advance how much space will be used. So, estimate the worst and allocate the maximum. Later on, we pull
skb->tailback in again.v2 of the option registration patch will conflict with this. The prepare callback does figure out the number of option bytes required before writing to the outgoing skb, so that can happen before the
alloc_skb().
No worries, I will take care of the conflicts.
Will be working on a v2 of my patchset to handle the incoming data path as well.
Christoph
Quoted 66 lines
Mat
Quoted 57 lines
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
net/ipv6/tcp_ipv6.c| 16 ++++++++--------1 file changed, 8 insertions(+), 8 deletions(-)net/ipv6/tcp_ipv6.c +8
-8@@ -784,17 +784,11 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct flowi6 fl6;struct net *net = sk ?sock_net (sk) :dev_net (skb_dst (skb)->dev);struct sock *ctl_sk = net->ipv6.tcp_sk; -unsigned int tot_len =sizeof (struct tcphdr ); +unsigned int tot_len =sizeof (struct tcphdr ) +MAX_TCP_OPTION_SPACE ; +unsigned int reduce =0 ;/* By how much to pull skb->tail back in? */ struct dst_entry *dst;__be32 *topt; -if (tsecr) - tot_len +=TCPOLEN_TSTAMP_ALIGNED ; -#ifdef CONFIG_TCP_MD5SIG -if (key) - tot_len +=TCPOLEN_MD5SIG_ALIGNED ; -#endif - buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -823,6 +817,8 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 (TCPOPT_TIMESTAMP << 8) | TCPOLEN_TIMESTAMP); *topt++ =htonl (tsval); *topt++ =htonl (tsecr); + + reduce +=TCPOLEN_TSTAMP_ALIGNED ; }#ifdef CONFIG_TCP_MD5SIG @@ -832,9 +828,13 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32tcp_v6_md5_hash_hdr ((__u8 *)topt, key, &ipv6_hdr (skb)->saddr, &ipv6_hdr (skb)->daddr, t1); + + reduce += TCPOLEN_MD5SIG_ALIGNED; }#endif + buff->tail -= reduce; +memset (&fl6,0 ,sizeof (fl6)); fl6.daddr =ipv6_hdr (skb)->saddr; fl6.saddr =ipv6_hdr (skb)->daddr;Signature · 1 line
2.14.1--
Mat Martineau
Intel OTC
Christoph Paasch
PATCH 6/18 tcp: Register handlers for extra TCP options
In reply to Christoph PaaschFrom: Mat Martineau <mathew.j.martineau(a)linux.intel.com>
Allow additional TCP options to be handled by registered hook functions.
Option parsing will call the provided 'parse' function when a TCP option number is not recognized by the normal option parsing code.
The 'prepare' and 'prepare_req' functions determine the required space for registered options and store associated data. There are two variants because options must be generated for connections that are associated with either tcp_sock or request_sock structures.
A static key and RCU synchronization are used to minimize the performance impact of these extensible TCP features.
Before this is posted upstream, I plan to split the patch in two parts (at least), since making tcp_out_options public should be separate. The extra parameter for tcp_parse_options may also warrant its own patch. I'd also like to discuss where to store information for the options that are parsed or generated using these hooks, since the tcp_options_received and tcp_out_options structs don't have places to store extra information yet.
I've confirmed that this code builds, but haven't tested yet.
This commit is also available at
https://git.kernel.org/pub/scm/linux/kernel/git/martineau/linux.git
branch: mptcp
--- drivers/infiniband/hw/cxgb4/cm.c | 2 +- include/linux/tcp.h | 17 +++++ include/net/tcp.h | 49 ++++++++++++++- net/ipv4/syncookies.c | 2 +- net/ipv4/tcp.c | 133 +++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_input.c | 15 +++-- net/ipv4/tcp_minisocks.c | 4 +- net/ipv4/tcp_output.c | 35 ++++++----- net/ipv6/syncookies.c | 2 +- 9 files changed, 231 insertions(+), 28 deletions(-)
drivers/infiniband/hw/cxgb4/cm.c +1 -1
@@ -3752,7 +3752,7 @@ static void build_cpl_pass_accept_req(struct sk_buff *skb, int stid , u8 tos)*/ memset (&tmp_opt,0 ,sizeof (tmp_opt));tcp_clear_options (&tmp_opt); -tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ,NULL ); req =__skb_push (skb,sizeof (*req));memset (req,0 ,sizeof (*req));
include/linux/tcp.h +17 -0
@@ -112,6 +112,23 @@ static inline void tcp_clear_options(struct tcp_options_received *rx_opt) rx_opt->wscale_ok = rx_opt->snd_wscale =0 ; } +#define OPTION_SACK_ADVERTISE (1 << 0) +#define OPTION_TS (1 << 1) +#define OPTION_MD5 (1 << 2) +#define OPTION_WSCALE (1 << 3) +#define OPTION_FAST_OPEN_COOKIE (1 << 8) + +struct tcp_out_options { +u16 options;/* bit field of OPTION_* */ +u16 mss;/* 0 to disable */ +u8 ws;/* window scale, 0 to disable */ +u8 num_sack_blocks;/* number of SACK blocks to include */ +u8 hash_size;/* bytes in hash_location */ +__u8 *hash_location;/* temporary pointer, overloaded */ +__u32 tsval, tsecr;/* need to include OPTION_TS */ +struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ +}; +/* This is the max number of SACKS that we'll generate and process. It's safe * to increase this, although since: * size = TCPOLEN_SACK_BASE_ALIGNED (4) + n * TCPOLEN_SACK_PERBLOCK (8)
include/net/tcp.h +48 -1
59 lines not on this page · raw message
net/ipv4/syncookies.c +1 -1
@@ -313,7 +313,7 @@ struct sock *cookie_v4_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcp_ts_off(sock_net(sk),
net/ipv4/tcp.c +133 -0
157 lines not on this page · raw message
net/ipv4/tcp_input.c +10 -5
@@ -3726,7 +3726,7 @@ static void tcp_parse_fastopen_option(int len, const unsigned char *cookie,void tcp_parse_options (const struct net *net,const struct sk_buff *skb,struct tcp_options_received *opt_rx,int estab, -struct tcp_fastopen_cookie *foc) +struct tcp_fastopen_cookie *foc,struct tcp_sock *tp) {const unsigned char *ptr;const struct tcphdr *th =tcp_hdr (skb);
@@ -3828,6 +3828,11 @@ void tcp_parse_options(const struct net *net, ptr + 2, th->syn, foc, true);break ; +default : +tcp_extra_options_parse (opcode, opsize, ptr, + skb, opt_rx, tp); +break ; + } ptr += opsize-2 ; length -= opsize;
@@ -3874,7 +3879,7 @@ static bool tcp_fast_parse_options(const struct net *net,return true; } -tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL ); +tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL , tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;
@@ -5550,7 +5555,7 @@ static bool tcp_rcv_fastopen_synack(struct sock *sk, struct sk_buff *synack,/* Get original SYNACK MSS value if user MSS sets mss_clamp */ tcp_clear_options (&opt); opt.user_mss = opt.mss_clamp =0 ; -tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL , tp); mss = opt.mss_clamp; }
@@ -5604,7 +5609,7 @@ static int tcp_rcv_synsent_state_process(struct sock *sk, struct sk_buff *skb,int saved_clamp = tp->rx_opt.mss_clamp;bool fastopen_fail; -tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc); +tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc, tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;
@@ -6280,7 +6285,7 @@ int tcp_conn_request(struct request_sock_ops *rsk_ops, tmp_opt.mss_clamp = af_ops->mss_clamp; tmp_opt.user_mss = tp->rx_opt.user_mss;tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 , - want_cookie ?NULL : &foc); + want_cookie ?NULL : &foc, tp);if (want_cookie && !tmp_opt.saw_tstamp)tcp_clear_options (&tmp_opt);
net/ipv4/tcp_minisocks.c +2 -2
@@ -98,7 +98,7 @@ tcp_timewait_state_process(struct inet_timewait_sock *tw, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (*th) >>2 ) && tcptw->tw_ts_recent_stamp) { -tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) {if (tmp_opt.rcv_tsecr)
@@ -565,7 +565,7 @@ struct sock *tcp_check_req(struct sock *sk, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (struct tcphdr )>>2 )) { -tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) { tmp_opt.ts_recent = req->ts_recent;
net/ipv4/tcp_output.c +18 -17
@@ -41,6 +41,7 @@#include <linux/compiler.h> #include <linux/gfp.h> #include <linux/module.h> +#include <linux/static_key.h> /* People can turn this off for buggy TCP's found in printers etc. */ int sysctl_tcp_retrans_collapse__read_mostly =1 ;
@@ -413,23 +414,6 @@ static inline bool tcp_urg_mode(const struct tcp_sock *tp)return tp->snd_una != tp->snd_up; } -#define OPTION_SACK_ADVERTISE (1 << 0) -#define OPTION_TS (1 << 1) -#define OPTION_MD5 (1 << 2) -#define OPTION_WSCALE (1 << 3) -#define OPTION_FAST_OPEN_COOKIE (1 << 8) - -struct tcp_out_options { -u16 options;/* bit field of OPTION_* */ -u16 mss;/* 0 to disable */ -u8 ws;/* window scale, 0 to disable */ -u8 num_sack_blocks;/* number of SACK blocks to include */ -u8 hash_size;/* bytes in hash_location */ -__u8 *hash_location;/* temporary pointer, overloaded */ -__u32 tsval, tsecr;/* need to include OPTION_TS */ -struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ -}; -/* Write previously computed TCP options to the packet. * * Beware: Something in the Internet is very sensitive to the ordering of
@@ -540,6 +524,9 @@ static void tcp_options_write(__be32 *ptr, struct sk_buff *skb, struct sock *sk, } ptr += (len +3 ) >>2 ; } + +if (static_branch_unlikely (&tcp_extra_options_enabled)) +tcp_extra_options_write (ptr, opts, tp); }/* Compute TCP options for SYN packets. This is not the final
@@ -607,6 +594,10 @@ static unsigned int tcp_syn_options(struct sock *sk, struct sk_buff *skb, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare (skb,TCPHDR_SYN , + remaining, opts, tp); +return MAX_TCP_OPTION_SPACE - remaining; }
@@ -668,6 +659,13 @@ static unsigned int tcp_synack_options(const struct sock *sk, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare_req (skb, +TCPHDR_SYN | +TCPHDR_ACK , + remaining, opts, + req); +return MAX_TCP_OPTION_SPACE - remaining; }
@@ -701,6 +699,9 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skb size +=TCPOLEN_TSTAMP_ALIGNED ; } + size +=tcp_extra_options_prepare (skb,0 ,MAX_TCP_OPTION_SPACE - size, + opts, tp); + eff_sacks = tp->rx_opt.num_sacks + tp->rx_opt.dsack;if (unlikely (eff_sacks)) {const unsigned int remaining =MAX_TCP_OPTION_SPACE - size;
net/ipv6/syncookies.c +1 -1
@@ -162,7 +162,7 @@ struct sock *cookie_v6_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcpv6_ts_off(sock_net(sk),
Signature · 1 line
2.14.1
Mat Martineau
Re: [MPTCP] [PATCH 06/18] tcp: Register handlers for extra TCP options
Quoted 5 lines · Christoph Paasch
From: Mat Martineau <mathew.j.martineau(a)linux.intel.com>
Allow additional TCP options to be handled by registered hook functions.
Quoted 7 lines
Option parsing will call the provided 'parse' function when a TCP option number is not recognized by the normal option parsing code.
The 'prepare' and '
prepare_req' functions determine the required space for registered options and store associated data. There are two variants because options must be generated for connections that are associated with eithertcp_sockorrequest_sockstructures.
I have a newer version of this patch where there's a single prepare callback that takes a struct sock *, so I'll send that out.
Mat
Quoted 496 lines
A static key and RCU synchronization are used to minimize the performance impact of these extensible TCP features.
Before this is posted upstream, I plan to split the patch in two parts (at least), since making
tcp_out_optionspublic should be separate. The extra parameter fortcp_parse_optionsmay also warrant its own patch. I'd also like to discuss where to store information for the options that are parsed or generated using these hooks, since thetcp_options_receivedandtcp_out_optionsstructs don't have places to store extra information yet.I've confirmed that this code builds, but haven't tested yet.
This commit is also available at
https://git.kernel.org/pub/scm/linux/kernel/git/martineau/linux.git
branch: mptcpSigned-off-by Mat Martineau <mathew.j.martineau(a)linux.intel.com>---
drivers/infiniband/hw/cxgb4/cm.c | 2 +- include/linux/tcp.h | 17 +++++ include/net/tcp.h | 49 ++++++++++++++- net/ipv4/syncookies.c | 2 +- net/ipv4/tcp.c | 133 +++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_input.c | 15 +++-- net/ipv4/tcp_minisocks.c | 4 +- net/ipv4/tcp_output.c | 35 ++++++----- net/ipv6/syncookies.c | 2 +- 9 files changed, 231 insertions(+), 28 deletions(-)drivers/infiniband/hw/cxgb4/cm.c +1
-1@@ -3752,7 +3752,7 @@ static void build_cpl_pass_accept_req(struct sk_buff *skb, int stid , u8 tos)*/ memset (&tmp_opt,0 ,sizeof (tmp_opt));tcp_clear_options (&tmp_opt); -tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ,NULL ); req =__skb_push (skb,sizeof (*req));memset (req,0 ,sizeof (*req));include/linux/tcp.h +17
-0@@ -112,6 +112,23 @@ static inline void tcp_clear_options(struct tcp_options_received *rx_opt) rx_opt->wscale_ok = rx_opt->snd_wscale =0 ; } +#define OPTION_SACK_ADVERTISE (1 << 0) +#define OPTION_TS (1 << 1) +#define OPTION_MD5 (1 << 2) +#define OPTION_WSCALE (1 << 3) +#define OPTION_FAST_OPEN_COOKIE (1 << 8) + +struct tcp_out_options { +u16 options;/* bit field of OPTION_* */ +u16 mss;/* 0 to disable */ +u8 ws;/* window scale, 0 to disable */ +u8 num_sack_blocks;/* number of SACK blocks to include */ +u8 hash_size;/* bytes in hash_location */ +__u8 *hash_location;/* temporary pointer, overloaded */ +__u32 tsval, tsecr;/* need to include OPTION_TS */ +struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ +}; +/* This is the max number of SACKS that we'll generate and process. It's safe * to increase this, although since: * size = TCPOLEN_SACK_BASE_ALIGNED (4) + n * TCPOLEN_SACK_PERBLOCK (8) include/net/tcp.h +48
-1@@ -433,7 +433,8 @@ int tcp_recvmsg(struct sock *sk, struct msghdr *msg, size_t len, int nonblock, int flags, int *addr_len);void tcp_parse_options (const struct net *net,const struct sk_buff *skb,struct tcp_options_received *opt_rx, -int estab,struct tcp_fastopen_cookie *foc); +int estab,struct tcp_fastopen_cookie *foc, +struct tcp_sock *tp);const u8 *tcp_parse_md5sig_option (const struct tcphdr *th);/* @@ -2103,4 +2104,50 @@ static inline bool tcp_bpf_ca_needs_ecn(struct sock *sk) {return (tcp_call_bpf (sk,BPF_SOCK_OPS_NEEDS_ECN ) ==1 ); } + +extern struct static_key_false tcp_extra_options_enabled; + +struct tcp_extra_option_ops { +struct list_head list; +unsigned char option_kind; +void (*parse)(int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp); +/* Return the number of bytes consumed */ +unsigned int (*prepare)(struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp); +/* Return the number of bytes consumed */ +unsigned int (*prepare_req)(struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req); +void (*write)(__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp); +struct module *owner; +}; + +void tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp); + +unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp); + +unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req); + +void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp); + +int tcp_register_extra_option (struct tcp_extra_option_ops *ops); +void tcp_unregister_extra_option (struct tcp_extra_option_ops *ops); +#endif /* _TCP_H */ net/ipv4/syncookies.c +1
-1@@ -313,7 +313,7 @@ struct sock *cookie_v4_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcp_ts_off(sock_net(sk),net/ipv4/tcp.c +133
-0@@ -270,6 +270,7 @@#include <linux/time.h> #include <linux/slab.h> #include <linux/errqueue.h> +#include <linux/static_key.h> #include <net/icmp.h> #include <net/inet_common.h> @@ -306,6 +307,11 @@ EXPORT_SYMBOL(tcp_memory_allocated);struct percpu_counter tcp_sockets_allocated;EXPORT_SYMBOL (tcp_sockets_allocated); +/* Optional TCP option handlers */ +static DEFINE_SPINLOCK (tcp_option_list_lock); +static LIST_HEAD (tcp_option_list); +DEFINE_STATIC_KEY_FALSE (tcp_extra_options_enabled); +/* * TCP splice context */ @@ -3375,6 +3381,132 @@ EXPORT_SYMBOL(tcp_md5_hash_key);#endif +/* Linear search, few entries are expected. The RCU read lock must +* be held before calling. +*/ +static struct tcp_extra_option_ops *tcp_extra_options_find_kind (unsigned char kind) +{ +struct tcp_extra_option_ops *entry; + +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (entry->option_kind == kind) +return entry; + } + +return NULL ; +} + +void tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; + +rcu_read_lock (); + entry =tcp_extra_options_find_kind (opcode); +if (entry && entry->parse) + entry->parse (opsize, opptr, skb, opt_rx, tp); +rcu_read_unlock (); +} + +unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; +unsigned int used =0 ; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->prepare)) +continue ; + + used += entry->prepare (skb, flags, remaining - used, opts, tp); + } +rcu_read_unlock (); + +return used; +} + +unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req) +{ +struct tcp_extra_option_ops *entry; +unsigned int used =0 ; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->prepare_req)) +continue ; + + used += entry->prepare_req (skb, flags, remaining - used, opts, + req); + } +rcu_read_unlock (); + +return used; +} + +void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->write)) +continue ; + + entry->write (ptr, opts, tp); + } +rcu_read_unlock (); +} + +int tcp_register_extra_option (struct tcp_extra_option_ops *ops) +{ +int ret =0 ; + +if (!ops->option_kind) +return -EINVAL ; + +if (!try_module_get (ops->owner)) +return -ENOENT ; + +spin_lock (&tcp_option_list_lock); +if (tcp_extra_options_find_kind (ops->option_kind)) { +pr_notice ("Option kind %u already registered\n" , + ops->option_kind); +spin_unlock (&tcp_option_list_lock); +module_put (ops->owner); +return -EEXIST ; + } + +list_add_tail_rcu (&ops->list, &tcp_option_list); +pr_debug ("Option kind %u registered\n" , ops->option_kind); +spin_unlock (&tcp_option_list_lock); + +static_branch_inc (&tcp_extra_options_enabled); + +return ret; +} + +void tcp_unregister_extra_option (struct tcp_extra_option_ops *ops) +{ +spin_lock (&tcp_option_list_lock); +list_del_rcu (&ops->list); +spin_unlock (&tcp_option_list_lock); + +synchronize_net (); + +static_branch_dec (&tcp_extra_options_enabled); + +module_put (ops->owner); +} +void tcp_done (struct sock *sk) {struct request_sock *req =tcp_sk (sk)->fastopen_rsk;@@ -3521,6 +3653,7 @@ void __init tcp_init(void)INIT_HLIST_HEAD (&tcp_hashinfo.bhash[i].chain); } +INIT_LIST_HEAD (&tcp_option_list); cnt = tcp_hashinfo.ehash_mask +1 ; sysctl_tcp_max_orphans = cnt /2 ;net/ipv4/tcp_input.c +10
-5@@ -3726,7 +3726,7 @@ static void tcp_parse_fastopen_option(int len, const unsigned char *cookie,void tcp_parse_options (const struct net *net,const struct sk_buff *skb,struct tcp_options_received *opt_rx,int estab, -struct tcp_fastopen_cookie *foc) +struct tcp_fastopen_cookie *foc,struct tcp_sock *tp) {const unsigned char *ptr;const struct tcphdr *th =tcp_hdr (skb);@@ -3828,6 +3828,11 @@ void tcp_parse_options(const struct net *net, ptr + 2, th->syn, foc, true);break ; +default : +tcp_extra_options_parse (opcode, opsize, ptr, + skb, opt_rx, tp); +break ; + } ptr += opsize-2 ; length -= opsize;@@ -3874,7 +3879,7 @@ static bool tcp_fast_parse_options(const struct net *net,return true; } -tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL ); +tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL , tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;@@ -5550,7 +5555,7 @@ static bool tcp_rcv_fastopen_synack(struct sock *sk, struct sk_buff *synack,/* Get original SYNACK MSS value if user MSS sets mss_clamp */ tcp_clear_options (&opt); opt.user_mss = opt.mss_clamp =0 ; -tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL , tp); mss = opt.mss_clamp; }@@ -5604,7 +5609,7 @@ static int tcp_rcv_synsent_state_process(struct sock *sk, struct sk_buff *skb,int saved_clamp = tp->rx_opt.mss_clamp;bool fastopen_fail; -tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc); +tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc, tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;@@ -6280,7 +6285,7 @@ int tcp_conn_request(struct request_sock_ops *rsk_ops, tmp_opt.mss_clamp = af_ops->mss_clamp; tmp_opt.user_mss = tp->rx_opt.user_mss;tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 , - want_cookie ?NULL : &foc); + want_cookie ?NULL : &foc, tp);if (want_cookie && !tmp_opt.saw_tstamp)tcp_clear_options (&tmp_opt);net/ipv4/tcp_minisocks.c +2
-2@@ -98,7 +98,7 @@ tcp_timewait_state_process(struct inet_timewait_sock *tw, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (*th) >>2 ) && tcptw->tw_ts_recent_stamp) { -tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) {if (tmp_opt.rcv_tsecr)@@ -565,7 +565,7 @@ struct sock *tcp_check_req(struct sock *sk, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (struct tcphdr )>>2 )) { -tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) { tmp_opt.ts_recent = req->ts_recent;net/ipv4/tcp_output.c +18
-17@@ -41,6 +41,7 @@#include <linux/compiler.h> #include <linux/gfp.h> #include <linux/module.h> +#include <linux/static_key.h> /* People can turn this off for buggy TCP's found in printers etc. */ int sysctl_tcp_retrans_collapse__read_mostly =1 ;@@ -413,23 +414,6 @@ static inline bool tcp_urg_mode(const struct tcp_sock *tp)return tp->snd_una != tp->snd_up; } -#define OPTION_SACK_ADVERTISE (1 << 0) -#define OPTION_TS (1 << 1) -#define OPTION_MD5 (1 << 2) -#define OPTION_WSCALE (1 << 3) -#define OPTION_FAST_OPEN_COOKIE (1 << 8) - -struct tcp_out_options { -u16 options;/* bit field of OPTION_* */ -u16 mss;/* 0 to disable */ -u8 ws;/* window scale, 0 to disable */ -u8 num_sack_blocks;/* number of SACK blocks to include */ -u8 hash_size;/* bytes in hash_location */ -__u8 *hash_location;/* temporary pointer, overloaded */ -__u32 tsval, tsecr;/* need to include OPTION_TS */ -struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ -}; -/* Write previously computed TCP options to the packet. * * Beware: Something in the Internet is very sensitive to the ordering of @@ -540,6 +524,9 @@ static void tcp_options_write(__be32 *ptr, struct sk_buff *skb, struct sock *sk, } ptr += (len +3 ) >>2 ; } + +if (static_branch_unlikely (&tcp_extra_options_enabled)) +tcp_extra_options_write (ptr, opts, tp); }/* Compute TCP options for SYN packets. This is not the final @@ -607,6 +594,10 @@ static unsigned int tcp_syn_options(struct sock *sk, struct sk_buff *skb, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare (skb,TCPHDR_SYN , + remaining, opts, tp); +return MAX_TCP_OPTION_SPACE - remaining; }@@ -668,6 +659,13 @@ static unsigned int tcp_synack_options(const struct sock *sk, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare_req (skb, +TCPHDR_SYN | +TCPHDR_ACK , + remaining, opts, + req); +return MAX_TCP_OPTION_SPACE - remaining; }@@ -701,6 +699,9 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skb size +=TCPOLEN_TSTAMP_ALIGNED ; } + size +=tcp_extra_options_prepare (skb,0 ,MAX_TCP_OPTION_SPACE - size, + opts, tp); + eff_sacks = tp->rx_opt.num_sacks + tp->rx_opt.dsack;if (unlikely (eff_sacks)) {const unsigned int remaining =MAX_TCP_OPTION_SPACE - size;net/ipv6/syncookies.c +1
-1@@ -162,7 +162,7 @@ struct sock *cookie_v6_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcpv6_ts_off(sock_net(sk),Signature · 1 line
2.14.1
--
Mat Martineau
Intel OTC
Christoph Paasch
Re: [MPTCP] [PATCH 06/18] tcp: Register handlers for extra TCP options
Quoted 11 lines · Mat Martineau
Quoted 8 lines · Christoph Paasch
From: Mat Martineau <mathew.j.martineau(a)linux.intel.com>
Allow additional TCP options to be handled by registered hook functions.
Option parsing will call the provided 'parse' function when a TCP option number is not recognized by the normal option parsing code.
Quoted 7 lines
Quoted 4 lines
The 'prepare' and '
prepare_req' functions determine the required space for registered options and store associated data. There are two variants because options must be generated for connections that are associated with eithertcp_sockorrequest_sockstructures.I have a newer version of this patch where there's a single prepare callback that takes a struct sock *, so I'll send that out.
Nice, will you push it to the git repo?
Christoph
Quoted 505 lines
Mat
Quoted 496 lines
A static key and RCU synchronization are used to minimize the performance impact of these extensible TCP features.
Before this is posted upstream, I plan to split the patch in two parts (at least), since making
tcp_out_optionspublic should be separate. The extra parameter fortcp_parse_optionsmay also warrant its own patch. I'd also like to discuss where to store information for the options that are parsed or generated using these hooks, since thetcp_options_receivedandtcp_out_optionsstructs don't have places to store extra information yet.I've confirmed that this code builds, but haven't tested yet.
This commit is also available at
https://git.kernel.org/pub/scm/linux/kernel/git/martineau/linux.git
branch: mptcpSigned-off-by Mat Martineau <mathew.j.martineau(a)linux.intel.com>---
drivers/infiniband/hw/cxgb4/cm.c | 2 +- include/linux/tcp.h | 17 +++++ include/net/tcp.h | 49 ++++++++++++++- net/ipv4/syncookies.c | 2 +- net/ipv4/tcp.c | 133 +++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_input.c | 15 +++-- net/ipv4/tcp_minisocks.c | 4 +- net/ipv4/tcp_output.c | 35 ++++++----- net/ipv6/syncookies.c | 2 +- 9 files changed, 231 insertions(+), 28 deletions(-)drivers/infiniband/hw/cxgb4/cm.c +1
-1@@ -3752,7 +3752,7 @@ static void build_cpl_pass_accept_req(struct sk_buff *skb, int stid , u8 tos)*/ memset (&tmp_opt,0 ,sizeof (tmp_opt));tcp_clear_options (&tmp_opt); -tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ,NULL ); req =__skb_push (skb,sizeof (*req));memset (req,0 ,sizeof (*req));include/linux/tcp.h +17
-0@@ -112,6 +112,23 @@ static inline void tcp_clear_options(struct tcp_options_received *rx_opt) rx_opt->wscale_ok = rx_opt->snd_wscale =0 ; } +#define OPTION_SACK_ADVERTISE (1 << 0) +#define OPTION_TS (1 << 1) +#define OPTION_MD5 (1 << 2) +#define OPTION_WSCALE (1 << 3) +#define OPTION_FAST_OPEN_COOKIE (1 << 8) + +struct tcp_out_options { +u16 options;/* bit field of OPTION_* */ +u16 mss;/* 0 to disable */ +u8 ws;/* window scale, 0 to disable */ +u8 num_sack_blocks;/* number of SACK blocks to include */ +u8 hash_size;/* bytes in hash_location */ +__u8 *hash_location;/* temporary pointer, overloaded */ +__u32 tsval, tsecr;/* need to include OPTION_TS */ +struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ +}; +/* This is the max number of SACKS that we'll generate and process. It's safe * to increase this, although since: * size = TCPOLEN_SACK_BASE_ALIGNED (4) + n * TCPOLEN_SACK_PERBLOCK (8) include/net/tcp.h +48
-1@@ -433,7 +433,8 @@ int tcp_recvmsg(struct sock *sk, struct msghdr *msg, size_t len, int nonblock, int flags, int *addr_len);void tcp_parse_options (const struct net *net,const struct sk_buff *skb,struct tcp_options_received *opt_rx, -int estab,struct tcp_fastopen_cookie *foc); +int estab,struct tcp_fastopen_cookie *foc, +struct tcp_sock *tp);const u8 *tcp_parse_md5sig_option (const struct tcphdr *th);/* @@ -2103,4 +2104,50 @@ static inline bool tcp_bpf_ca_needs_ecn(struct sock *sk) {return (tcp_call_bpf (sk,BPF_SOCK_OPS_NEEDS_ECN ) ==1 ); } + +extern struct static_key_false tcp_extra_options_enabled; + +struct tcp_extra_option_ops { +struct list_head list; +unsigned char option_kind; +void (*parse)(int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp); +/* Return the number of bytes consumed */ +unsigned int (*prepare)(struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp); +/* Return the number of bytes consumed */ +unsigned int (*prepare_req)(struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req); +void (*write)(__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp); +struct module *owner; +}; + +void tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp); + +unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp); + +unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req); + +void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp); + +int tcp_register_extra_option (struct tcp_extra_option_ops *ops); +void tcp_unregister_extra_option (struct tcp_extra_option_ops *ops); +#endif /* _TCP_H */ net/ipv4/syncookies.c +1
-1@@ -313,7 +313,7 @@ struct sock *cookie_v4_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcp_ts_off(sock_net(sk),net/ipv4/tcp.c +133
-0@@ -270,6 +270,7 @@#include <linux/time.h> #include <linux/slab.h> #include <linux/errqueue.h> +#include <linux/static_key.h> #include <net/icmp.h> #include <net/inet_common.h> @@ -306,6 +307,11 @@ EXPORT_SYMBOL(tcp_memory_allocated);struct percpu_counter tcp_sockets_allocated;EXPORT_SYMBOL (tcp_sockets_allocated); +/* Optional TCP option handlers */ +static DEFINE_SPINLOCK (tcp_option_list_lock); +static LIST_HEAD (tcp_option_list); +DEFINE_STATIC_KEY_FALSE (tcp_extra_options_enabled); +/* * TCP splice context */ @@ -3375,6 +3381,132 @@ EXPORT_SYMBOL(tcp_md5_hash_key);#endif +/* Linear search, few entries are expected. The RCU read lock must +* be held before calling. +*/ +static struct tcp_extra_option_ops *tcp_extra_options_find_kind (unsigned char kind) +{ +struct tcp_extra_option_ops *entry; + +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (entry->option_kind == kind) +return entry; + } + +return NULL ; +} + +void tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; + +rcu_read_lock (); + entry =tcp_extra_options_find_kind (opcode); +if (entry && entry->parse) + entry->parse (opsize, opptr, skb, opt_rx, tp); +rcu_read_unlock (); +} + +unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; +unsigned int used =0 ; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->prepare)) +continue ; + + used += entry->prepare (skb, flags, remaining - used, opts, tp); + } +rcu_read_unlock (); + +return used; +} + +unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req) +{ +struct tcp_extra_option_ops *entry; +unsigned int used =0 ; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->prepare_req)) +continue ; + + used += entry->prepare_req (skb, flags, remaining - used, opts, + req); + } +rcu_read_unlock (); + +return used; +} + +void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->write)) +continue ; + + entry->write (ptr, opts, tp); + } +rcu_read_unlock (); +} + +int tcp_register_extra_option (struct tcp_extra_option_ops *ops) +{ +int ret =0 ; + +if (!ops->option_kind) +return -EINVAL ; + +if (!try_module_get (ops->owner)) +return -ENOENT ; + +spin_lock (&tcp_option_list_lock); +if (tcp_extra_options_find_kind (ops->option_kind)) { +pr_notice ("Option kind %u already registered\n" , + ops->option_kind); +spin_unlock (&tcp_option_list_lock); +module_put (ops->owner); +return -EEXIST ; + } + +list_add_tail_rcu (&ops->list, &tcp_option_list); +pr_debug ("Option kind %u registered\n" , ops->option_kind); +spin_unlock (&tcp_option_list_lock); + +static_branch_inc (&tcp_extra_options_enabled); + +return ret; +} + +void tcp_unregister_extra_option (struct tcp_extra_option_ops *ops) +{ +spin_lock (&tcp_option_list_lock); +list_del_rcu (&ops->list); +spin_unlock (&tcp_option_list_lock); + +synchronize_net (); + +static_branch_dec (&tcp_extra_options_enabled); + +module_put (ops->owner); +} +void tcp_done (struct sock *sk) {struct request_sock *req =tcp_sk (sk)->fastopen_rsk;@@ -3521,6 +3653,7 @@ void __init tcp_init(void)INIT_HLIST_HEAD (&tcp_hashinfo.bhash[i].chain); } +INIT_LIST_HEAD (&tcp_option_list); cnt = tcp_hashinfo.ehash_mask +1 ; sysctl_tcp_max_orphans = cnt /2 ;net/ipv4/tcp_input.c +10
-5@@ -3726,7 +3726,7 @@ static void tcp_parse_fastopen_option(int len, const unsigned char *cookie,void tcp_parse_options (const struct net *net,const struct sk_buff *skb,struct tcp_options_received *opt_rx,int estab, -struct tcp_fastopen_cookie *foc) +struct tcp_fastopen_cookie *foc,struct tcp_sock *tp) {const unsigned char *ptr;const struct tcphdr *th =tcp_hdr (skb);@@ -3828,6 +3828,11 @@ void tcp_parse_options(const struct net *net, ptr + 2, th->syn, foc, true);break ; +default : +tcp_extra_options_parse (opcode, opsize, ptr, + skb, opt_rx, tp); +break ; + } ptr += opsize-2 ; length -= opsize;@@ -3874,7 +3879,7 @@ static bool tcp_fast_parse_options(const struct net *net,return true; } -tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL ); +tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL , tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;@@ -5550,7 +5555,7 @@ static bool tcp_rcv_fastopen_synack(struct sock *sk, struct sk_buff *synack,/* Get original SYNACK MSS value if user MSS sets mss_clamp */ tcp_clear_options (&opt); opt.user_mss = opt.mss_clamp =0 ; -tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL , tp); mss = opt.mss_clamp; }@@ -5604,7 +5609,7 @@ static int tcp_rcv_synsent_state_process(struct sock *sk, struct sk_buff *skb,int saved_clamp = tp->rx_opt.mss_clamp;bool fastopen_fail; -tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc); +tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc, tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;@@ -6280,7 +6285,7 @@ int tcp_conn_request(struct request_sock_ops *rsk_ops, tmp_opt.mss_clamp = af_ops->mss_clamp; tmp_opt.user_mss = tp->rx_opt.user_mss;tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 , - want_cookie ?NULL : &foc); + want_cookie ?NULL : &foc, tp);if (want_cookie && !tmp_opt.saw_tstamp)tcp_clear_options (&tmp_opt);net/ipv4/tcp_minisocks.c +2
-2@@ -98,7 +98,7 @@ tcp_timewait_state_process(struct inet_timewait_sock *tw, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (*th) >>2 ) && tcptw->tw_ts_recent_stamp) { -tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) {if (tmp_opt.rcv_tsecr)@@ -565,7 +565,7 @@ struct sock *tcp_check_req(struct sock *sk, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (struct tcphdr )>>2 )) { -tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) { tmp_opt.ts_recent = req->ts_recent;net/ipv4/tcp_output.c +18
-17@@ -41,6 +41,7 @@#include <linux/compiler.h> #include <linux/gfp.h> #include <linux/module.h> +#include <linux/static_key.h> /* People can turn this off for buggy TCP's found in printers etc. */ int sysctl_tcp_retrans_collapse__read_mostly =1 ;@@ -413,23 +414,6 @@ static inline bool tcp_urg_mode(const struct tcp_sock *tp)return tp->snd_una != tp->snd_up; } -#define OPTION_SACK_ADVERTISE (1 << 0) -#define OPTION_TS (1 << 1) -#define OPTION_MD5 (1 << 2) -#define OPTION_WSCALE (1 << 3) -#define OPTION_FAST_OPEN_COOKIE (1 << 8) - -struct tcp_out_options { -u16 options;/* bit field of OPTION_* */ -u16 mss;/* 0 to disable */ -u8 ws;/* window scale, 0 to disable */ -u8 num_sack_blocks;/* number of SACK blocks to include */ -u8 hash_size;/* bytes in hash_location */ -__u8 *hash_location;/* temporary pointer, overloaded */ -__u32 tsval, tsecr;/* need to include OPTION_TS */ -struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ -}; -/* Write previously computed TCP options to the packet. * * Beware: Something in the Internet is very sensitive to the ordering of @@ -540,6 +524,9 @@ static void tcp_options_write(__be32 *ptr, struct sk_buff *skb, struct sock *sk, } ptr += (len +3 ) >>2 ; } + +if (static_branch_unlikely (&tcp_extra_options_enabled)) +tcp_extra_options_write (ptr, opts, tp); }/* Compute TCP options for SYN packets. This is not the final @@ -607,6 +594,10 @@ static unsigned int tcp_syn_options(struct sock *sk, struct sk_buff *skb, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare (skb,TCPHDR_SYN , + remaining, opts, tp); +return MAX_TCP_OPTION_SPACE - remaining; }@@ -668,6 +659,13 @@ static unsigned int tcp_synack_options(const struct sock *sk, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare_req (skb, +TCPHDR_SYN | +TCPHDR_ACK , + remaining, opts, + req); +return MAX_TCP_OPTION_SPACE - remaining; }@@ -701,6 +699,9 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skb size +=TCPOLEN_TSTAMP_ALIGNED ; } + size +=tcp_extra_options_prepare (skb,0 ,MAX_TCP_OPTION_SPACE - size, + opts, tp); + eff_sacks = tp->rx_opt.num_sacks + tp->rx_opt.dsack;if (unlikely (eff_sacks)) {const unsigned int remaining =MAX_TCP_OPTION_SPACE - size;net/ipv6/syncookies.c +1
-1@@ -162,7 +162,7 @@ struct sock *cookie_v6_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcpv6_ts_off(sock_net(sk),Signature · 1 line
2.14.1--
Mat Martineau
Intel OTC
Mat Martineau
Re: [MPTCP] [PATCH 06/18] tcp: Register handlers for extra TCP options
Quoted 17 lines · Christoph Paasch
Quoted 16 lines · Mat Martineau
Quoted 12 lines · Christoph Paasch
From: Mat Martineau <mathew.j.martineau(a)linux.intel.com>
Allow additional TCP options to be handled by registered hook functions.
Option parsing will call the provided 'parse' function when a TCP option number is not recognized by the normal option parsing code.
The 'prepare' and '
prepare_req' functions determine the required space for registered options and store associated data. There are two variants because options must be generated for connections that are associated with eithertcp_sockorrequest_sockstructures.
Quoted 4 lines
Quoted 2 lines
I have a newer version of this patch where there's a single prepare callback that takes a struct sock *, so I'll send that out.
Nice, will you push it to the git repo?
I needed to rebase it to the current upstream tree, but now I've posted it to the list and pushed to
https://git.kernel.org/pub/scm/linux/kernel/git/martineau/linux.git/commit/?h=mptcp
Mat
Quoted 495 lines
Quoted 495 lines
Mat
Quoted 490 lines
A static key and RCU synchronization are used to minimize the performance impact of these extensible TCP features.
Before this is posted upstream, I plan to split the patch in two parts (at least), since making
tcp_out_optionspublic should be separate. The extra parameter fortcp_parse_optionsmay also warrant its own patch. I'd also like to discuss where to store information for the options that are parsed or generated using these hooks, since thetcp_options_receivedandtcp_out_optionsstructs don't have places to store extra information yet.I've confirmed that this code builds, but haven't tested yet.
This commit is also available at
https://git.kernel.org/pub/scm/linux/kernel/git/martineau/linux.git
branch: mptcpSigned-off-by Mat Martineau <mathew.j.martineau(a)linux.intel.com>---
drivers/infiniband/hw/cxgb4/cm.c | 2 +- include/linux/tcp.h | 17 +++++ include/net/tcp.h | 49 ++++++++++++++- net/ipv4/syncookies.c | 2 +- net/ipv4/tcp.c | 133 +++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_input.c | 15 +++-- net/ipv4/tcp_minisocks.c | 4 +- net/ipv4/tcp_output.c | 35 ++++++----- net/ipv6/syncookies.c | 2 +- 9 files changed, 231 insertions(+), 28 deletions(-)drivers/infiniband/hw/cxgb4/cm.c +1
-1@@ -3752,7 +3752,7 @@ static void build_cpl_pass_accept_req(struct sk_buff *skb, int stid , u8 tos)*/ memset (&tmp_opt,0 ,sizeof (tmp_opt));tcp_clear_options (&tmp_opt); -tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (&init_net, skb, &tmp_opt,0 ,NULL ,NULL ); req =__skb_push (skb,sizeof (*req));memset (req,0 ,sizeof (*req));include/linux/tcp.h +17
-0@@ -112,6 +112,23 @@ static inline void tcp_clear_options(struct tcp_options_received *rx_opt) rx_opt->wscale_ok = rx_opt->snd_wscale =0 ; } +#define OPTION_SACK_ADVERTISE (1 << 0) +#define OPTION_TS (1 << 1) +#define OPTION_MD5 (1 << 2) +#define OPTION_WSCALE (1 << 3) +#define OPTION_FAST_OPEN_COOKIE (1 << 8) + +struct tcp_out_options { +u16 options;/* bit field of OPTION_* */ +u16 mss;/* 0 to disable */ +u8 ws;/* window scale, 0 to disable */ +u8 num_sack_blocks;/* number of SACK blocks to include */ +u8 hash_size;/* bytes in hash_location */ +__u8 *hash_location;/* temporary pointer, overloaded */ +__u32 tsval, tsecr;/* need to include OPTION_TS */ +struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ +}; +/* This is the max number of SACKS that we'll generate and process. It's safe * to increase this, although since: * size = TCPOLEN_SACK_BASE_ALIGNED (4) + n * TCPOLEN_SACK_PERBLOCK (8) include/net/tcp.h +48
-1@@ -433,7 +433,8 @@ int tcp_recvmsg(struct sock *sk, struct msghdr *msg, size_t len, int nonblock, int flags, int *addr_len);void tcp_parse_options (const struct net *net,const struct sk_buff *skb,struct tcp_options_received *opt_rx, -int estab,struct tcp_fastopen_cookie *foc); +int estab,struct tcp_fastopen_cookie *foc, +struct tcp_sock *tp);const u8 *tcp_parse_md5sig_option (const struct tcphdr *th);/* @@ -2103,4 +2104,50 @@ static inline bool tcp_bpf_ca_needs_ecn(struct sock *sk) {return (tcp_call_bpf (sk,BPF_SOCK_OPS_NEEDS_ECN ) ==1 ); } + +extern struct static_key_false tcp_extra_options_enabled; + +struct tcp_extra_option_ops { +struct list_head list; +unsigned char option_kind; +void (*parse)(int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp); +/* Return the number of bytes consumed */ +unsigned int (*prepare)(struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp); +/* Return the number of bytes consumed */ +unsigned int (*prepare_req)(struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req); +void (*write)(__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp); +struct module *owner; +}; + +void tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp); + +unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp); + +unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req); + +void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp); + +int tcp_register_extra_option (struct tcp_extra_option_ops *ops); +void tcp_unregister_extra_option (struct tcp_extra_option_ops *ops); +#endif /* _TCP_H */ net/ipv4/syncookies.c +1
-1@@ -313,7 +313,7 @@ struct sock *cookie_v4_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcp_ts_off(sock_net(sk),net/ipv4/tcp.c +133
-0@@ -270,6 +270,7 @@#include <linux/time.h> #include <linux/slab.h> #include <linux/errqueue.h> +#include <linux/static_key.h> #include <net/icmp.h> #include <net/inet_common.h> @@ -306,6 +307,11 @@ EXPORT_SYMBOL(tcp_memory_allocated);struct percpu_counter tcp_sockets_allocated;EXPORT_SYMBOL (tcp_sockets_allocated); +/* Optional TCP option handlers */ +static DEFINE_SPINLOCK (tcp_option_list_lock); +static LIST_HEAD (tcp_option_list); +DEFINE_STATIC_KEY_FALSE (tcp_extra_options_enabled); +/* * TCP splice context */ @@ -3375,6 +3381,132 @@ EXPORT_SYMBOL(tcp_md5_hash_key);#endif +/* Linear search, few entries are expected. The RCU read lock must +* be held before calling. +*/ +static struct tcp_extra_option_ops *tcp_extra_options_find_kind (unsigned char kind) +{ +struct tcp_extra_option_ops *entry; + +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (entry->option_kind == kind) +return entry; + } + +return NULL ; +} + +void tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr, +const struct sk_buff *skb, +struct tcp_options_received *opt_rx, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; + +rcu_read_lock (); + entry =tcp_extra_options_find_kind (opcode); +if (entry && entry->parse) + entry->parse (opsize, opptr, skb, opt_rx, tp); +rcu_read_unlock (); +} + +unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; +unsigned int used =0 ; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->prepare)) +continue ; + + used += entry->prepare (skb, flags, remaining - used, opts, tp); + } +rcu_read_unlock (); + +return used; +} + +unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags, +unsigned int remaining, +struct tcp_out_options *opts, +struct request_sock *req) +{ +struct tcp_extra_option_ops *entry; +unsigned int used =0 ; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->prepare_req)) +continue ; + + used += entry->prepare_req (skb, flags, remaining - used, opts, + req); + } +rcu_read_unlock (); + +return used; +} + +void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, +struct tcp_sock *tp) +{ +struct tcp_extra_option_ops *entry; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->write)) +continue ; + + entry->write (ptr, opts, tp); + } +rcu_read_unlock (); +} + +int tcp_register_extra_option (struct tcp_extra_option_ops *ops) +{ +int ret =0 ; + +if (!ops->option_kind) +return -EINVAL ; + +if (!try_module_get (ops->owner)) +return -ENOENT ; + +spin_lock (&tcp_option_list_lock); +if (tcp_extra_options_find_kind (ops->option_kind)) { +pr_notice ("Option kind %u already registered\n" , + ops->option_kind); +spin_unlock (&tcp_option_list_lock); +module_put (ops->owner); +return -EEXIST ; + } + +list_add_tail_rcu (&ops->list, &tcp_option_list); +pr_debug ("Option kind %u registered\n" , ops->option_kind); +spin_unlock (&tcp_option_list_lock); + +static_branch_inc (&tcp_extra_options_enabled); + +return ret; +} + +void tcp_unregister_extra_option (struct tcp_extra_option_ops *ops) +{ +spin_lock (&tcp_option_list_lock); +list_del_rcu (&ops->list); +spin_unlock (&tcp_option_list_lock); + +synchronize_net (); + +static_branch_dec (&tcp_extra_options_enabled); + +module_put (ops->owner); +} +void tcp_done (struct sock *sk) {struct request_sock *req =tcp_sk (sk)->fastopen_rsk;@@ -3521,6 +3653,7 @@ void __init tcp_init(void)INIT_HLIST_HEAD (&tcp_hashinfo.bhash[i].chain); } +INIT_LIST_HEAD (&tcp_option_list); cnt = tcp_hashinfo.ehash_mask +1 ; sysctl_tcp_max_orphans = cnt /2 ;net/ipv4/tcp_input.c +10
-5@@ -3726,7 +3726,7 @@ static void tcp_parse_fastopen_option(int len, const unsigned char *cookie,void tcp_parse_options (const struct net *net,const struct sk_buff *skb,struct tcp_options_received *opt_rx,int estab, -struct tcp_fastopen_cookie *foc) +struct tcp_fastopen_cookie *foc,struct tcp_sock *tp) {const unsigned char *ptr;const struct tcphdr *th =tcp_hdr (skb);@@ -3828,6 +3828,11 @@ void tcp_parse_options(const struct net *net, ptr + 2, th->syn, foc, true);break ; +default : +tcp_extra_options_parse (opcode, opsize, ptr, + skb, opt_rx, tp); +break ; + } ptr += opsize-2 ; length -= opsize;@@ -3874,7 +3879,7 @@ static bool tcp_fast_parse_options(const struct net *net,return true; } -tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL ); +tcp_parse_options (net, skb, &tp->rx_opt,1 ,NULL , tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;@@ -5550,7 +5555,7 @@ static bool tcp_rcv_fastopen_synack(struct sock *sk, struct sk_buff *synack,/* Get original SYNACK MSS value if user MSS sets mss_clamp */ tcp_clear_options (&opt); opt.user_mss = opt.mss_clamp =0 ; -tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), synack, &opt,0 ,NULL , tp); mss = opt.mss_clamp; }@@ -5604,7 +5609,7 @@ static int tcp_rcv_synsent_state_process(struct sock *sk, struct sk_buff *skb,int saved_clamp = tp->rx_opt.mss_clamp;bool fastopen_fail; -tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc); +tcp_parse_options (sock_net (sk), skb, &tp->rx_opt,0 , &foc, tp);if (tp->rx_opt.saw_tstamp && tp->rx_opt.rcv_tsecr) tp->rx_opt.rcv_tsecr -= tp->tsoffset;@@ -6280,7 +6285,7 @@ int tcp_conn_request(struct request_sock_ops *rsk_ops, tmp_opt.mss_clamp = af_ops->mss_clamp; tmp_opt.user_mss = tp->rx_opt.user_mss;tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 , - want_cookie ?NULL : &foc); + want_cookie ?NULL : &foc, tp);if (want_cookie && !tmp_opt.saw_tstamp)tcp_clear_options (&tmp_opt);net/ipv4/tcp_minisocks.c +2
-2@@ -98,7 +98,7 @@ tcp_timewait_state_process(struct inet_timewait_sock *tw, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (*th) >>2 ) && tcptw->tw_ts_recent_stamp) { -tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (twsk_net (tw), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) {if (tmp_opt.rcv_tsecr)@@ -565,7 +565,7 @@ struct sock *tcp_check_req(struct sock *sk, struct sk_buff *skb, tmp_opt.saw_tstamp =0 ;if (th->doff > (sizeof (struct tcphdr )>>2 )) { -tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tmp_opt,0 ,NULL ,NULL );if (tmp_opt.saw_tstamp) { tmp_opt.ts_recent = req->ts_recent;net/ipv4/tcp_output.c +18
-17@@ -41,6 +41,7 @@#include <linux/compiler.h> #include <linux/gfp.h> #include <linux/module.h> +#include <linux/static_key.h> /* People can turn this off for buggy TCP's found in printers etc. */ int sysctl_tcp_retrans_collapse__read_mostly =1 ;@@ -413,23 +414,6 @@ static inline bool tcp_urg_mode(const struct tcp_sock *tp)return tp->snd_una != tp->snd_up; } -#define OPTION_SACK_ADVERTISE (1 << 0) -#define OPTION_TS (1 << 1) -#define OPTION_MD5 (1 << 2) -#define OPTION_WSCALE (1 << 3) -#define OPTION_FAST_OPEN_COOKIE (1 << 8) - -struct tcp_out_options { -u16 options;/* bit field of OPTION_* */ -u16 mss;/* 0 to disable */ -u8 ws;/* window scale, 0 to disable */ -u8 num_sack_blocks;/* number of SACK blocks to include */ -u8 hash_size;/* bytes in hash_location */ -__u8 *hash_location;/* temporary pointer, overloaded */ -__u32 tsval, tsecr;/* need to include OPTION_TS */ -struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ -}; -/* Write previously computed TCP options to the packet. * * Beware: Something in the Internet is very sensitive to the ordering of @@ -540,6 +524,9 @@ static void tcp_options_write(__be32 *ptr, struct sk_buff *skb, struct sock *sk, } ptr += (len +3 ) >>2 ; } + +if (static_branch_unlikely (&tcp_extra_options_enabled)) +tcp_extra_options_write (ptr, opts, tp); }/* Compute TCP options for SYN packets. This is not the final @@ -607,6 +594,10 @@ static unsigned int tcp_syn_options(struct sock *sk, struct sk_buff *skb, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare (skb,TCPHDR_SYN , + remaining, opts, tp); +return MAX_TCP_OPTION_SPACE - remaining; }@@ -668,6 +659,13 @@ static unsigned int tcp_synack_options(const struct sock *sk, } } +if (static_branch_unlikely (&tcp_extra_options_enabled)) + remaining -=tcp_extra_options_prepare_req (skb, +TCPHDR_SYN | +TCPHDR_ACK , + remaining, opts, + req); +return MAX_TCP_OPTION_SPACE - remaining; }@@ -701,6 +699,9 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skb size +=TCPOLEN_TSTAMP_ALIGNED ; } + size +=tcp_extra_options_prepare (skb,0 ,MAX_TCP_OPTION_SPACE - size, + opts, tp); + eff_sacks = tp->rx_opt.num_sacks + tp->rx_opt.dsack;if (unlikely (eff_sacks)) {const unsigned int remaining =MAX_TCP_OPTION_SPACE - size;net/ipv6/syncookies.c +1
-1@@ -162,7 +162,7 @@ struct sock *cookie_v6_check(struct sock *sk, struct sk_buff *skb)/* check for timestamp cookie support */ memset (&tcp_opt,0 ,sizeof (tcp_opt)); -tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL ); +tcp_parse_options (sock_net (sk), skb, &tcp_opt,0 ,NULL , tp);
Quoted 11 lines
Quoted 10 lines
Quoted 6 lines
net/ipv6/syncookies.c +0
-1if (tcp_opt.saw_tstamp && tcp_opt.rcv_tsecr) { tsoff = secure_tcpv6_ts_off(sock_net(sk), --2.14.1
--
Mat Martineau
Intel OTC
--
Mat Martineau
Intel OTC
Christoph Paasch
PATCH 7/18 tcp_extra_option: add_header callback for TCP extra options
In reply to Christoph PaaschExtra options need to be accounted in tcp_header_len of tcp_sock. Thus, we need another callback for this as well.
--- include/net/tcp.h | 5 +++++ net/ipv4/tcp.c | 18 ++++++++++++++++++ net/ipv4/tcp_minisocks.c | 3 +++ net/ipv4/tcp_output.c | 3 +++ 4 files changed, 29 insertions(+)
include/net/tcp.h +5 -0
@@ -2126,6 +2126,8 @@ struct tcp_extra_option_ops { struct request_sock *req);void (*write)(__be32 *ptr,struct tcp_out_options *opts,struct tcp_sock *tp); +int (*add_header_len)(const struct sock *listener, +const struct sock *sk);struct module *owner; };
@@ -2147,6 +2149,9 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags,void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts,struct tcp_sock *tp); +int tcp_extra_options_add_header (const struct sock *listener, +const struct sock *sk); +int tcp_register_extra_option (struct tcp_extra_option_ops *ops);void tcp_unregister_extra_option (struct tcp_extra_option_ops *ops);
net/ipv4/tcp.c +18 -0
@@ -3466,6 +3466,24 @@ void tcp_extra_options_write(__be32 *ptr, struct tcp_out_options *opts,rcu_read_unlock (); } +int tcp_extra_options_add_header (const struct sock *listener, +const struct sock *sk) +{ +struct tcp_extra_option_ops *entry; +int tcp_header_len =0 ; + +rcu_read_lock (); +list_for_each_entry_rcu (entry, &tcp_option_list, list) { +if (unlikely (!entry->add_header_len)) +continue ; + + tcp_header_len += entry->add_header_len (listener, sk); + } +rcu_read_unlock (); + +return tcp_header_len; +} +int tcp_register_extra_option (struct tcp_extra_option_ops *ops) {int ret =0 ;
net/ipv4/tcp_minisocks.c +3 -0
@@ -525,6 +525,9 @@ struct sock *tcp_create_openreq_child(const struct sock *sk,if (newtp->af_specific->md5_lookup (sk, newsk)) newtp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ;#endif +if (static_branch_unlikely (&tcp_extra_options_enabled)) + newtp->tcp_header_len +=tcp_extra_options_add_header (sk, newsk); +if (skb->len >=TCP_MSS_DEFAULT + newtp->tcp_header_len) newicsk->icsk_ack.last_seg_size = skb->len - newtp->tcp_header_len; newtp->rx_opt.mss_clamp = req->mss;
net/ipv4/tcp_output.c +3 -0
@@ -3250,6 +3250,9 @@ static void tcp_connect_init(struct sock *sk) tp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ;#endif +if (static_branch_unlikely (&tcp_extra_options_enabled)) + tp->tcp_header_len +=tcp_extra_options_add_header (sk, sk); +/* If user gave his TCP_MAXSEG, record it to clamp */ if (tp->rx_opt.user_mss) tp->rx_opt.mss_clamp = tp->rx_opt.user_mss;
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 8/18 tcp_extra_option: Add missing static branch for tcp_extra_options_prepare
In reply to Christoph Paasch--- net/ipv4/tcp_output.c | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-)
net/ipv4/tcp_output.c +4 -2
@@ -699,8 +699,10 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skb size +=TCPOLEN_TSTAMP_ALIGNED ; } - size +=tcp_extra_options_prepare (skb,0 ,MAX_TCP_OPTION_SPACE - size, - opts, tp); +if (static_branch_unlikely (&tcp_extra_options_enabled)) + size +=tcp_extra_options_prepare (skb,0 , +MAX_TCP_OPTION_SPACE - size, + opts, tp); eff_sacks = tp->rx_opt.num_sacks + tp->rx_opt.dsack;if (unlikely (eff_sacks)) {
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 9/18 tcp_extra_option: Use sock instead of tcp_sock in tcp_extra_options_parse/prepare/write
In reply to Christoph PaaschIt's just easier that way and we can do less type-casts later on for MD5.
--- include/net/tcp.h | 12 ++++++------ net/ipv4/tcp.c | 12 ++++++------ net/ipv4/tcp_input.c | 3 ++- net/ipv4/tcp_output.c | 6 +++--- 4 files changed, 17 insertions(+), 16 deletions(-)
include/net/tcp.h +6 -6
@@ -2113,19 +2113,19 @@ struct tcp_extra_option_ops {void (*parse)(int opsize,const unsigned char *opptr,const struct sk_buff *skb,struct tcp_options_received *opt_rx, -struct tcp_sock *tp); +struct sock *sk);/* Return the number of bytes consumed */ unsigned int (*prepare)(struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct tcp_sock *tp); +struct sock *sk);/* Return the number of bytes consumed */ unsigned int (*prepare_req)(struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts,struct request_sock *req);void (*write)(__be32 *ptr,struct tcp_out_options *opts, -struct tcp_sock *tp); +struct sock *sk);int (*add_header_len)(const struct sock *listener,const struct sock *sk);struct module *owner;
@@ -2134,12 +2134,12 @@ struct tcp_extra_option_ops {void tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr,const struct sk_buff *skb,struct tcp_options_received *opt_rx, -struct tcp_sock *tp); +struct sock *sk);unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct tcp_sock *tp); +struct sock *sk); unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags, unsigned int remaining,
@@ -2147,7 +2147,7 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags, struct request_sock *req);void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, -struct tcp_sock *tp); +struct sock *sk);int tcp_extra_options_add_header (const struct sock *listener,const struct sock *sk);
net/ipv4/tcp.c +6 -6
@@ -3399,21 +3399,21 @@ static struct tcp_extra_option_ops *tcp_extra_options_find_kind(unsigned char kivoid tcp_extra_options_parse (int opcode,int opsize,const unsigned char *opptr,const struct sk_buff *skb,struct tcp_options_received *opt_rx, -struct tcp_sock *tp) +struct sock *sk) {struct tcp_extra_option_ops *entry;rcu_read_lock (); entry =tcp_extra_options_find_kind (opcode);if (entry && entry->parse) - entry->parse (opsize, opptr, skb, opt_rx, tp); + entry->parse (opsize, opptr, skb, opt_rx, sk);rcu_read_unlock (); }unsigned int tcp_extra_options_prepare (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct tcp_sock *tp) +struct sock *sk) {struct tcp_extra_option_ops *entry;unsigned int used =0 ;
@@ -3423,7 +3423,7 @@ unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags,if (unlikely (!entry->prepare))continue ; - used += entry->prepare (skb, flags, remaining - used, opts, tp); + used += entry->prepare (skb, flags, remaining - used, opts, sk); }rcu_read_unlock ();
@@ -3452,7 +3452,7 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags, }void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, -struct tcp_sock *tp) +struct sock *sk) {struct tcp_extra_option_ops *entry;
@@ -3461,7 +3461,7 @@ void tcp_extra_options_write(__be32 *ptr, struct tcp_out_options *opts,if (unlikely (!entry->write))continue ; - entry->write (ptr, opts, tp); + entry->write (ptr, opts, sk); }rcu_read_unlock (); }
net/ipv4/tcp_input.c +2 -1
@@ -3830,7 +3830,8 @@ void tcp_parse_options(const struct net *net,default :tcp_extra_options_parse (opcode, opsize, ptr, - skb, opt_rx, tp); + skb, opt_rx, + (struct sock *)tp);break ; }
net/ipv4/tcp_output.c +3 -3
@@ -526,7 +526,7 @@ static void tcp_options_write(__be32 *ptr, struct sk_buff *skb, struct sock *sk, }if (static_branch_unlikely (&tcp_extra_options_enabled)) -tcp_extra_options_write (ptr, opts, tp); +tcp_extra_options_write (ptr, opts, sk); }/* Compute TCP options for SYN packets. This is not the final
@@ -596,7 +596,7 @@ static unsigned int tcp_syn_options(struct sock *sk, struct sk_buff *skb,if (static_branch_unlikely (&tcp_extra_options_enabled)) remaining -=tcp_extra_options_prepare (skb,TCPHDR_SYN , - remaining, opts, tp); + remaining, opts, sk);return MAX_TCP_OPTION_SPACE - remaining; }
@@ -702,7 +702,7 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skbif (static_branch_unlikely (&tcp_extra_options_enabled)) size +=tcp_extra_options_prepare (skb,0 ,MAX_TCP_OPTION_SPACE - size, - opts, tp); + opts, sk); eff_sacks = tp->rx_opt.num_sacks + tp->rx_opt.dsack;if (unlikely (eff_sacks)) {
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 10/18 tcp_extra_option: Pass skb to tcp_extra_options_write
In reply to Christoph PaaschWill be needed for TCP_MD5.
--- include/net/tcp.h | 8 ++++---- net/ipv4/tcp.c | 6 +++--- net/ipv4/tcp_output.c | 2 +- 3 files changed, 8 insertions(+), 8 deletions(-)
include/net/tcp.h +4 -4
@@ -2124,8 +2124,8 @@ struct tcp_extra_option_ops {unsigned int remaining, struct tcp_out_options *opts, struct request_sock *req); -void (*write)(__be32 *ptr,struct tcp_out_options *opts, -struct sock *sk); +void (*write)(__be32 *ptr,struct sk_buff *skb, +struct tcp_out_options *opts,struct sock *sk);int (*add_header_len)(const struct sock *listener,const struct sock *sk);struct module *owner;
@@ -2146,8 +2146,8 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags,struct tcp_out_options *opts, struct request_sock *req); -void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, -struct sock *sk); +void tcp_extra_options_write (__be32 *ptr,struct sk_buff *skb, +struct tcp_out_options *opts,struct sock *sk);int tcp_extra_options_add_header (const struct sock *listener,const struct sock *sk);
net/ipv4/tcp.c +3 -3
@@ -3451,8 +3451,8 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags,return used; } -void tcp_extra_options_write (__be32 *ptr,struct tcp_out_options *opts, -struct sock *sk) +void tcp_extra_options_write (__be32 *ptr,struct sk_buff *skb, +struct tcp_out_options *opts,struct sock *sk) {struct tcp_extra_option_ops *entry;
@@ -3461,7 +3461,7 @@ void tcp_extra_options_write(__be32 *ptr, struct tcp_out_options *opts,if (unlikely (!entry->write))continue ; - entry->write (ptr, opts, sk); + entry->write (ptr, skb, opts, sk); }rcu_read_unlock (); }
net/ipv4/tcp_output.c +1 -1
@@ -526,7 +526,7 @@ static void tcp_options_write(__be32 *ptr, struct sk_buff *skb, struct sock *sk, }if (static_branch_unlikely (&tcp_extra_options_enabled)) -tcp_extra_options_write (ptr, opts, sk); +tcp_extra_options_write (ptr, skb, opts, sk); }/* Compute TCP options for SYN packets. This is not the final
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 11/18 tcp_extra_option: Pass sock to prepare_req
In reply to Christoph PaaschWill be needed for TCP_MD5.
--- include/net/tcp.h | 6 ++++-- net/ipv4/tcp.c | 5 +++-- net/ipv4/tcp_output.c | 3 ++- 3 files changed, 9 insertions(+), 5 deletions(-)
include/net/tcp.h +4 -2
@@ -2123,7 +2123,8 @@ struct tcp_extra_option_ops {unsigned int (*prepare_req)(struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req); +struct request_sock *req, +const struct sock *sk);void (*write)(__be32 *ptr,struct sk_buff *skb,struct tcp_out_options *opts,struct sock *sk); int (*add_header_len)(const struct sock *listener,
@@ -2144,7 +2145,8 @@ unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags,unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req); +struct request_sock *req, +const struct sock *sk);void tcp_extra_options_write (__be32 *ptr,struct sk_buff *skb,struct tcp_out_options *opts,struct sock *sk);
net/ipv4/tcp.c +3 -2
@@ -3433,7 +3433,8 @@ unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags,unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req) +struct request_sock *req, +const struct sock *sk) {struct tcp_extra_option_ops *entry;unsigned int used =0 ;
@@ -3444,7 +3445,7 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags,continue ; used += entry->prepare_req (skb, flags, remaining - used, opts, - req); + req, sk); }rcu_read_unlock ();
net/ipv4/tcp_output.c +2 -1
@@ -664,7 +664,8 @@ static unsigned int tcp_synack_options(const struct sock *sk,TCPHDR_SYN |TCPHDR_ACK , remaining, opts, - req); + req, + sk);return MAX_TCP_OPTION_SPACE - remaining; }
Signature · 1 line
2.14.1
Mat Martineau
Re: [MPTCP] [PATCH 11/18] tcp_extra_option: Pass sock to prepare_req
Quoted 1 line · Christoph Paasch
Will be needed for
TCP_MD5.
Patches 7-10 look good to me. Some overlap with v2 of patch 6 that I posted earlier today, so there will be some conflicts to sort out.
Quoted 22 lines
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
include/net/tcp.h | 6 ++++-- net/ipv4/tcp.c | 5 +++-- net/ipv4/tcp_output.c | 3 ++- 3 files changed, 9 insertions(+), 5 deletions(-)include/net/tcp.h +2
-1@@ -2123,7 +2123,8 @@ struct tcp_extra_option_ops {unsigned int (*prepare_req)(struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req); +struct request_sock *req, +const struct sock *sk);void (*write)(__be32 *ptr,struct sk_buff *skb,struct tcp_out_options *opts,struct sock *sk); int (*add_header_len)(const struct sock *listener,
include/net/tcp.h unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags, · line 2149
Quoted 6 lines
include/net/tcp.h +2
-1@@ -2144,7 +2145,8 @@ unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags,unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req); +struct request_sock *req, +const struct sock *sk);
v2 of the option registration patch will cause a problem here, since I consolidated the prepare callbacks.
Is it better to keep these callbacks separate to allow for different parameters? It might be possible to have one "get_length" callback instead of prepare/prepare_req/add_header_len, if we can determine a simple set of rules for the callback implementor to follow. This only makes sense if it looks like the callbacks are very similar to each other in practice - a quick look at the MD5 code makes me think that's the case.
Mat
Quoted 43 lines
include/net/tcp.h +0
-0void tcp_extra_options_write (__be32 *ptr,struct sk_buff *skb,struct tcp_out_options *opts,struct sock *sk);net/ipv4/tcp.c +3
-2@@ -3433,7 +3433,8 @@ unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags,unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req) +struct request_sock *req, +const struct sock *sk) {struct tcp_extra_option_ops *entry;unsigned int used =0 ;@@ -3444,7 +3445,7 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags,continue ; used += entry->prepare_req (skb, flags, remaining - used, opts, - req); + req, sk); }rcu_read_unlock ();net/ipv4/tcp_output.c +2
-1@@ -664,7 +664,8 @@ static unsigned int tcp_synack_options(const struct sock *sk,TCPHDR_SYN |TCPHDR_ACK , remaining, opts, - req); + req, + sk);return MAX_TCP_OPTION_SPACE - remaining; }Signature · 1 line
2.14.1
--
Mat Martineau
Intel OTC
Christoph Paasch
Re: [MPTCP] [PATCH 11/18] tcp_extra_option: Pass sock to prepare_req
Quoted 7 lines · Mat Martineau
Quoted 1 line · Christoph Paasch
Will be needed for
TCP_MD5.Patches 7-10 look good to me. Some overlap with v2 of patch 6 that I posted earlier today, so there will be some conflicts to sort out.
Ok, if 7-10 are fine, I will squash them into your patch so that we have a single one for the extra options.
Quoted 34 lines
Quoted 24 lines
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
include/net/tcp.h | 6 ++++-- net/ipv4/tcp.c | 5 +++-- net/ipv4/tcp_output.c | 3 ++- 3 files changed, 9 insertions(+), 5 deletions(-)include/net/tcp.h +2
-1@@ -2123,7 +2123,8 @@ struct tcp_extra_option_ops {unsigned int (*prepare_req)(struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req); +struct request_sock *req, +const struct sock *sk);void (*write)(__be32 *ptr,struct sk_buff *skb,struct tcp_out_options *opts,struct sock *sk); int (*add_header_len)(const struct sock *listener,include/net/tcp.h unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags, · line 2149
Quoted 6 lines
include/net/tcp.h +2
-1@@ -2144,7 +2145,8 @@ unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags,unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req); +struct request_sock *req, +const struct sock *sk);v2 of the option registration patch will cause a problem here, since I consolidated the prepare callbacks.
Quoted 6 lines
Is it better to keep these callbacks separate to allow for different parameters? It might be possible to have one "
get_length" callback instead of prepare/prepare_req/add_header_len, if we can determine a simple set of rules for the callback implementor to follow. This only makes sense if it looks like the callbacks are very similar to each other in practice - a quick look at the MD5 code makes me think that's the case.
prepare and prepare_req are fine to merge IMO.
add_header_len has quite different semantics in my opinion in that it gets called during connect() and tcp_create_openreq_child(). And is rather static. For example, for MPTCP prepare and add_header_len would be quite different.
Christoph
Quoted 52 lines
Mat
Quoted 43 lines
include/net/tcp.h +0
-0void tcp_extra_options_write (__be32 *ptr,struct sk_buff *skb,struct tcp_out_options *opts,struct sock *sk);net/ipv4/tcp.c +3
-2@@ -3433,7 +3433,8 @@ unsigned int tcp_extra_options_prepare(struct sk_buff *skb, u8 flags,unsigned int tcp_extra_options_prepare_req (struct sk_buff *skb,u8 flags,unsigned int remaining,struct tcp_out_options *opts, -struct request_sock *req) +struct request_sock *req, +const struct sock *sk) {struct tcp_extra_option_ops *entry;unsigned int used =0 ;@@ -3444,7 +3445,7 @@ unsigned int tcp_extra_options_prepare_req(struct sk_buff *skb, u8 flags,continue ; used += entry->prepare_req (skb, flags, remaining - used, opts, - req); + req, sk); }rcu_read_unlock ();net/ipv4/tcp_output.c +2
-1@@ -664,7 +664,8 @@ static unsigned int tcp_synack_options(const struct sock *sk,TCPHDR_SYN |TCPHDR_ACK , remaining, opts, - req); + req, + sk);return MAX_TCP_OPTION_SPACE - remaining; }Signature · 1 line
2.14.1--
Mat Martineau
Intel OTC
Christoph Paasch
PATCH 12/18 tcp_md5: Detect key inside tcp_v4_send_ack instead of passing it as an argument
In reply to Christoph PaaschThis will simplify to consolidate the TCP_MD5-code into a single place.
--- net/ipv4/tcp_ipv4.c | 18 ++++++++++++++---- 1 file changed, 14 insertions(+), 4 deletions(-)
net/ipv4/tcp_ipv4.c +14 -4
@@ -732,7 +732,6 @@ static void tcp_v4_send_reset(const struct sock *sk, struct sk_buff *skb)static void tcp_v4_send_ack (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr,int oif, -struct tcp_md5sig_key *key,int reply_flags,u8 tos) {const struct tcphdr *th =tcp_hdr (skb);
@@ -744,6 +743,9 @@ static void tcp_v4_send_ack(const struct sock *sk,#endif ]; } rep; +#ifdef CONFIG_TCP_MD5SIG +struct tcp_md5sig_key *key; +#endif struct net *net =sock_net (sk);struct ip_reply_arg arg;
@@ -771,6 +773,17 @@ static void tcp_v4_send_ack(const struct sock *sk, rep.th.window =htons (win);#ifdef CONFIG_TCP_MD5SIG +if (sk->sk_state ==TCP_TIME_WAIT ) { +struct tcp_timewait_sock *tcptw =tcp_twsk (sk); + + key =tcp_twsk_md5_key (tcptw); + }else if (sk->sk_state ==TCP_NEW_SYN_RECV ) { + key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&ip_hdr (skb)->daddr, +AF_INET ); + }else { +BUG (); + } +if (key) {int offset = (tsecr) ?3 :0 ;
@@ -816,7 +829,6 @@ static void tcp_v4_timewait_ack(struct sock *sk, struct sk_buff *skb)tcp_time_stamp_raw () + tcptw->tw_ts_offset, tcptw->tw_ts_recent, tw->tw_bound_dev_if, -tcp_twsk_md5_key (tcptw), tw->tw_transparent ?IP_REPLY_ARG_NOSRCCHECK :0 , tw->tw_tos );
@@ -844,8 +856,6 @@ static void tcp_v4_reqsk_send_ack(const struct sock *sk, struct sk_buff *skb,tcp_time_stamp_raw () +tcp_rsk (req)->ts_off, req->ts_recent,0 , -tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&ip_hdr (skb)->daddr, -AF_INET ),inet_rsk (req)->no_srccheck ?IP_REPLY_ARG_NOSRCCHECK :0 , ip_hdr(skb)->tos); }
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 13/18 tcp_md5: Detect key inside tcp_v6_send_response instead of passing it as an argument
In reply to Christoph Paasch--- net/ipv6/tcp_ipv6.c | 106 ++++++++++++++++++++++++++-------------------------- 1 file changed, 53 insertions(+), 53 deletions(-)
net/ipv6/tcp_ipv6.c +53 -53
@@ -775,8 +775,7 @@ static const struct tcp_request_sock_ops tcp_request_sock_ipv6_ops = {static void tcp_v6_send_response (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr, -int oif,struct tcp_md5sig_key *key,int rst, -u8 tclass,__be32 label) +int oif,int rst,u8 tclass,__be32 label) {const struct tcphdr *th =tcp_hdr (skb);struct tcphdr *t1;
@@ -789,6 +788,12 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct dst_entry *dst;__be32 *topt; +#ifdef CONFIG_TCP_MD5SIG +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +struct ipv6hdr *ipv6h =ipv6_hdr (skb); +#endif + buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)
@@ -822,6 +827,48 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 }#ifdef CONFIG_TCP_MD5SIG +rcu_read_lock (); + hash_location =tcp_parse_md5sig_option (th); +if (sk &&sk_fullsock (sk)) { + key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); + }else if (sk && sk->sk_state ==TCP_TIME_WAIT ) { +struct tcp_timewait_sock *tcptw =tcp_twsk (sk); + + key =tcp_twsk_md5_key (tcptw); + }else if (sk && sk->sk_state ==TCP_NEW_SYN_RECV ) { + key =tcp_v6_md5_do_lookup (sk, &ipv6h->daddr); + }else if (hash_location) { +unsigned char newhash[16 ]; +struct sock *sk1 =NULL ; +int genhash; + +/* active side is lost. Try to find listening socket through +* source port, and then find md5 key through listening socket. +* we are not loose security here: +* Incoming packet is checked with md5 hash with finding key, +* no RST generated if md5 hash doesn't match. +*/ + sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), + &tcp_hashinfo,NULL ,0 , + &ipv6h->saddr, + th->source, &ipv6h->daddr, +ntohs (th->source),tcp_v6_iif (skb), +tcp_v6_sdif (skb)); +if (!sk1) + goto go_on; + + key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); +if (!key) + goto go_on; + + genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto go_on; + } + +go_on: +rcu_read_unlock (); +if (key) { *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG );
@@ -882,14 +929,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) {const struct tcphdr *th =tcp_hdr (skb);u32 seq =0 , ack_seq =0 ; -struct tcp_md5sig_key *key =NULL ; -#ifdef CONFIG_TCP_MD5SIG -const __u8 *hash_location =NULL ; -struct ipv6hdr *ipv6h =ipv6_hdr (skb); -unsigned char newhash[16 ]; -int genhash; -struct sock *sk1 =NULL ; -#endif int oif;if (th->rst)
@@ -901,38 +940,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb)if (!sk && !ipv6_unicast_destination (skb))return ; -#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); - }else if (hash_location) { -/* -* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), - &tcp_hashinfo,NULL ,0 , - &ipv6h->saddr, - th->source, &ipv6h->daddr, -ntohs (th->source),tcp_v6_iif (skb), -tcp_v6_sdif (skb)); -if (!sk1) - goto out; - - key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); -if (!key) - goto out; - - genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto out; - } -#endif -if (th->ack) seq =ntohl (th->ack_seq);else
@@ -940,20 +947,14 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) (th->doff <<2 ); oif = sk ? sk->sk_bound_dev_if :0 ; -tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif, key,1 ,0 ,0 ); - -#ifdef CONFIG_TCP_MD5SIG -out: -rcu_read_unlock (); -#endif +tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif,1 ,0 ,0 ); }static void tcp_v6_send_ack (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr,int oif, -struct tcp_md5sig_key *key,u8 tclass, -__be32 label) +u8 tclass,__be32 label) { -tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif, key,0 , +tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif,0 , tclass, label); }
@@ -965,7 +966,7 @@ static void tcp_v6_timewait_ack(struct sock *sk, struct sk_buff *skb)tcp_v6_send_ack (sk, skb, tcptw->tw_snd_nxt, tcptw->tw_rcv_nxt, tcptw->tw_rcv_wnd >> tw->tw_rcv_wscale,tcp_time_stamp_raw () + tcptw->tw_ts_offset, - tcptw->tw_ts_recent, tw->tw_bound_dev_if,tcp_twsk_md5_key (tcptw), + tcptw->tw_ts_recent, tw->tw_bound_dev_if, tw->tw_tclass,cpu_to_be32 (tw->tw_flowlabel));inet_twsk_put (tw);
@@ -988,7 +989,6 @@ static void tcp_v6_reqsk_send_ack(const struct sock *sk, struct sk_buff *skb, req->rsk_rcv_wnd >>inet_rsk (req)->rcv_wscale,tcp_time_stamp_raw () +tcp_rsk (req)->ts_off, req->ts_recent, sk->sk_bound_dev_if, -tcp_v6_md5_do_lookup (sk, &ipv6_hdr (skb)->daddr), 0, 0); }
Signature · 1 line
2.14.1
Mat Martineau
Re: [MPTCP] [PATCH 13/18] tcp_md5: Detect key inside tcp_v6_send_response instead of passing it as an argument
Quoted 63 lines · Christoph Paasch
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
net/ipv6/tcp_ipv6.c| 106 ++++++++++++++++++++++++++--------------------------1 file changed, 53 insertions(+), 53 deletions(-)net/ipv6/tcp_ipv6.c +34
-2@@ -775,8 +775,7 @@ static const struct tcp_request_sock_ops tcp_request_sock_ipv6_ops = {static void tcp_v6_send_response (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr, -int oif,struct tcp_md5sig_key *key,int rst, -u8 tclass,__be32 label) +int oif,int rst,u8 tclass,__be32 label) {const struct tcphdr *th =tcp_hdr (skb);struct tcphdr *t1;@@ -789,6 +788,12 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct dst_entry *dst;__be32 *topt; +#ifdef CONFIG_TCP_MD5SIG +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +struct ipv6hdr *ipv6h =ipv6_hdr (skb); +#endif + buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -822,6 +827,48 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 } #ifdef CONFIG_TCP_MD5SIG + rcu_read_lock(); + hash_location = tcp_parse_md5sig_option(th); + if (sk && sk_fullsock(sk)) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->saddr); + } else if (sk && sk->sk_state == TCP_TIME_WAIT) { + struct tcp_timewait_sock *tcptw = tcp_twsk(sk); + + key = tcp_twsk_md5_key(tcptw); + } else if (sk && sk->sk_state == TCP_NEW_SYN_RECV) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->daddr); + } else if (hash_location) { + unsigned char newhash[16]; + struct sock *sk1 = NULL; + int genhash; + + /* active side is lost. Try to find listening socket through + * source port, and then find md5 key through listening socket. + * we are not loose security here: + * Incoming packet is checked with md5 hash with finding key, + * no RST generated if md5 hash doesn't match. + */ + sk1 = inet6_lookup_listener(dev_net(skb_dst(skb)->dev), + &tcp_hashinfo, NULL, 0, + &ipv6h->saddr, + th->source, &ipv6h->daddr, + ntohs(th->source), tcp_v6_iif(skb), + tcp_v6_sdif(skb));
net/ipv6/tcp_ipv6.c static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 · line 866
Quoted 10 lines
net/ipv6/tcp_ipv6.c +10
-0+if (!sk1) + goto go_on; + + key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); +if (!key) + goto go_on; + + genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto go_on;
I see where this came from in tcp_v6_send_reset(), but the pasted code doesn't preserve the same behavior (and the goto does nothing, so the conditional does nothing). I haven't looked ahead yet to see if it gets fixed up in a later patch, but it seems like the intent is for these patches to be bisectable.
Mat
Quoted 107 lines
net/ipv6/tcp_ipv6.c +9
-51+ } + +go_on: +rcu_read_unlock (); +if (key) { *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG );@@ -882,14 +929,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) {const struct tcphdr *th =tcp_hdr (skb);u32 seq =0 , ack_seq =0 ; -struct tcp_md5sig_key *key =NULL ; -#ifdef CONFIG_TCP_MD5SIG -const __u8 *hash_location =NULL ; -struct ipv6hdr *ipv6h =ipv6_hdr (skb); -unsigned char newhash[16 ]; -int genhash; -struct sock *sk1 =NULL ; -#endif int oif;if (th->rst)@@ -901,38 +940,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb)if (!sk && !ipv6_unicast_destination (skb))return ; -#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); - }else if (hash_location) { -/* -* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), - &tcp_hashinfo,NULL ,0 , - &ipv6h->saddr, - th->source, &ipv6h->daddr, -ntohs (th->source),tcp_v6_iif (skb), -tcp_v6_sdif (skb)); -if (!sk1) - goto out; - - key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); -if (!key) - goto out; - - genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto out; - } -#endif -if (th->ack) seq =ntohl (th->ack_seq);else @@ -940,20 +947,14 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) (th->doff <<2 ); oif = sk ? sk->sk_bound_dev_if :0 ; -tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif, key,1 ,0 ,0 ); - -#ifdef CONFIG_TCP_MD5SIG -out: -rcu_read_unlock (); -#endif +tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif,1 ,0 ,0 ); }static void tcp_v6_send_ack (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr,int oif, -struct tcp_md5sig_key *key,u8 tclass, -__be32 label) +u8 tclass,__be32 label) { -tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif, key,0 , +tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif,0 , tclass, label); }@@ -965,7 +966,7 @@ static void tcp_v6_timewait_ack(struct sock *sk, struct sk_buff *skb)tcp_v6_send_ack (sk, skb, tcptw->tw_snd_nxt, tcptw->tw_rcv_nxt, tcptw->tw_rcv_wnd >> tw->tw_rcv_wscale,tcp_time_stamp_raw () + tcptw->tw_ts_offset, - tcptw->tw_ts_recent, tw->tw_bound_dev_if,tcp_twsk_md5_key (tcptw), + tcptw->tw_ts_recent, tw->tw_bound_dev_if, tw->tw_tclass,cpu_to_be32 (tw->tw_flowlabel));inet_twsk_put (tw);@@ -988,7 +989,6 @@ static void tcp_v6_reqsk_send_ack(const struct sock *sk, struct sk_buff *skb, req->rsk_rcv_wnd >>inet_rsk (req)->rcv_wscale,tcp_time_stamp_raw () +tcp_rsk (req)->ts_off, req->ts_recent, sk->sk_bound_dev_if, -tcp_v6_md5_do_lookup (sk, &ipv6_hdr (skb)->daddr), 0, 0); }Signature · 1 line
2.14.1
--
Mat Martineau
Intel OTC
Christoph Paasch
Re: [MPTCP] [PATCH 13/18] tcp_md5: Detect key inside tcp_v6_send_response instead of passing it as an argument
Quoted 71 lines · Mat Martineau
Quoted 68 lines · Christoph Paasch
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
net/ipv6/tcp_ipv6.c| 106 ++++++++++++++++++++++++++--------------------------1 file changed, 53 insertions(+), 53 deletions(-)net/ipv6/tcp_ipv6.c +39
-2@@ -775,8 +775,7 @@ static const struct tcp_request_sock_ops tcp_request_sock_ipv6_ops = {static void tcp_v6_send_response (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr, -int oif,struct tcp_md5sig_key *key,int rst, -u8 tclass,__be32 label) +int oif,int rst,u8 tclass,__be32 label) {const struct tcphdr *th =tcp_hdr (skb);struct tcphdr *t1;@@ -789,6 +788,12 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct dst_entry *dst;__be32 *topt; +#ifdef CONFIG_TCP_MD5SIG +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +struct ipv6hdr *ipv6h =ipv6_hdr (skb); +#endif + buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -822,6 +827,48 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 } #ifdef CONFIG_TCP_MD5SIG + rcu_read_lock(); + hash_location = tcp_parse_md5sig_option(th); + if (sk && sk_fullsock(sk)) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->saddr); + } else if (sk && sk->sk_state == TCP_TIME_WAIT) { + struct tcp_timewait_sock *tcptw = tcp_twsk(sk); + + key = tcp_twsk_md5_key(tcptw); + } else if (sk && sk->sk_state == TCP_NEW_SYN_RECV) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->daddr); + } else if (hash_location) { + unsigned char newhash[16]; + struct sock *sk1 = NULL; + int genhash; + + /* active side is lost. Try to find listening socket through + * source port, and then find md5 key through listening socket. + * we are not loose security here: + * Incoming packet is checked with md5 hash with finding key, + * no RST generated if md5 hash doesn't match. + */ + sk1 = inet6_lookup_listener(dev_net(skb_dst(skb)->dev), + &tcp_hashinfo, NULL, 0, + &ipv6h->saddr, + th->source, &ipv6h->daddr, + ntohs(th->source), tcp_v6_iif(skb), + tcp_v6_sdif(skb)); + if (!sk1) + goto go_on; + + key = tcp_v6_md5_do_lookup(sk1, &ipv6h->saddr); + if (!key)
Quoted 8 lines
net/ipv6/tcp_ipv6.c static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 · line 866
Quoted 5 lines
net/ipv6/tcp_ipv6.c +5
-0+ goto go_on; + + genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto go_on;I see where this came from in
tcp_v6_send_reset(), but the pasted code doesn't preserve the same behavior
Which part are you worried about here? Which behavior would change?
Quoted 2 lines
(and the goto does nothing, so the
conditional does nothing).
True, this goto here is not necessary.
Christoph
Quoted 119 lines
I haven't looked ahead yet to see if it gets
fixed up in a later patch, but it seems like the intent is for these patches to be bisectable.Mat
Quoted 107 lines
net/ipv6/tcp_ipv6.c +9
-51+ } + +go_on: +rcu_read_unlock (); +if (key) { *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG );@@ -882,14 +929,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) {const struct tcphdr *th =tcp_hdr (skb);u32 seq =0 , ack_seq =0 ; -struct tcp_md5sig_key *key =NULL ; -#ifdef CONFIG_TCP_MD5SIG -const __u8 *hash_location =NULL ; -struct ipv6hdr *ipv6h =ipv6_hdr (skb); -unsigned char newhash[16 ]; -int genhash; -struct sock *sk1 =NULL ; -#endif int oif;if (th->rst)@@ -901,38 +940,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb)if (!sk && !ipv6_unicast_destination (skb))return ; -#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); - }else if (hash_location) { -/* -* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), - &tcp_hashinfo,NULL ,0 , - &ipv6h->saddr, - th->source, &ipv6h->daddr, -ntohs (th->source),tcp_v6_iif (skb), -tcp_v6_sdif (skb)); -if (!sk1) - goto out; - - key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); -if (!key) - goto out; - - genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto out; - } -#endif -if (th->ack) seq =ntohl (th->ack_seq);else @@ -940,20 +947,14 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) (th->doff <<2 ); oif = sk ? sk->sk_bound_dev_if :0 ; -tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif, key,1 ,0 ,0 ); - -#ifdef CONFIG_TCP_MD5SIG -out: -rcu_read_unlock (); -#endif +tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif,1 ,0 ,0 ); }static void tcp_v6_send_ack (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr,int oif, -struct tcp_md5sig_key *key,u8 tclass, -__be32 label) +u8 tclass,__be32 label) { -tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif, key,0 , +tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif,0 , tclass, label); }@@ -965,7 +966,7 @@ static void tcp_v6_timewait_ack(struct sock *sk, struct sk_buff *skb)tcp_v6_send_ack (sk, skb, tcptw->tw_snd_nxt, tcptw->tw_rcv_nxt, tcptw->tw_rcv_wnd >> tw->tw_rcv_wscale,tcp_time_stamp_raw () + tcptw->tw_ts_offset, - tcptw->tw_ts_recent, tw->tw_bound_dev_if,tcp_twsk_md5_key (tcptw), + tcptw->tw_ts_recent, tw->tw_bound_dev_if, tw->tw_tclass,cpu_to_be32 (tw->tw_flowlabel));inet_twsk_put (tw);@@ -988,7 +989,6 @@ static void tcp_v6_reqsk_send_ack(const struct sock *sk, struct sk_buff *skb, req->rsk_rcv_wnd >>inet_rsk (req)->rcv_wscale,tcp_time_stamp_raw () +tcp_rsk (req)->ts_off, req->ts_recent, sk->sk_bound_dev_if, -tcp_v6_md5_do_lookup (sk, &ipv6_hdr (skb)->daddr), 0, 0); }Signature · 1 line
2.14.1--
Mat Martineau
Intel OTC
Mat Martineau
Re: [MPTCP] [PATCH 13/18] tcp_md5: Detect key inside tcp_v6_send_response instead of passing it as an argument
Quoted 81 lines · Christoph Paasch
Quoted 71 lines · Mat Martineau
Quoted 68 lines · Christoph Paasch
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
net/ipv6/tcp_ipv6.c| 106 ++++++++++++++++++++++++++--------------------------1 file changed, 53 insertions(+), 53 deletions(-)net/ipv6/tcp_ipv6.c +39
-2@@ -775,8 +775,7 @@ static const struct tcp_request_sock_ops tcp_request_sock_ipv6_ops = {static void tcp_v6_send_response (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr, -int oif,struct tcp_md5sig_key *key,int rst, -u8 tclass,__be32 label) +int oif,int rst,u8 tclass,__be32 label) {const struct tcphdr *th =tcp_hdr (skb);struct tcphdr *t1;@@ -789,6 +788,12 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct dst_entry *dst;__be32 *topt; +#ifdef CONFIG_TCP_MD5SIG +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +struct ipv6hdr *ipv6h =ipv6_hdr (skb); +#endif + buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -822,6 +827,48 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 } #ifdef CONFIG_TCP_MD5SIG + rcu_read_lock(); + hash_location = tcp_parse_md5sig_option(th); + if (sk && sk_fullsock(sk)) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->saddr); + } else if (sk && sk->sk_state == TCP_TIME_WAIT) { + struct tcp_timewait_sock *tcptw = tcp_twsk(sk); + + key = tcp_twsk_md5_key(tcptw); + } else if (sk && sk->sk_state == TCP_NEW_SYN_RECV) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->daddr); + } else if (hash_location) { + unsigned char newhash[16]; + struct sock *sk1 = NULL; + int genhash; + + /* active side is lost. Try to find listening socket through + * source port, and then find md5 key through listening socket. + * we are not loose security here: + * Incoming packet is checked with md5 hash with finding key, + * no RST generated if md5 hash doesn't match. + */ + sk1 = inet6_lookup_listener(dev_net(skb_dst(skb)->dev), + &tcp_hashinfo, NULL, 0, + &ipv6h->saddr, + th->source, &ipv6h->daddr, + ntohs(th->source), tcp_v6_iif(skb), + tcp_v6_sdif(skb)); + if (!sk1) + goto go_on; + + key = tcp_v6_md5_do_lookup(sk1, &ipv6h->saddr); + if (!key)Quoted 8 lines
net/ipv6/tcp_ipv6.c static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 · line 866
Quoted 5 lines
net/ipv6/tcp_ipv6.c +5
-0+ goto go_on; + + genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto go_on;I see where this came from in
tcp_v6_send_reset(), but the pasted code doesn't preserve the same behavior
Quoted 1 line
Which part are you worried about here? Which behavior would change?
The gotos in the original code skipped tcp_v6_send_response() altogether. Now a response is sent even if the md5 hash fails or is a mismatch.
Mat
Quoted 120 lines
Quoted 3 lines
(and the goto does nothing, so the
conditional does nothing).True, this goto here is not necessary.
Christoph
Quoted 111 lines
I haven't looked ahead yet to see if it gets
fixed up in a later patch, but it seems like the intent is for these patches to be bisectable.Mat
Quoted 103 lines
net/ipv6/tcp_ipv6.c +9
-51+ } + +go_on: +rcu_read_unlock (); +if (key) { *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG );@@ -882,14 +929,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) {const struct tcphdr *th =tcp_hdr (skb);u32 seq =0 , ack_seq =0 ; -struct tcp_md5sig_key *key =NULL ; -#ifdef CONFIG_TCP_MD5SIG -const __u8 *hash_location =NULL ; -struct ipv6hdr *ipv6h =ipv6_hdr (skb); -unsigned char newhash[16 ]; -int genhash; -struct sock *sk1 =NULL ; -#endif int oif;if (th->rst)@@ -901,38 +940,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb)if (!sk && !ipv6_unicast_destination (skb))return ; -#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); - }else if (hash_location) { -/* -* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), - &tcp_hashinfo,NULL ,0 , - &ipv6h->saddr, - th->source, &ipv6h->daddr, -ntohs (th->source),tcp_v6_iif (skb), -tcp_v6_sdif (skb)); -if (!sk1) - goto out; - - key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); -if (!key) - goto out; - - genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto out; - } -#endif -if (th->ack) seq =ntohl (th->ack_seq);else @@ -940,20 +947,14 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) (th->doff <<2 ); oif = sk ? sk->sk_bound_dev_if :0 ; -tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif, key,1 ,0 ,0 ); - -#ifdef CONFIG_TCP_MD5SIG -out: -rcu_read_unlock (); -#endif +tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif,1 ,0 ,0 ); }static void tcp_v6_send_ack (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr,int oif, -struct tcp_md5sig_key *key,u8 tclass, -__be32 label) +u8 tclass,__be32 label) { -tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif, key,0 , +tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif,0 , tclass, label); }@@ -965,7 +966,7 @@ static void tcp_v6_timewait_ack(struct sock *sk, struct sk_buff *skb)tcp_v6_send_ack (sk, skb, tcptw->tw_snd_nxt, tcptw->tw_rcv_nxt, tcptw->tw_rcv_wnd >> tw->tw_rcv_wscale,tcp_time_stamp_raw () + tcptw->tw_ts_offset, - tcptw->tw_ts_recent, tw->tw_bound_dev_if,tcp_twsk_md5_key (tcptw), + tcptw->tw_ts_recent, tw->tw_bound_dev_if, tw->tw_tclass,cpu_to_be32 (tw->tw_flowlabel));inet_twsk_put (tw);@@ -988,7 +989,6 @@ static void tcp_v6_reqsk_send_ack(const struct sock *sk, struct sk_buff *skb, req->rsk_rcv_wnd >>inet_rsk (req)->rcv_wscale,tcp_time_stamp_raw () +tcp_rsk (req)->ts_off, req->ts_recent, sk->sk_bound_dev_if, -tcp_v6_md5_do_lookup (sk, &ipv6_hdr (skb)->daddr), 0, 0); }
Quoted 4 lines
Quoted 4 lines
Quoted 4 lines
--
2.14.1
--
Mat Martineau
Intel OTC
Christoph Paasch
Re: [MPTCP] [PATCH 13/18] tcp_md5: Detect key inside tcp_v6_send_response instead of passing it as an argument
Quoted 83 lines · Mat Martineau
Quoted 81 lines · Christoph Paasch
Quoted 79 lines · Mat Martineau
Quoted 63 lines · Christoph Paasch
Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
net/ipv6/tcp_ipv6.c| 106 ++++++++++++++++++++++++++--------------------------1 file changed, 53 insertions(+), 53 deletions(-)net/ipv6/tcp_ipv6.c +34
-2@@ -775,8 +775,7 @@ static const struct tcp_request_sock_ops tcp_request_sock_ipv6_ops = {static void tcp_v6_send_response (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr, -int oif,struct tcp_md5sig_key *key,int rst, -u8 tclass,__be32 label) +int oif,int rst,u8 tclass,__be32 label) {const struct tcphdr *th =tcp_hdr (skb);struct tcphdr *t1;@@ -789,6 +788,12 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct dst_entry *dst;__be32 *topt; +#ifdef CONFIG_TCP_MD5SIG +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +struct ipv6hdr *ipv6h =ipv6_hdr (skb); +#endif + buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -822,6 +827,48 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 } #ifdef CONFIG_TCP_MD5SIG + rcu_read_lock(); + hash_location = tcp_parse_md5sig_option(th); + if (sk && sk_fullsock(sk)) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->saddr); + } else if (sk && sk->sk_state == TCP_TIME_WAIT) { + struct tcp_timewait_sock *tcptw = tcp_twsk(sk); + + key = tcp_twsk_md5_key(tcptw); + } else if (sk && sk->sk_state == TCP_NEW_SYN_RECV) { + key = tcp_v6_md5_do_lookup(sk, &ipv6h->daddr); + } else if (hash_location) { + unsigned char newhash[16]; + struct sock *sk1 = NULL; + int genhash; + + /* active side is lost. Try to find listening socket through + * source port, and then find md5 key through listening socket. + * we are not loose security here: + * Incoming packet is checked with md5 hash with finding key, + * no RST generated if md5 hash doesn't match. + */ + sk1 = inet6_lookup_listener(dev_net(skb_dst(skb)->dev), + &tcp_hashinfo, NULL, 0, + &ipv6h->saddr, + th->source, &ipv6h->daddr, + ntohs(th->source), tcp_v6_iif(skb), + tcp_v6_sdif(skb));net/ipv6/tcp_ipv6.c static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 · line 866
Quoted 10 lines
net/ipv6/tcp_ipv6.c +10
-0+if (!sk1) + goto go_on; + + key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); +if (!key) + goto go_on; + + genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto go_on;I see where this came from in
tcp_v6_send_reset(), but the pasted code doesn't preserve the same behavior
Quoted 4 lines
Quoted 1 line
Which part are you worried about here? Which behavior would change?
The gotos in the original code skipped
tcp_v6_send_response()altogether. Now a response is sent even if the md5 hash fails or is a mismatch.
Oh, you're right. Thanks for spotting this. I will update this in my v2 as well.
Christoph
Quoted 131 lines
Mat
Quoted 120 lines
Quoted 3 lines
(and the goto does nothing, so the
conditional does nothing).True, this goto here is not necessary.
Christoph
Quoted 111 lines
I haven't looked ahead yet to see if it gets
fixed up in a later patch, but it seems like the intent is for these patches to be bisectable.Mat
Quoted 103 lines
net/ipv6/tcp_ipv6.c +9
-51+ } + +go_on: +rcu_read_unlock (); +if (key) { *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG );@@ -882,14 +929,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) {const struct tcphdr *th =tcp_hdr (skb);u32 seq =0 , ack_seq =0 ; -struct tcp_md5sig_key *key =NULL ; -#ifdef CONFIG_TCP_MD5SIG -const __u8 *hash_location =NULL ; -struct ipv6hdr *ipv6h =ipv6_hdr (skb); -unsigned char newhash[16 ]; -int genhash; -struct sock *sk1 =NULL ; -#endif int oif;if (th->rst)@@ -901,38 +940,6 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb)if (!sk && !ipv6_unicast_destination (skb))return ; -#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); - }else if (hash_location) { -/* -* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), - &tcp_hashinfo,NULL ,0 , - &ipv6h->saddr, - th->source, &ipv6h->daddr, -ntohs (th->source),tcp_v6_iif (skb), -tcp_v6_sdif (skb)); -if (!sk1) - goto out; - - key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); -if (!key) - goto out; - - genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto out; - } -#endif -if (th->ack) seq =ntohl (th->ack_seq);else @@ -940,20 +947,14 @@ static void tcp_v6_send_reset(const struct sock *sk, struct sk_buff *skb) (th->doff <<2 ); oif = sk ? sk->sk_bound_dev_if :0 ; -tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif, key,1 ,0 ,0 ); - -#ifdef CONFIG_TCP_MD5SIG -out: -rcu_read_unlock (); -#endif +tcp_v6_send_response (sk, skb, seq, ack_seq,0 ,0 ,0 , oif,1 ,0 ,0 ); }static void tcp_v6_send_ack (const struct sock *sk,struct sk_buff *skb,u32 seq,u32 ack,u32 win,u32 tsval,u32 tsecr,int oif, -struct tcp_md5sig_key *key,u8 tclass, -__be32 label) +u8 tclass,__be32 label) { -tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif, key,0 , +tcp_v6_send_response (sk, skb, seq, ack, win, tsval, tsecr, oif,0 , tclass, label); }@@ -965,7 +966,7 @@ static void tcp_v6_timewait_ack(struct sock *sk, struct sk_buff *skb)tcp_v6_send_ack (sk, skb, tcptw->tw_snd_nxt, tcptw->tw_rcv_nxt, tcptw->tw_rcv_wnd >> tw->tw_rcv_wscale,tcp_time_stamp_raw () + tcptw->tw_ts_offset, - tcptw->tw_ts_recent, tw->tw_bound_dev_if,tcp_twsk_md5_key (tcptw), + tcptw->tw_ts_recent, tw->tw_bound_dev_if, tw->tw_tclass,cpu_to_be32 (tw->tw_flowlabel));inet_twsk_put (tw);@@ -988,7 +989,6 @@ static void tcp_v6_reqsk_send_ack(const struct sock *sk, struct sk_buff *skb, req->rsk_rcv_wnd >>inet_rsk (req)->rcv_wscale,tcp_time_stamp_raw () +tcp_rsk (req)->ts_off, req->ts_recent, sk->sk_bound_dev_if, -tcp_v6_md5_do_lookup (sk, &ipv6_hdr (skb)->daddr), 0, 0); }Quoted 4 lines
Quoted 4 lines
Quoted 4 lines
--
2.14.1--
Mat Martineau
Intel OTC
Christoph Paasch
PATCH 14/18 tcp_md5: Check for TCP_MD5 after TCP Timestamps in tcp_established_options
In reply to Christoph PaaschIt really does not matter, because we never use TCP timestamps when TCP_MD5 is enabled (see tcp_syn_options).
Moving TCP_MD5 a bit lower allows for easier adoption of the tcp_extra_option framework.
--- net/ipv4/tcp_output.c | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-)
net/ipv4/tcp_output.c +7 -7
@@ -683,6 +683,13 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skb opts->options =0 ; +if (likely (tp->rx_opt.tstamp_ok)) { + opts->options |=OPTION_TS ; + opts->tsval = skb ?tcp_skb_timestamp (skb) + tp->tsoffset :0 ; + opts->tsecr = tp->rx_opt.ts_recent; + size +=TCPOLEN_TSTAMP_ALIGNED ; + } +#ifdef CONFIG_TCP_MD5SIG *md5 = tp->af_specific->md5_lookup (sk, sk);if (unlikely (*md5)) {
@@ -693,13 +700,6 @@ static unsigned int tcp_established_options(struct sock *sk, struct sk_buff *skb *md5 =NULL ;#endif -if (likely (tp->rx_opt.tstamp_ok)) { - opts->options |=OPTION_TS ; - opts->tsval = skb ?tcp_skb_timestamp (skb) + tp->tsoffset :0 ; - opts->tsecr = tp->rx_opt.ts_recent; - size +=TCPOLEN_TSTAMP_ALIGNED ; - } -if (static_branch_unlikely (&tcp_extra_options_enabled)) size += tcp_extra_options_prepare(skb, 0, MAX_TCP_OPTION_SPACE - size,
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 15/18 tcp: Move TCP-MD5 code out of TCP itself
In reply to Christoph PaaschThis is all just copy-pasting the TCP_MD5-code into functions that are placed in net/ipv4/tcp_md5.c.
--- include/linux/inet_diag.h | 1 + include/linux/tcp_md5.h | 129 ++++++ include/net/tcp.h | 77 ---- net/ipv4/Makefile | 1 + net/ipv4/tcp.c | 133 +----- net/ipv4/tcp_diag.c | 81 +--- net/ipv4/tcp_input.c | 38 -- net/ipv4/tcp_ipv4.c | 498 +-------------------- net/ipv4/tcp_md5.c | 1080 +++++++++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_minisocks.c | 27 +- net/ipv4/tcp_output.c | 4 +- net/ipv6/tcp_ipv6.c | 313 +------------ 12 files changed, 1234 insertions(+), 1148 deletions(-) create mode 100644 include/linux/tcp_md5.h create mode 100644 net/ipv4/tcp_md5.c
include/linux/inet_diag.h +1 -0
@@ -1,6 +1,7 @@#ifndef _INET_DIAG_H_#define _INET_DIAG_H_ 1 +#include <linux/user_namespace.h> #include <uapi/linux/inet_diag.h> struct net ;
include/linux/tcp_md5.h new file +129 -0
129 lines not on this page · raw message
include/net/tcp.h +0 -77
95 lines not on this page · raw message
net/ipv4/Makefile +1 -0
@@ -60,6 +60,7 @@ obj-$(CONFIG_TCP_CONG_LP) += tcp_lp.o obj-$(CONFIG_TCP_CONG_YEAH) += tcp_yeah.o obj-$(CONFIG_TCP_CONG_ILLINOIS) += tcp_illinois.o obj-$(CONFIG_NETLABEL) += cipso_ipv4.o +obj-$(CONFIG_TCP_MD5SIG) += tcp_md5.o obj-$(CONFIG_XFRM) += xfrm4_policy.o xfrm4_state.o xfrm4_input.o \ xfrm4_output.o xfrm4_protocol.o
net/ipv4/tcp.c +1 -132
145 lines not on this page · raw message
net/ipv4/tcp_diag.c +6 -75
103 lines not on this page · raw message
net/ipv4/tcp_input.c +0 -38
@@ -3887,44 +3887,6 @@ static bool tcp_fast_parse_options(const struct net *net,return true; } -#ifdef CONFIG_TCP_MD5SIG -/* -* Parse MD5 Signature option -*/ -const u8 *tcp_parse_md5sig_option (const struct tcphdr *th) -{ -int length = (th->doff <<2 ) -sizeof (*th); -const u8 *ptr = (const u8 *)(th +1 ); - -/* If the TCP option is too short, we can short cut */ -if (length <TCPOLEN_MD5SIG ) -return NULL ; - -while (length >0 ) { -int opcode = *ptr++; -int opsize; - -switch (opcode) { -case TCPOPT_EOL : -return NULL ; -case TCPOPT_NOP : - length--; -continue ; -default : - opsize = *ptr++; -if (opsize <2 || opsize > length) -return NULL ; -if (opcode ==TCPOPT_MD5SIG ) -return opsize ==TCPOLEN_MD5SIG ? ptr :NULL ; - } - ptr += opsize -2 ; - length -= opsize; - } -return NULL ; -} -EXPORT_SYMBOL (tcp_parse_md5sig_option); -#endif -/* Sorry, PAWS as specified is broken wrt. pure-ACKs -DaveM * * It is not fatal. If this ACK does _not_ change critical state (seqs, window)
net/ipv4/tcp_ipv4.c +7 -491
570 lines not on this page · raw message
net/ipv4/tcp_md5.c new file +1080 -0
1,080 lines not on this page · raw message
net/ipv4/tcp_minisocks.c +4 -23
@@ -22,6 +22,7 @@#include <linux/module.h> #include <linux/slab.h> #include <linux/sysctl.h> +#include <linux/tcp_md5.h> #include <linux/workqueue.h> #include <net/tcp.h> #include <net/inet_common.h>
@@ -286,22 +287,7 @@ void tcp_time_wait(struct sock *sk, int state, int timeo)#endif #ifdef CONFIG_TCP_MD5SIG -/* -* The timewait bucket does not have the key DB from the -* sock structure. We just make a quick copy of the -* md5 key being used (if indeed we are using one) -* so the timewait ack generating code has the key. -*/ -do { -struct tcp_md5sig_key *key; - tcptw->tw_md5_key =NULL ; - key = tp->af_specific->md5_lookup (sk, sk); -if (key) { - tcptw->tw_md5_key =kmemdup (key,sizeof (*key),GFP_ATOMIC ); -if (tcptw->tw_md5_key && !tcp_alloc_md5sig_pool ()) -BUG (); - } - }while (0 ); +tcp_md5_time_wait (sk, tw);#endif /* Get the TIME_WAIT timeout firing. */
@@ -331,10 +317,7 @@ void tcp_time_wait(struct sock *sk, int state, int timeo)void tcp_twsk_destructor (struct sock *sk) {#ifdef CONFIG_TCP_MD5SIG -struct tcp_timewait_sock *twsk =tcp_twsk (sk); - -if (twsk->tw_md5_key) -kfree_rcu (twsk->tw_md5_key, rcu); +tcp_md5_twsk_destructor (sk);#endif }EXPORT_SYMBOL_GPL (tcp_twsk_destructor);
@@ -521,9 +504,7 @@ struct sock *tcp_create_openreq_child(const struct sock *sk, } newtp->tsoffset = treq->ts_off;#ifdef CONFIG_TCP_MD5SIG - newtp->md5sig_info =NULL ;/*XXX*/ -if (newtp->af_specific->md5_lookup (sk, newsk)) - newtp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +tcp_md5_add_header_len (sk, newsk);#endif if (static_branch_unlikely (&tcp_extra_options_enabled)) newtp->tcp_header_len +=tcp_extra_options_add_header (sk, newsk);
net/ipv4/tcp_output.c +2 -2
@@ -42,6 +42,7 @@#include <linux/gfp.h> #include <linux/module.h> #include <linux/static_key.h> +#include <linux/tcp_md5.h> /* People can turn this off for buggy TCP's found in printers etc. */ int sysctl_tcp_retrans_collapse__read_mostly =1 ;
@@ -3249,8 +3250,7 @@ static void tcp_connect_init(struct sock *sk) tp->tcp_header_len +=TCPOLEN_TSTAMP_ALIGNED ;#ifdef CONFIG_TCP_MD5SIG -if (tp->af_specific->md5_lookup (sk, sk)) - tp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +tcp_md5_add_header_len (sk, sk);#endif if (static_branch_unlikely (&tcp_extra_options_enabled))
net/ipv6/tcp_ipv6.c +3 -310
367 lines not on this page · raw message
Signature · 1 line
2.14.1
Mat Martineau
Re: [MPTCP] [PATCH 15/18] tcp: Move TCP-MD5 code out of TCP itself
Quoted 1,840 lines · Christoph Paasch
This is all just copy-pasting the TCP_MD5-code into functions that are placed in
net/ipv4/tcp_md5.c.Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
include/linux/inet_diag.h | 1 + include/linux/tcp_md5.h | 129 ++++++ include/net/tcp.h | 77 ---- net/ipv4/Makefile | 1 + net/ipv4/tcp.c | 133 +----- net/ipv4/tcp_diag.c | 81 +--- net/ipv4/tcp_input.c | 38 -- net/ipv4/tcp_ipv4.c | 498 +-------------------- net/ipv4/tcp_md5.c | 1080 +++++++++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_minisocks.c | 27 +- net/ipv4/tcp_output.c | 4 +- net/ipv6/tcp_ipv6.c | 313 +------------ 12 files changed, 1234 insertions(+), 1148 deletions(-)create mode 100644
include/linux/tcp_md5.h
create mode 100644net/ipv4/tcp_md5.cinclude/linux/inet_diag.h +1
-0@@ -1,6 +1,7 @@#ifndef _INET_DIAG_H_#define _INET_DIAG_H_ 1 +#include <linux/user_namespace.h> #include <uapi/linux/inet_diag.h> struct net ;include/linux/tcp_md5.h new file +129
-0@@ -0,0 +1,129 @@ +#ifndef _LINUX_TCP_MD5_H +#define _LINUX_TCP_MD5_H + +#ifdef CONFIG_TCP_MD5SIG + +#include <linux/types.h> + +#include <net/tcp.h> + +union tcp_md5_addr { +struct in_addr a4; +#if IS_ENABLED (CONFIG_IPV6 ) +struct in6_addr a6; +#endif +}; + +/* - key database */ +struct tcp_md5sig_key { +struct hlist_node node; +u8 keylen; +u8 family;/* AF_INET or AF_INET6 */ +union tcp_md5_addr addr; +u8 prefixlen; +u8 key[TCP_MD5SIG_MAXKEYLEN ]; +struct rcu_head rcu; +}; + +/* - sock block */ +struct tcp_md5sig_info { +struct hlist_head head; +struct rcu_head rcu; +}; + +union tcp_md5sum_block { +struct tcp4_pseudohdr ip4; +#if IS_ENABLED (CONFIG_IPV6 ) +struct tcp6_pseudohdr ip6; +#endif +}; + +/* - pool: digest algorithm, hash description and scratch buffer */ +struct tcp_md5sig_pool { +struct ahash_request *md5_req; +void *scratch; +}; + +extern const struct tcp_sock_af_ops tcp_sock_ipv4_specific; +extern const struct tcp_sock_af_ops tcp_sock_ipv6_specific; +extern const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific; + +/* - functions */ +int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, +const struct sock *sk,const struct sk_buff *skb); + +struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, +const struct sock *addr_sk); + +void tcp_v4_md5_destroy_sock (struct sock *sk); + +int tcp_v4_md5_send_reset (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt); + +void tcp_v4_md5_send_ack (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt); + +int tcp_v6_md5_send_response_write (struct sk_buff *skb,struct tcphdr *t1, +__be32 *topt,const struct sock *sk); + +bool tcp_v4_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb); + +void tcp_v4_md5_syn_recv_sock (const struct sock *listener,struct sock *sk); + +void tcp_v6_md5_syn_recv_sock (const struct sock *listener,struct sock *sk); + +void tcp_md5_time_wait (struct sock *sk,struct inet_timewait_sock *tw); + +struct tcp_md5sig_key *tcp_v6_md5_lookup (const struct sock *sk, +const struct sock *addr_sk); + +int tcp_v6_md5_hash_skb (char *md5_hash, +const struct tcp_md5sig_key *key, +const struct sock *sk, +const struct sk_buff *skb); + +bool tcp_v6_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb); + +static inline void tcp_md5_twsk_destructor (struct sock *sk) +{ +struct tcp_timewait_sock *twsk =tcp_twsk (sk); + +if (twsk->tw_md5_key) +kfree_rcu (twsk->tw_md5_key, rcu); +} + +static inline void tcp_md5_add_header_len (const struct sock *listener, +struct sock *sk) +{ +struct tcp_sock *tp =tcp_sk (sk); + + tp->md5sig_info =NULL ;/*XXX*/ +if (tp->af_specific->md5_lookup (listener, sk)) + tp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +} + +int tcp_md5_diag_get_aux (struct sock *sk,bool net_admin,struct sk_buff *skb); + +int tcp_md5_diag_get_aux_size (struct sock *sk,bool net_admin); + +#else + +static inline bool tcp_v4_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +return false; +} + +static inline bool tcp_v6_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +return false; +} + +#endif + +#endif /* _LINUX_TCP_MD5_H */ include/net/tcp.h +0
-77@@ -435,7 +435,6 @@ void tcp_parse_options(const struct net *net, const struct sk_buff *skb,struct tcp_options_received *opt_rx, int estab, struct tcp_fastopen_cookie *foc, struct tcp_sock *tp); -const u8 *tcp_parse_md5sig_option (const struct tcphdr *th);/* * TCP v4 functions exported for the inet6 API @@ -1443,30 +1442,6 @@ static inline void tcp_clear_all_retrans_hints(struct tcp_sock *tp) tp->retransmit_skb_hint =NULL ; } -union tcp_md5_addr { -struct in_addr a4; -#if IS_ENABLED (CONFIG_IPV6 ) -struct in6_addr a6; -#endif -}; - -/* - key database */ -struct tcp_md5sig_key { -struct hlist_node node; -u8 keylen; -u8 family;/* AF_INET or AF_INET6 */ -union tcp_md5_addr addr; -u8 prefixlen; -u8 key[TCP_MD5SIG_MAXKEYLEN ]; -struct rcu_head rcu; -}; - -/* - sock block */ -struct tcp_md5sig_info { -struct hlist_head head; -struct rcu_head rcu; -}; -/* - pseudo header */ struct tcp4_pseudohdr {__be32 saddr;@@ -1483,58 +1458,6 @@ struct tcp6_pseudohdr {__be32 protocol;/* including padding */ }; -union tcp_md5sum_block { -struct tcp4_pseudohdr ip4; -#if IS_ENABLED (CONFIG_IPV6 ) -struct tcp6_pseudohdr ip6; -#endif -}; - -/* - pool: digest algorithm, hash description and scratch buffer */ -struct tcp_md5sig_pool { -struct ahash_request *md5_req; -void *scratch; -}; - -/* - functions */ -int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, -const struct sock *sk,const struct sk_buff *skb); -int tcp_md5_do_add (struct sock *sk,const union tcp_md5_addr *addr, -int family,u8 prefixlen,const u8 *newkey,u8 newkeylen, -gfp_t gfp); -int tcp_md5_do_del (struct sock *sk,const union tcp_md5_addr *addr, -int family,u8 prefixlen); -struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, -const struct sock *addr_sk); - -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, -const union tcp_md5_addr *addr, -int family); -#define tcp_twsk_md5_key (twsk) ((twsk)->tw_md5_key) -#else -static inline struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, -const union tcp_md5_addr *addr, -int family) -{ -return NULL ; -} -#define tcp_twsk_md5_key (twsk) NULL -#endif - -bool tcp_alloc_md5sig_pool (void ); - -struct tcp_md5sig_pool *tcp_get_md5sig_pool (void ); -static inline void tcp_put_md5sig_pool (void ) -{ -local_bh_enable (); -} - -int tcp_md5_hash_skb_data (struct tcp_md5sig_pool *,const struct sk_buff *, -unsigned int header_len); -int tcp_md5_hash_key (struct tcp_md5sig_pool *hp, -const struct tcp_md5sig_key *key); -/* From tcp_fastopen.c */ void tcp_fastopen_cache_get(struct sock *sk, u16 *mss, struct tcp_fastopen_cookie *cookie, int *syn_loss,net/ipv4/Makefile +0
-0@@ -60,6 +60,7 @@ obj-$(CONFIG_TCP_CONG_LP) += tcp_lp.oobj-$(CONFIG_TCP_CONG_YEAH) += tcp_yeah.o
obj-$(CONFIG_TCP_CONG_ILLINOIS) += tcp_illinois.o
obj-$(CONFIG_NETLABEL) += cipso_ipv4.o
+obj-$(CONFIG_TCP_MD5SIG) += tcp_md5.oobj-$(CONFIG_XFRM) += xfrm4_policy.o xfrm4_state.o xfrm4_input.o \
xfrm4_output.o xfrm4_protocol.onet/ipv4/tcp.c +1
-132@@ -271,6 +271,7 @@#include <linux/slab.h> #include <linux/errqueue.h> #include <linux/static_key.h> +#include <linux/tcp_md5.h> #include <net/icmp.h> #include <net/inet_common.h> @@ -3249,138 +3250,6 @@ int compat_tcp_getsockopt(struct sock *sk, int level, int optname,EXPORT_SYMBOL (compat_tcp_getsockopt);#endif -#ifdef CONFIG_TCP_MD5SIG -static DEFINE_PER_CPU(struct tcp_md5sig_pool, tcp_md5sig_pool); -static DEFINE_MUTEX (tcp_md5sig_mutex); -static bool tcp_md5sig_pool_populated = false; - -static void __tcp_alloc_md5sig_pool (void ) -{ -struct crypto_ahash *hash; -int cpu; - - hash =crypto_alloc_ahash ("md5" ,0 ,CRYPTO_ALG_ASYNC ); -if (IS_ERR (hash)) -return ; - -for_each_possible_cpu (cpu) { -void *scratch =per_cpu (tcp_md5sig_pool, cpu).scratch; -struct ahash_request *req; - -if (!scratch) { - scratch =kmalloc_node (sizeof (union tcp_md5sum_block ) + -sizeof (struct tcphdr ), -GFP_KERNEL , -cpu_to_node (cpu)); -if (!scratch) -return ; -per_cpu (tcp_md5sig_pool, cpu).scratch = scratch; - } -if (per_cpu (tcp_md5sig_pool, cpu).md5_req) -continue ; - - req =ahash_request_alloc (hash,GFP_KERNEL ); -if (!req) -return ; - -ahash_request_set_callback (req,0 ,NULL ,NULL ); - -per_cpu (tcp_md5sig_pool, cpu).md5_req = req; - } -/* before setting tcp_md5sig_pool_populated, we must commit all writes -* to memory. See smp_rmb() in tcp_get_md5sig_pool() -*/ -smp_wmb (); - tcp_md5sig_pool_populated = true; -} - -bool tcp_alloc_md5sig_pool (void ) -{ -if (unlikely (!tcp_md5sig_pool_populated)) { -mutex_lock (&tcp_md5sig_mutex); - -if (!tcp_md5sig_pool_populated) -__tcp_alloc_md5sig_pool (); - -mutex_unlock (&tcp_md5sig_mutex); - } -return tcp_md5sig_pool_populated; -} -EXPORT_SYMBOL (tcp_alloc_md5sig_pool); - - -/** -* tcp_get_md5sig_pool - get md5sig_pool for this user -* -* We use percpu structure, so if we succeed, we exit with preemption -* and BH disabled, to make sure another thread or softirq handling -* wont try to get same context. -*/ -struct tcp_md5sig_pool *tcp_get_md5sig_pool (void ) -{ -local_bh_disable (); - -if (tcp_md5sig_pool_populated) { -/* coupled with smp_wmb() in __tcp_alloc_md5sig_pool() */ -smp_rmb (); -return this_cpu_ptr (&tcp_md5sig_pool); - } -local_bh_enable (); -return NULL ; -} -EXPORT_SYMBOL (tcp_get_md5sig_pool); - -int tcp_md5_hash_skb_data (struct tcp_md5sig_pool *hp, -const struct sk_buff *skb,unsigned int header_len) -{ -struct scatterlist sg; -const struct tcphdr *tp =tcp_hdr (skb); -struct ahash_request *req = hp->md5_req; -unsigned int i; -const unsigned int head_data_len =skb_headlen (skb) > header_len ? -skb_headlen (skb) - header_len :0 ; -const struct skb_shared_info *shi =skb_shinfo (skb); -struct sk_buff *frag_iter; - -sg_init_table (&sg,1 ); - -sg_set_buf (&sg, ((u8 *) tp) + header_len, head_data_len); -ahash_request_set_crypt (req, &sg,NULL , head_data_len); -if (crypto_ahash_update (req)) -return 1 ; - -for (i =0 ; i < shi->nr_frags; ++i) { -const struct skb_frag_struct *f = &shi->frags[i]; -unsigned int offset = f->page_offset; -struct page *page =skb_frag_page (f) + (offset >>PAGE_SHIFT ); - -sg_set_page (&sg, page,skb_frag_size (f), -offset_in_page (offset)); -ahash_request_set_crypt (req, &sg,NULL ,skb_frag_size (f)); -if (crypto_ahash_update (req)) -return 1 ; - } - - skb_walk_frags(skb, frag_iter) -if (tcp_md5_hash_skb_data (hp, frag_iter,0 )) -return 1 ; - -return 0 ; -} -EXPORT_SYMBOL (tcp_md5_hash_skb_data); - -int tcp_md5_hash_key (struct tcp_md5sig_pool *hp,const struct tcp_md5sig_key *key) -{ -struct scatterlist sg; - -sg_init_one (&sg, key->key, key->keylen); -ahash_request_set_crypt (hp->md5_req, &sg,NULL , key->keylen); -return crypto_ahash_update (hp->md5_req); -} -EXPORT_SYMBOL (tcp_md5_hash_key); - -#endif -/* Linear search, few entries are expected. The RCU read lock must * be held before calling. */ net/ipv4/tcp_diag.c +6
-75@@ -15,6 +15,7 @@#include <linux/inet_diag.h> #include <linux/tcp.h> +#include <linux/tcp_md5.h> #include <net/netlink.h> #include <net/tcp.h> @@ -37,70 +38,14 @@ static void tcp_diag_get_info(struct sock *sk, struct inet_diag_msg *r,tcp_get_info (sk, info); } -#ifdef CONFIG_TCP_MD5SIG -static void tcp_diag_md5sig_fill (struct tcp_diag_md5sig *info, -const struct tcp_md5sig_key *key) -{ - info->tcpm_family = key->family; - info->tcpm_prefixlen = key->prefixlen; - info->tcpm_keylen = key->keylen; -memcpy (info->tcpm_key, key->key, key->keylen); - -if (key->family ==AF_INET ) - info->tcpm_addr[0 ] = key->addr.a4.s_addr; -#if IS_ENABLED (CONFIG_IPV6 ) - else if (key->family == AF_INET6) - memcpy(&info->tcpm_addr, &key->addr.a6, - sizeof(info->tcpm_addr)); -#endif -} - -static int tcp_diag_put_md5sig (struct sk_buff *skb, -const struct tcp_md5sig_info *md5sig) -{ -const struct tcp_md5sig_key *key; -struct tcp_diag_md5sig *info; -struct nlattr *attr; -int md5sig_count =0 ; - -hlist_for_each_entry_rcu (key, &md5sig->head, node) - md5sig_count++; -if (md5sig_count ==0 ) -return 0 ; - - attr =nla_reserve (skb,INET_DIAG_MD5SIG , - md5sig_count *sizeof (struct tcp_diag_md5sig )); -if (!attr) -return -EMSGSIZE ; - - info =nla_data (attr); -memset (info,0 , md5sig_count *sizeof (struct tcp_diag_md5sig )); -hlist_for_each_entry_rcu (key, &md5sig->head, node) { -tcp_diag_md5sig_fill (info++, key); -if (--md5sig_count ==0 ) -break ; - } - -return 0 ; -} -#endif -static int tcp_diag_get_aux (struct sock *sk,bool net_admin,struct sk_buff *skb) {#ifdef CONFIG_TCP_MD5SIG -if (net_admin) { -struct tcp_md5sig_info *md5sig; -int err =0 ; - -rcu_read_lock (); - md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); -if (md5sig) - err =tcp_diag_put_md5sig (skb, md5sig); -rcu_read_unlock (); -if (err <0 ) -return err; - } +int err =tcp_md5_diag_get_aux (sk, net_admin, skb); + +if (err <0 ) +return err;#endif return 0 ;@@ -111,21 +56,7 @@ static size_t tcp_diag_get_aux_size(struct sock *sk, bool net_admin)size_t size =0 ;#ifdef CONFIG_TCP_MD5SIG -if (net_admin &&sk_fullsock (sk)) { -const struct tcp_md5sig_info *md5sig; -const struct tcp_md5sig_key *key; -size_t md5sig_count =0 ; - -rcu_read_lock (); - md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); -if (md5sig) { -hlist_for_each_entry_rcu (key, &md5sig->head, node) - md5sig_count++; - } -rcu_read_unlock (); - size +=nla_total_size (md5sig_count * -sizeof (struct tcp_diag_md5sig )); - } + size +=tcp_md5_diag_get_aux_size (sk, net_admin);#endif return size;net/ipv4/tcp_input.c +0
-38@@ -3887,44 +3887,6 @@ static bool tcp_fast_parse_options(const struct net *net,return true; } -#ifdef CONFIG_TCP_MD5SIG -/* -* Parse MD5 Signature option -*/ -const u8 *tcp_parse_md5sig_option (const struct tcphdr *th) -{ -int length = (th->doff <<2 ) -sizeof (*th); -const u8 *ptr = (const u8 *)(th +1 ); - -/* If the TCP option is too short, we can short cut */ -if (length <TCPOLEN_MD5SIG ) -return NULL ; - -while (length >0 ) { -int opcode = *ptr++; -int opsize; - -switch (opcode) { -case TCPOPT_EOL : -return NULL ; -case TCPOPT_NOP : - length--; -continue ; -default : - opsize = *ptr++; -if (opsize <2 || opsize > length) -return NULL ; -if (opcode ==TCPOPT_MD5SIG ) -return opsize ==TCPOLEN_MD5SIG ? ptr :NULL ; - } - ptr += opsize -2 ; - length -= opsize; - } -return NULL ; -} -EXPORT_SYMBOL (tcp_parse_md5sig_option); -#endif -/* Sorry, PAWS as specified is broken wrt. pure-ACKs -DaveM * * It is not fatal. If this ACK does _not_ change critical state (seqs, window) net/ipv4/tcp_ipv4.c +7
-491@@ -62,6 +62,7 @@#include <linux/init.h> #include <linux/times.h> #include <linux/slab.h> +#include <linux/tcp_md5.h> #include <net/net_namespace.h> #include <net/icmp.h> @@ -85,11 +86,6 @@#include <crypto/hash.h> #include <linux/scatterlist.h> -#ifdef CONFIG_TCP_MD5SIG -static int tcp_v4_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, -__be32 daddr,__be32 saddr,const struct tcphdr *th); -#endif -struct inet_hashinfo tcp_hashinfo;EXPORT_SYMBOL (tcp_hashinfo);@@ -603,13 +599,6 @@ static void tcp_v4_send_reset(const struct sock *sk, struct sk_buff *skb)#endif } rep;struct ip_reply_arg arg; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key =NULL ; -const __u8 *hash_location =NULL ; -unsigned char newhash[16 ]; -int genhash; -struct sock *sk1 =NULL ; -#endif struct net *net;/* Never send a reset in response to a reset. */ @@ -643,53 +632,8 @@ static void tcp_v4_send_reset(const struct sock *sk, struct sk_buff *skb) net = sk ?sock_net (sk) :dev_net (skb_dst (skb)->dev);#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *) - &ip_hdr (skb)->saddr,AF_INET ); - }else if (hash_location) { -/* -* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =__inet_lookup_listener (net, &tcp_hashinfo,NULL ,0 , -ip_hdr (skb)->saddr, - th->source,ip_hdr (skb)->daddr, -ntohs (th->source),inet_iif (skb), -tcp_v4_sdif (skb)); -/* don't send rst if it can't find key */ -if (!sk1) - goto out; - - key =tcp_md5_do_lookup (sk1, (union tcp_md5_addr *) - &ip_hdr (skb)->saddr,AF_INET ); -if (!key) - goto out; - - - genhash =tcp_v4_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto out; - - } - -if (key) { - rep.opt[0 ] =htonl ((TCPOPT_NOP <<24 ) | - (TCPOPT_NOP <<16 ) | - (TCPOPT_MD5SIG <<8 ) | -TCPOLEN_MD5SIG ); -/* Update length and the length the header thinks exists */ - arg.iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; - rep.th.doff = arg.iov[0 ].iov_len /4 ; - -tcp_v4_md5_hash_hdr ((__u8 *) &rep.opt[1 ], - key,ip_hdr (skb)->saddr, -ip_hdr (skb)->daddr, &rep.th); - } +if (tcp_v4_md5_send_reset (skb, sk, &arg, &rep.th, rep.opt)) +return ;#endif arg.csum = csum_tcpudp_nofold(ip_hdr(skb)->daddr, ip_hdr(skb)->saddr, /* XXX */@@ -718,11 +662,6 @@ static void tcp_v4_send_reset(const struct sock *sk, struct sk_buff *skb)__TCP_INC_STATS (net,TCP_MIB_OUTSEGS );__TCP_INC_STATS (net,TCP_MIB_OUTRSTS );local_bh_enable (); - -#ifdef CONFIG_TCP_MD5SIG -out: -rcu_read_unlock (); -#endif }/* The code following below sending ACKs in SYN-RECV and TIME-WAIT states @@ -743,9 +682,6 @@ static void tcp_v4_send_ack(const struct sock *sk,#endif ]; } rep; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key; -#endif struct net *net =sock_net (sk);struct ip_reply_arg arg;@@ -773,31 +709,8 @@ static void tcp_v4_send_ack(const struct sock *sk, rep.th.window =htons (win);#ifdef CONFIG_TCP_MD5SIG -if (sk->sk_state ==TCP_TIME_WAIT ) { -struct tcp_timewait_sock *tcptw =tcp_twsk (sk); - - key =tcp_twsk_md5_key (tcptw); - }else if (sk->sk_state ==TCP_NEW_SYN_RECV ) { - key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&ip_hdr (skb)->daddr, -AF_INET ); - }else { -BUG (); - } - -if (key) { -int offset = (tsecr) ?3 :0 ; - - rep.opt[offset++] =htonl ((TCPOPT_NOP <<24 ) | - (TCPOPT_NOP <<16 ) | - (TCPOPT_MD5SIG <<8 ) | -TCPOLEN_MD5SIG ); - arg.iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; - rep.th.doff = arg.iov[0 ].iov_len/4 ; - -tcp_v4_md5_hash_hdr ((__u8 *) &rep.opt[offset], - key,ip_hdr (skb)->saddr, -ip_hdr (skb)->daddr, &rep.th); - } +tcp_v4_md5_send_ack (skb, sk, &arg, &rep.th, + (tsecr) ? &rep.opt[3 ] : &rep.opt[0 ]);#endif arg.flags = reply_flags; arg.csum = csum_tcpudp_nofold(ip_hdr(skb)->daddr,@@ -902,374 +815,6 @@ static void tcp_v4_reqsk_destructor(struct request_sock *req)kfree (inet_rsk (req)->opt); } -#ifdef CONFIG_TCP_MD5SIG -/* -* RFC2385 MD5 checksumming requires a mapping of -* IP address->MD5 Key. -* We need to maintain these in the sk structure. -*/ - -/* Find the Key structure for an address. */ -struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, -const union tcp_md5_addr *addr, -int family) -{ -const struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_key *key; -const struct tcp_md5sig_info *md5sig; -__be32 mask; -struct tcp_md5sig_key *best_match =NULL ; -bool match; - -/* caller either holds rcu_read_lock() or socket lock */ - md5sig =rcu_dereference_check (tp->md5sig_info, -lockdep_sock_is_held (sk)); -if (!md5sig) -return NULL ; - -hlist_for_each_entry_rcu (key, &md5sig->head, node) { -if (key->family != family) -continue ; - -if (family ==AF_INET ) { - mask =inet_make_mask (key->prefixlen); - match = (key->addr.a4.s_addr & mask) == - (addr->a4.s_addr & mask); -#if IS_ENABLED (CONFIG_IPV6 ) - } else if (family == AF_INET6) { - match =ipv6_prefix_equal (&key->addr.a6, &addr->a6, - key->prefixlen); -#endif - }else { - match = false; - } - -if (match && (!best_match || - key->prefixlen > best_match->prefixlen)) - best_match = key; - } -return best_match; -} -EXPORT_SYMBOL (tcp_md5_do_lookup); - -static struct tcp_md5sig_key *tcp_md5_do_lookup_exact (const struct sock *sk, -const union tcp_md5_addr *addr, -int family,u8 prefixlen) -{ -const struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_key *key; -unsigned int size =sizeof (struct in_addr ); -const struct tcp_md5sig_info *md5sig; - -/* caller either holds rcu_read_lock() or socket lock */ - md5sig =rcu_dereference_check (tp->md5sig_info, -lockdep_sock_is_held (sk)); -if (!md5sig) -return NULL ; -#if IS_ENABLED (CONFIG_IPV6 ) -if (family ==AF_INET6 ) - size =sizeof (struct in6_addr ); -#endif -hlist_for_each_entry_rcu (key, &md5sig->head, node) { -if (key->family != family) -continue ; -if (!memcmp (&key->addr, addr, size) && - key->prefixlen == prefixlen) -return key; - } -return NULL ; -} - -struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, -const struct sock *addr_sk) -{ -const union tcp_md5_addr *addr; - - addr = (const union tcp_md5_addr *)&addr_sk->sk_daddr; -return tcp_md5_do_lookup (sk, addr,AF_INET ); -} -EXPORT_SYMBOL (tcp_v4_md5_lookup); - -/* This can be called on a newly created socket, from other files */ -int tcp_md5_do_add (struct sock *sk,const union tcp_md5_addr *addr, -int family,u8 prefixlen,const u8 *newkey,u8 newkeylen, -gfp_t gfp) -{ -/* Add Key to the list */ -struct tcp_md5sig_key *key; -struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_info *md5sig; - - key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); -if (key) { -/* Pre-existing entry - just update that one. */ -memcpy (key->key, newkey, newkeylen); - key->keylen = newkeylen; -return 0 ; - } - - md5sig =rcu_dereference_protected (tp->md5sig_info, -lockdep_sock_is_held (sk)); -if (!md5sig) { - md5sig =kmalloc (sizeof (*md5sig), gfp); -if (!md5sig) -return -ENOMEM ; - -sk_nocaps_add (sk,NETIF_F_GSO_MASK ); -INIT_HLIST_HEAD (&md5sig->head); -rcu_assign_pointer (tp->md5sig_info, md5sig); - } - - key =sock_kmalloc (sk,sizeof (*key), gfp); -if (!key) -return -ENOMEM ; -if (!tcp_alloc_md5sig_pool ()) { -sock_kfree_s (sk, key,sizeof (*key)); -return -ENOMEM ; - } - -memcpy (key->key, newkey, newkeylen); - key->keylen = newkeylen; - key->family = family; - key->prefixlen = prefixlen; -memcpy (&key->addr, addr, - (family ==AF_INET6 ) ?sizeof (struct in6_addr ) : -sizeof (struct in_addr )); -hlist_add_head_rcu (&key->node, &md5sig->head); -return 0 ; -} -EXPORT_SYMBOL (tcp_md5_do_add); - -int tcp_md5_do_del (struct sock *sk,const union tcp_md5_addr *addr,int family, -u8 prefixlen) -{ -struct tcp_md5sig_key *key; - - key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); -if (!key) -return -ENOENT ; -hlist_del_rcu (&key->node); -atomic_sub (sizeof (*key), &sk->sk_omem_alloc); -kfree_rcu (key, rcu); -return 0 ; -} -EXPORT_SYMBOL (tcp_md5_do_del); - -static void tcp_clear_md5_list (struct sock *sk) -{ -struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_key *key; -struct hlist_node *n; -struct tcp_md5sig_info *md5sig; - - md5sig =rcu_dereference_protected (tp->md5sig_info,1 ); - -hlist_for_each_entry_safe (key, n, &md5sig->head, node) { -hlist_del_rcu (&key->node); -atomic_sub (sizeof (*key), &sk->sk_omem_alloc); -kfree_rcu (key, rcu); - } -} - -static int tcp_v4_parse_md5_keys (struct sock *sk,int optname, -char __user *optval,int optlen) -{ -struct tcp_md5sig cmd; -struct sockaddr_in *sin = (struct sockaddr_in *)&cmd.tcpm_addr; -u8 prefixlen =32 ; - -if (optlen <sizeof (cmd)) -return -EINVAL ; - -if (copy_from_user (&cmd, optval,sizeof (cmd))) -return -EFAULT ; - -if (sin->sin_family !=AF_INET ) -return -EINVAL ; - -if (optname ==TCP_MD5SIG_EXT && - cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { - prefixlen = cmd.tcpm_prefixlen; -if (prefixlen >32 ) -return -EINVAL ; - } - -if (!cmd.tcpm_keylen) -return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, -AF_INET , prefixlen); - -if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) -return -EINVAL ; - -return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, -AF_INET , prefixlen, cmd.tcpm_key, cmd.tcpm_keylen, -GFP_KERNEL ); -} - -static int tcp_v4_md5_hash_headers (struct tcp_md5sig_pool *hp, -__be32 daddr,__be32 saddr, -const struct tcphdr *th,int nbytes) -{ -struct tcp4_pseudohdr *bp; -struct scatterlist sg; -struct tcphdr *_th; - - bp = hp->scratch; - bp->saddr = saddr; - bp->daddr = daddr; - bp->pad =0 ; - bp->protocol =IPPROTO_TCP ; - bp->len =cpu_to_be16 (nbytes); - - _th = (struct tcphdr *)(bp +1 ); -memcpy (_th, th,sizeof (*th)); - _th->check =0 ; - -sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); -ahash_request_set_crypt (hp->md5_req, &sg,NULL , -sizeof (*bp) +sizeof (*th)); -return crypto_ahash_update (hp->md5_req); -} - -static int tcp_v4_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, -__be32 daddr,__be32 saddr,const struct tcphdr *th) -{ -struct tcp_md5sig_pool *hp; -struct ahash_request *req; - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; -if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} - -int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, -const struct sock *sk, -const struct sk_buff *skb) -{ -struct tcp_md5sig_pool *hp; -struct ahash_request *req; -const struct tcphdr *th =tcp_hdr (skb); -__be32 saddr, daddr; - -if (sk) {/* valid for establish/request sockets */ - saddr = sk->sk_rcv_saddr; - daddr = sk->sk_daddr; - }else { -const struct iphdr *iph =ip_hdr (skb); - saddr = iph->saddr; - daddr = iph->daddr; - } - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; - -if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, skb->len)) - goto clear_hash; -if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} -EXPORT_SYMBOL (tcp_v4_md5_hash_skb); - -#endif - -/* Called with rcu_read_lock() */ -static bool tcp_v4_inbound_md5_hash (const struct sock *sk, -const struct sk_buff *skb) -{ -#ifdef CONFIG_TCP_MD5SIG -/* -* This gets called for each TCP segment that arrives -* so we want to be efficient. -* We have 3 drop cases: -* o No MD5 hash and one expected. -* o MD5 hash and we're not expecting one. -* o MD5 hash and its wrong. -*/ -const __u8 *hash_location =NULL ; -struct tcp_md5sig_key *hash_expected; -const struct iphdr *iph =ip_hdr (skb); -const struct tcphdr *th =tcp_hdr (skb); -int genhash; -unsigned char newhash[16 ]; - - hash_expected =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&iph->saddr, -AF_INET ); - hash_location =tcp_parse_md5sig_option (th); - -/* We've parsed the options - do we have a hash? */ -if (!hash_expected && !hash_location) -return false; - -if (hash_expected && !hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); -return true; - } - -if (!hash_expected && hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); -return true; - } - -/* Okay, so this is hash_expected and hash_location - -* so we need to calculate the checksum. -*/ - genhash =tcp_v4_md5_hash_skb (newhash, - hash_expected, -NULL , skb); - -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); -net_info_ratelimited ("MD5 Hash failed for (%pI4, %d)->(%pI4, %d)%s\n" , - &iph->saddr,ntohs (th->source), - &iph->daddr,ntohs (th->dest), - genhash ?" tcp_v4_calc_md5_hash failed" - :"" ); -return true; - } -return false; -#endif -return false; -} -static void tcp_v4_init_req (struct request_sock *req,const struct sock *sk_listener,struct sk_buff *skb)@@ -1344,9 +889,6 @@ struct sock *tcp_v4_syn_recv_sock(const struct sock *sk, struct sk_buff *skb,struct inet_sock *newinet;struct tcp_sock *newtp;struct sock *newsk; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key; -#endif struct ip_options_rcu *inet_opt;if (sk_acceptq_is_full (sk))@@ -1394,20 +936,7 @@ struct sock *tcp_v4_syn_recv_sock(const struct sock *sk, struct sk_buff *skb,tcp_initialize_rcv_mss (newsk);#ifdef CONFIG_TCP_MD5SIG -/* Copy over the MD5 key from the original socket */ - key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&newinet->inet_daddr, -AF_INET ); -if (key) { -/* -* We're using one, so create a matching key -* on the newsk structure. If we fail to get -* memory, then we end up not copying the key -* across. Shucks. -*/ -tcp_md5_do_add (newsk, (union tcp_md5_addr *)&newinet->inet_daddr, -AF_INET ,32 , key->key, key->keylen,GFP_ATOMIC ); -sk_nocaps_add (newsk,NETIF_F_GSO_MASK ); - } +tcp_v4_md5_syn_recv_sock (sk, newsk);#endif if (__inet_inherit_port (sk, newsk) <0 )@@ -1839,14 +1368,6 @@ const struct inet_connection_sock_af_ops ipv4_specific = { };EXPORT_SYMBOL (ipv4_specific); -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv4_specific = { - .md5_lookup = tcp_v4_md5_lookup, - .calc_md5_hash = tcp_v4_md5_hash_skb, - .md5_parse = tcp_v4_parse_md5_keys, -}; -#endif -/* NOTE: A lot of things set to zero explicitly by call to * sk_alloc() so need not be done here. */ @@ -1885,12 +1406,7 @@ void tcp_v4_destroy_sock(struct sock *sk)skb_rbtree_purge (&tp->out_of_order_queue);#ifdef CONFIG_TCP_MD5SIG -/* Clean up the MD5 key list, if any */ -if (tp->md5sig_info) { -tcp_clear_md5_list (sk); -kfree_rcu (tp->md5sig_info, rcu); - tp->md5sig_info =NULL ; - } +tcp_v4_md5_destroy_sock (sk);#endif /* Clean up a referenced TCP bind bucket. */ net/ipv4/tcp_md5.c new file +656
-0@@ -0,0 +1,1080 @@ +#include <linux/inet_diag.h> +#include <linux/inetdevice.h> +#include <linux/tcp.h> +#include <linux/tcp_md5.h> + +#include <crypto/hash.h> + +#include <net/inet6_hashtables.h> + +static DEFINE_PER_CPU(struct tcp_md5sig_pool, tcp_md5sig_pool); +static DEFINE_MUTEX (tcp_md5sig_mutex); +static bool tcp_md5sig_pool_populated; + +#define tcp_twsk_md5_key (twsk) ((twsk)->tw_md5_key) + +static void __tcp_alloc_md5sig_pool (void ) +{ +struct crypto_ahash *hash; +int cpu; + + hash =crypto_alloc_ahash ("md5" ,0 ,CRYPTO_ALG_ASYNC ); +if (IS_ERR (hash)) +return ; + +for_each_possible_cpu (cpu) { +void *scratch =per_cpu (tcp_md5sig_pool, cpu).scratch; +struct ahash_request *req; + +if (!scratch) { + scratch =kmalloc_node (sizeof (union tcp_md5sum_block ) + +sizeof (struct tcphdr ), +GFP_KERNEL , +cpu_to_node (cpu)); +if (!scratch) +return ; +per_cpu (tcp_md5sig_pool, cpu).scratch = scratch; + } +if (per_cpu (tcp_md5sig_pool, cpu).md5_req) +continue ; + + req =ahash_request_alloc (hash,GFP_KERNEL ); +if (!req) +return ; + +ahash_request_set_callback (req,0 ,NULL ,NULL ); + +per_cpu (tcp_md5sig_pool, cpu).md5_req = req; + } +/* before setting tcp_md5sig_pool_populated, we must commit all writes +* to memory. See smp_rmb() in tcp_get_md5sig_pool() +*/ +smp_wmb (); + tcp_md5sig_pool_populated = true; +} + +static bool tcp_alloc_md5sig_pool (void ) +{ +if (unlikely (!tcp_md5sig_pool_populated)) { +mutex_lock (&tcp_md5sig_mutex); + +if (!tcp_md5sig_pool_populated) +__tcp_alloc_md5sig_pool (); + +mutex_unlock (&tcp_md5sig_mutex); + } +return tcp_md5sig_pool_populated; +} + +static void tcp_put_md5sig_pool (void ) +{ +local_bh_enable (); +} + +/** +* tcp_get_md5sig_pool - get md5sig_pool for this user +* +* We use percpu structure, so if we succeed, we exit with preemption +* and BH disabled, to make sure another thread or softirq handling +* wont try to get same context. +*/ +static struct tcp_md5sig_pool *tcp_get_md5sig_pool (void ) +{ +local_bh_disable (); + +if (tcp_md5sig_pool_populated) { +/* coupled with smp_wmb() in __tcp_alloc_md5sig_pool() */ +smp_rmb (); +return this_cpu_ptr (&tcp_md5sig_pool); + } +local_bh_enable (); +return NULL ; +} + +static struct tcp_md5sig_key *tcp_md5_do_lookup_exact (const struct sock *sk, +const union tcp_md5_addr *addr, +int family,u8 prefixlen) +{ +const struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; +unsigned int size =sizeof (struct in_addr ); +const struct tcp_md5sig_info *md5sig; + +/* caller either holds rcu_read_lock() or socket lock */ + md5sig =rcu_dereference_check (tp->md5sig_info, +lockdep_sock_is_held (sk)); +if (!md5sig) +return NULL ; +#if IS_ENABLED (CONFIG_IPV6 ) +if (family ==AF_INET6 ) + size =sizeof (struct in6_addr ); +#endif +hlist_for_each_entry_rcu (key, &md5sig->head, node) { +if (key->family != family) +continue ; +if (!memcmp (&key->addr, addr, size) && + key->prefixlen == prefixlen) +return key; + } +return NULL ; +} + +/* This can be called on a newly created socket, from other files */ +static int tcp_md5_do_add (struct sock *sk,const union tcp_md5_addr *addr, +int family,u8 prefixlen,const u8 *newkey, +u8 newkeylen,gfp_t gfp) +{ +/* Add Key to the list */ +struct tcp_md5sig_key *key; +struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_info *md5sig; + + key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); +if (key) { +/* Pre-existing entry - just update that one. */ +memcpy (key->key, newkey, newkeylen); + key->keylen = newkeylen; +return 0 ; + } + + md5sig =rcu_dereference_protected (tp->md5sig_info, +lockdep_sock_is_held (sk)); +if (!md5sig) { + md5sig =kmalloc (sizeof (*md5sig), gfp); +if (!md5sig) +return -ENOMEM ; + +sk_nocaps_add (sk,NETIF_F_GSO_MASK ); +INIT_HLIST_HEAD (&md5sig->head); +rcu_assign_pointer (tp->md5sig_info, md5sig); + } + + key =sock_kmalloc (sk,sizeof (*key), gfp); +if (!key) +return -ENOMEM ; +if (!tcp_alloc_md5sig_pool ()) { +sock_kfree_s (sk, key,sizeof (*key)); +return -ENOMEM ; + } + +memcpy (key->key, newkey, newkeylen); + key->keylen = newkeylen; + key->family = family; + key->prefixlen = prefixlen; +memcpy (&key->addr, addr, + (family ==AF_INET6 ) ?sizeof (struct in6_addr ) : +sizeof (struct in_addr )); +hlist_add_head_rcu (&key->node, &md5sig->head); +return 0 ; +} + +static void tcp_clear_md5_list (struct sock *sk) +{ +struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; +struct hlist_node *n; +struct tcp_md5sig_info *md5sig; + + md5sig =rcu_dereference_protected (tp->md5sig_info,1 ); + +hlist_for_each_entry_safe (key, n, &md5sig->head, node) { +hlist_del_rcu (&key->node); +atomic_sub (sizeof (*key), &sk->sk_omem_alloc); +kfree_rcu (key, rcu); + } +} + +static int tcp_md5_do_del (struct sock *sk,const union tcp_md5_addr *addr, +int family,u8 prefixlen) +{ +struct tcp_md5sig_key *key; + + key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); +if (!key) +return -ENOENT ; +hlist_del_rcu (&key->node); +atomic_sub (sizeof (*key), &sk->sk_omem_alloc); +kfree_rcu (key, rcu); +return 0 ; +} + +static int tcp_md5_hash_key (struct tcp_md5sig_pool *hp, +const struct tcp_md5sig_key *key) +{ +struct scatterlist sg; + +sg_init_one (&sg, key->key, key->keylen); +ahash_request_set_crypt (hp->md5_req, &sg,NULL , key->keylen); +return crypto_ahash_update (hp->md5_req); +} + +static int tcp_v4_parse_md5_keys (struct sock *sk,int optname, +char __user *optval,int optlen) +{ +struct tcp_md5sig cmd; +struct sockaddr_in *sin = (struct sockaddr_in *)&cmd.tcpm_addr; +u8 prefixlen =32 ; + +if (optlen <sizeof (cmd)) +return -EINVAL ; + +if (copy_from_user (&cmd, optval,sizeof (cmd))) +return -EFAULT ; + +if (sin->sin_family !=AF_INET ) +return -EINVAL ; + +if (optname ==TCP_MD5SIG_EXT && + cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { + prefixlen = cmd.tcpm_prefixlen; +if (prefixlen >32 ) +return -EINVAL ; + } + +if (!cmd.tcpm_keylen) +return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, +AF_INET , prefixlen); + +if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) +return -EINVAL ; + +return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, +AF_INET , prefixlen, cmd.tcpm_key, cmd.tcpm_keylen, +GFP_KERNEL ); +} + +static int tcp_v6_parse_md5_keys (struct sock *sk,int optname, +char __user *optval,int optlen) +{ +struct tcp_md5sig cmd; +struct sockaddr_in6 *sin6 = (struct sockaddr_in6 *)&cmd.tcpm_addr; +u8 prefixlen; + +if (optlen <sizeof (cmd)) +return -EINVAL ; + +if (copy_from_user (&cmd, optval,sizeof (cmd))) +return -EFAULT ; + +if (sin6->sin6_family !=AF_INET6 ) +return -EINVAL ; + +if (optname ==TCP_MD5SIG_EXT && + cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { + prefixlen = cmd.tcpm_prefixlen; +if (prefixlen >128 || (ipv6_addr_v4mapped (&sin6->sin6_addr) && + prefixlen >32 )) +return -EINVAL ; + }else { + prefixlen =ipv6_addr_v4mapped (&sin6->sin6_addr) ?32 :128 ; + } + +if (!cmd.tcpm_keylen) { +if (ipv6_addr_v4mapped (&sin6->sin6_addr)) +return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], +AF_INET , prefixlen); +return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr, +AF_INET6 , prefixlen); + } + +if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) +return -EINVAL ; + +if (ipv6_addr_v4mapped (&sin6->sin6_addr)) +return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], +AF_INET , prefixlen, cmd.tcpm_key, + cmd.tcpm_keylen,GFP_KERNEL ); + +return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr, +AF_INET6 , prefixlen, cmd.tcpm_key, + cmd.tcpm_keylen,GFP_KERNEL ); +} + +static int tcp_v4_md5_hash_headers (struct tcp_md5sig_pool *hp, +__be32 daddr,__be32 saddr, +const struct tcphdr *th,int nbytes) +{ +struct tcp4_pseudohdr *bp; +struct scatterlist sg; +struct tcphdr *_th; + + bp = hp->scratch; + bp->saddr = saddr; + bp->daddr = daddr; + bp->pad =0 ; + bp->protocol =IPPROTO_TCP ; + bp->len =cpu_to_be16 (nbytes); + + _th = (struct tcphdr *)(bp +1 ); +memcpy (_th, th,sizeof (*th)); + _th->check =0 ; + +sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); +ahash_request_set_crypt (hp->md5_req, &sg,NULL , +sizeof (*bp) +sizeof (*th)); +return crypto_ahash_update (hp->md5_req); +} + +static int tcp_v6_md5_hash_headers (struct tcp_md5sig_pool *hp, +const struct in6_addr *daddr, +const struct in6_addr *saddr, +const struct tcphdr *th,int nbytes) +{ +struct tcp6_pseudohdr *bp; +struct scatterlist sg; +struct tcphdr *_th; + + bp = hp->scratch; +/* 1. TCP pseudo-header (RFC2460) */ + bp->saddr = *saddr; + bp->daddr = *daddr; + bp->protocol =cpu_to_be32 (IPPROTO_TCP ); + bp->len =cpu_to_be32 (nbytes); + + _th = (struct tcphdr *)(bp +1 ); +memcpy (_th, th,sizeof (*th)); + _th->check =0 ; + +sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); +ahash_request_set_crypt (hp->md5_req, &sg,NULL , +sizeof (*bp) +sizeof (*th)); +return crypto_ahash_update (hp->md5_req); +} + +static int tcp_v4_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, +__be32 daddr,__be32 saddr, +const struct tcphdr *th) +{ +struct tcp_md5sig_pool *hp; +struct ahash_request *req; + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; +if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} + +static int tcp_v6_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, +const struct in6_addr *daddr, +struct in6_addr *saddr,const struct tcphdr *th) +{ +struct tcp_md5sig_pool *hp; +struct ahash_request *req; + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; +if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} + +/* RFC2385 MD5 checksumming requires a mapping of +* IP address->MD5 Key. +* We need to maintain these in the sk structure. +*/ + +/* Find the Key structure for an address. */ +static struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, +const union tcp_md5_addr *addr, +int family) +{ +const struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; +const struct tcp_md5sig_info *md5sig; +__be32 mask; +struct tcp_md5sig_key *best_match =NULL ; +bool match; + +/* caller either holds rcu_read_lock() or socket lock */ + md5sig =rcu_dereference_check (tp->md5sig_info, +lockdep_sock_is_held (sk)); +if (!md5sig) +return NULL ; + +hlist_for_each_entry_rcu (key, &md5sig->head, node) { +if (key->family != family) +continue ; + +if (family ==AF_INET ) { + mask =inet_make_mask (key->prefixlen); + match = (key->addr.a4.s_addr & mask) == + (addr->a4.s_addr & mask); +#if IS_ENABLED (CONFIG_IPV6 ) + } else if (family == AF_INET6) { + match =ipv6_prefix_equal (&key->addr.a6, &addr->a6, + key->prefixlen); +#endif + }else { + match = false; + } + +if (match && (!best_match || + key->prefixlen > best_match->prefixlen)) + best_match = key; + } +return best_match; +} + +/* Parse MD5 Signature option */ +static const u8 *tcp_parse_md5sig_option (const struct tcphdr *th) +{ +int length = (th->doff <<2 ) -sizeof (*th); +const u8 *ptr = (const u8 *)(th +1 ); + +/* If the TCP option is too short, we can short cut */ +if (length <TCPOLEN_MD5SIG ) +return NULL ; + +while (length >0 ) { +int opcode = *ptr++; +int opsize; + +switch (opcode) { +case TCPOPT_EOL : +return NULL ; +case TCPOPT_NOP : + length--; +continue ; +default : + opsize = *ptr++; +if (opsize <2 || opsize > length) +return NULL ; +if (opcode ==TCPOPT_MD5SIG ) +return opsize ==TCPOLEN_MD5SIG ? ptr :NULL ; + } + ptr += opsize -2 ; + length -= opsize; + } +return NULL ; +} + +static struct tcp_md5sig_key *tcp_v6_md5_do_lookup (const struct sock *sk, +const struct in6_addr *addr) +{ +return tcp_md5_do_lookup (sk, (union tcp_md5_addr *)addr,AF_INET6 ); +} + +static int tcp_md5_hash_skb_data (struct tcp_md5sig_pool *hp, +const struct sk_buff *skb, +unsigned int header_len) +{ +struct scatterlist sg; +const struct tcphdr *tp =tcp_hdr (skb); +struct ahash_request *req = hp->md5_req; +unsigned int i; +const unsigned int head_data_len =skb_headlen (skb) > header_len ? +skb_headlen (skb) - header_len :0 ; +const struct skb_shared_info *shi =skb_shinfo (skb); +struct sk_buff *frag_iter; + +sg_init_table (&sg,1 ); + +sg_set_buf (&sg, ((u8 *)tp) + header_len, head_data_len); +ahash_request_set_crypt (req, &sg,NULL , head_data_len); +if (crypto_ahash_update (req)) +return 1 ; + +for (i =0 ; i < shi->nr_frags; ++i) { +const struct skb_frag_struct *f = &shi->frags[i]; +unsigned int offset = f->page_offset; +struct page *page =skb_frag_page (f) + (offset >>PAGE_SHIFT ); + +sg_set_page (&sg, page,skb_frag_size (f), +offset_in_page (offset)); +ahash_request_set_crypt (req, &sg,NULL ,skb_frag_size (f)); +if (crypto_ahash_update (req)) +return 1 ; + } + + skb_walk_frags(skb, frag_iter) +if (tcp_md5_hash_skb_data (hp, frag_iter,0 )) +return 1 ; + +return 0 ; +} + +int tcp_v4_md5_send_reset (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt) +{ +const struct tcphdr *th =tcp_hdr (skb); +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +unsigned char newhash[16 ]; +struct sock *sk1 =NULL ; +struct net *net; +int genhash; + + net = sk ?sock_net (sk) :dev_net (skb_dst (skb)->dev); + +rcu_read_lock (); + hash_location =tcp_parse_md5sig_option (th); +if (sk &&sk_fullsock (sk)) { + key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *) + &ip_hdr (skb)->saddr,AF_INET ); + }else if (hash_location) { +/* active side is lost. Try to find listening socket through +* source port, and then find md5 key through listening socket. +* we are not loose security here: +* Incoming packet is checked with md5 hash with finding key, +* no RST generated if md5 hash doesn't match. +*/ + sk1 =__inet_lookup_listener (net, &tcp_hashinfo,NULL ,0 , +ip_hdr (skb)->saddr, + th->source,ip_hdr (skb)->daddr, +ntohs (th->source),inet_iif (skb), +tcp_v4_sdif (skb)); +/* don't send rst if it can't find key */ +if (!sk1) + goto out; + + key =tcp_md5_do_lookup (sk1, (union tcp_md5_addr *) + &ip_hdr (skb)->saddr,AF_INET ); +if (!key) + goto out; + + genhash =tcp_v4_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto out; + } + +if (key) { + opt[0 ] =htonl ((TCPOPT_NOP <<24 ) | + (TCPOPT_NOP <<16 ) | + (TCPOPT_MD5SIG <<8 ) | +TCPOLEN_MD5SIG ); +/* Update length and the length the header thinks exists */ + arg->iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; + repth->doff = arg->iov[0 ].iov_len /4 ; + +tcp_v4_md5_hash_hdr ((__u8 *)&opt[1 ], + key,ip_hdr (skb)->saddr, +ip_hdr (skb)->daddr, repth); + } + +rcu_read_unlock (); + +return 0 ; +out: +rcu_read_unlock (); +return -1 ; +} + +void tcp_v4_md5_send_ack (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt) +{ +struct tcp_md5sig_key *key; + +if (sk->sk_state ==TCP_TIME_WAIT ) { +struct tcp_timewait_sock *tcptw =tcp_twsk (sk); + + key =tcp_twsk_md5_key (tcptw); + }else if (sk->sk_state ==TCP_NEW_SYN_RECV ) { + key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&ip_hdr (skb)->daddr, +AF_INET ); + }else { +BUG (); + } + +if (key) { + opt[0 ] =htonl ((TCPOPT_NOP <<24 ) | + (TCPOPT_NOP <<16 ) | + (TCPOPT_MD5SIG <<8 ) | +TCPOLEN_MD5SIG ); + arg->iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; + repth->doff = arg->iov[0 ].iov_len /4 ; + +tcp_v4_md5_hash_hdr ((__u8 *)&opt[1 ], + key,ip_hdr (skb)->saddr, +ip_hdr (skb)->daddr, repth); + } +} + +int tcp_v6_md5_send_response_write (struct sk_buff *skb,struct tcphdr *t1, +__be32 *topt,const struct sock *sk) +{ +const struct tcphdr *th =tcp_hdr (skb); +struct ipv6hdr *ipv6h =ipv6_hdr (skb); +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +int ret =0 ; + +rcu_read_lock (); + hash_location =tcp_parse_md5sig_option (th); +if (sk &&sk_fullsock (sk)) { + key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); + }else if (sk && sk->sk_state ==TCP_TIME_WAIT ) { +struct tcp_timewait_sock *tcptw =tcp_twsk (sk); + + key =tcp_twsk_md5_key (tcptw); + }else if (sk && sk->sk_state ==TCP_NEW_SYN_RECV ) { + key =tcp_v6_md5_do_lookup (sk, &ipv6h->daddr); + }else if (hash_location) { +unsigned char newhash[16 ]; +struct sock *sk1 =NULL ; +int genhash; + +/* active side is lost. Try to find listening socket through +* source port, and then find md5 key through listening socket.
net/ipv4/tcp_md5.c line 666
Quoted 10 lines
net/ipv4/tcp_md5.c new file +10
-0+* we are not loose security here: +* Incoming packet is checked with md5 hash with finding key, +* no RST generated if md5 hash doesn't match. +*/ + sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), + &tcp_hashinfo,NULL ,0 , + &ipv6h->saddr, + th->source, &ipv6h->daddr, +ntohs (th->source),tcp_v6_iif (skb), +tcp_v6_sdif (skb));
This code (and other v6 code) gets compiled even when IPv6 is not configured - inet6_lookup_listener (for example) is not defined when IPv6 is not configured.
IPv6 support can be in a module, which makes things trickier - especially if you consider that MD5 can possibly be moved to a module once it is fully transitioned to the extra options framework. Maybe there would need to be two MD5 modules, tcp_md5 and tcp_md5_ipv6 (the latter depending on both tcp_md5 and ipv6). I may be getting ahead of myself with modularizing TCP_MD5, it would be simpler to leave the config as-is, splitting off the ipv6 parts of TCP_MD5 and including them in the ipv6 module.
Mat
Quoted 879 lines
net/ipv4/tcp_md5.c new file +414
-0+if (!sk1) + goto exit; + + key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); +if (!key) + goto exit; + + genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto exit; + } + +if (key) { + *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | + (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG ); +tcp_v6_md5_hash_hdr ((__u8 *)topt, key, + &ipv6_hdr (skb)->saddr, + &ipv6_hdr (skb)->daddr, t1); + + ret =TCPOLEN_MD5SIG_ALIGNED ; + } + +exit: +rcu_read_unlock (); + +return ret; +} + +struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, +const struct sock *addr_sk) +{ +const union tcp_md5_addr *addr; + + addr = (const union tcp_md5_addr *)&addr_sk->sk_daddr; +return tcp_md5_do_lookup (sk, addr,AF_INET ); +} +EXPORT_SYMBOL (tcp_v4_md5_lookup); + +int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, +const struct sock *sk, +const struct sk_buff *skb) +{ +struct tcp_md5sig_pool *hp; +struct ahash_request *req; +const struct tcphdr *th =tcp_hdr (skb); +__be32 saddr, daddr; + +if (sk) {/* valid for establish/request sockets */ + saddr = sk->sk_rcv_saddr; + daddr = sk->sk_daddr; + }else { +const struct iphdr *iph =ip_hdr (skb); + + saddr = iph->saddr; + daddr = iph->daddr; + } + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; + +if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, skb->len)) + goto clear_hash; +if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} +EXPORT_SYMBOL (tcp_v4_md5_hash_skb); + +int tcp_v6_md5_hash_skb (char *md5_hash, +const struct tcp_md5sig_key *key, +const struct sock *sk, +const struct sk_buff *skb) +{ +const struct in6_addr *saddr, *daddr; +struct tcp_md5sig_pool *hp; +struct ahash_request *req; +const struct tcphdr *th =tcp_hdr (skb); + +if (sk) {/* valid for establish/request sockets */ + saddr = &sk->sk_v6_rcv_saddr; + daddr = &sk->sk_v6_daddr; + }else { +const struct ipv6hdr *ip6h =ipv6_hdr (skb); + + saddr = &ip6h->saddr; + daddr = &ip6h->daddr; + } + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; + +if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, skb->len)) + goto clear_hash; +if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} + +/* Called with rcu_read_lock() */ +bool tcp_v4_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +/* This gets called for each TCP segment that arrives +* so we want to be efficient. +* We have 3 drop cases: +* o No MD5 hash and one expected. +* o MD5 hash and we're not expecting one. +* o MD5 hash and its wrong. +*/ +const __u8 *hash_location =NULL ; +struct tcp_md5sig_key *hash_expected; +const struct iphdr *iph =ip_hdr (skb); +const struct tcphdr *th =tcp_hdr (skb); +int genhash; +unsigned char newhash[16 ]; + + hash_expected =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&iph->saddr, +AF_INET ); + hash_location =tcp_parse_md5sig_option (th); + +/* We've parsed the options - do we have a hash? */ +if (!hash_expected && !hash_location) +return false; + +if (hash_expected && !hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); +return true; + } + +if (!hash_expected && hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); +return true; + } + +/* Okay, so this is hash_expected and hash_location - +* so we need to calculate the checksum. +*/ + genhash =tcp_v4_md5_hash_skb (newhash, + hash_expected, +NULL , skb); + +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); +net_info_ratelimited ("MD5 Hash failed for (%pI4, %d)->(%pI4, %d)%s\n" , + &iph->saddr,ntohs (th->source), + &iph->daddr,ntohs (th->dest), + genhash ?" tcp_v4_calc_md5_hash failed" + :"" ); +return true; + } +return false; +} + +bool tcp_v6_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +const __u8 *hash_location =NULL ; +struct tcp_md5sig_key *hash_expected; +const struct ipv6hdr *ip6h =ipv6_hdr (skb); +const struct tcphdr *th =tcp_hdr (skb); +int genhash; +u8 newhash[16 ]; + + hash_expected =tcp_v6_md5_do_lookup (sk, &ip6h->saddr); + hash_location =tcp_parse_md5sig_option (th); + +/* We've parsed the options - do we have a hash? */ +if (!hash_expected && !hash_location) +return false; + +if (hash_expected && !hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); +return true; + } + +if (!hash_expected && hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); +return true; + } + +/* check the signature */ + genhash =tcp_v6_md5_hash_skb (newhash, + hash_expected, +NULL , skb); + +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); +net_info_ratelimited ("MD5 Hash %s for [%pI6c]:%u->[%pI6c]:%u\n" , + genhash ?"failed" :"mismatch" , + &ip6h->saddr,ntohs (th->source), + &ip6h->daddr,ntohs (th->dest)); +return true; + } + +return false; +} + +void tcp_v4_md5_destroy_sock (struct sock *sk) +{ +struct tcp_sock *tp =tcp_sk (sk); + +/* Clean up the MD5 key list, if any */ +if (tp->md5sig_info) { +tcp_clear_md5_list (sk); +kfree_rcu (tp->md5sig_info, rcu); + tp->md5sig_info =NULL ; + } +} + +void tcp_v4_md5_syn_recv_sock (const struct sock *listener,struct sock *sk) +{ +struct inet_sock *inet =inet_sk (sk); +struct tcp_md5sig_key *key; + +/* Copy over the MD5 key from the original socket */ + key =tcp_md5_do_lookup (listener, (union tcp_md5_addr *)&inet->inet_daddr, +AF_INET ); +if (key) { +/* We're using one, so create a matching key +* on the sk structure. If we fail to get +* memory, then we end up not copying the key +* across. Shucks. +*/ +tcp_md5_do_add (sk, (union tcp_md5_addr *)&inet->inet_daddr, +AF_INET ,32 , key->key, key->keylen,GFP_ATOMIC ); +sk_nocaps_add (sk,NETIF_F_GSO_MASK ); + } +} + +void tcp_v6_md5_syn_recv_sock (const struct sock *listener,struct sock *sk) +{ +struct tcp_md5sig_key *key; + +/* Copy over the MD5 key from the original socket */ + key =tcp_v6_md5_do_lookup (listener, &sk->sk_v6_daddr); +if (key) { +/* We're using one, so create a matching key +* on the newsk structure. If we fail to get +* memory, then we end up not copying the key +* across. Shucks. +*/ +tcp_md5_do_add (sk, (union tcp_md5_addr *)&sk->sk_v6_daddr, +AF_INET6 ,128 , key->key, key->keylen, +sk_gfp_mask (sk,GFP_ATOMIC )); + } +} + +struct tcp_md5sig_key *tcp_v6_md5_lookup (const struct sock *sk, +const struct sock *addr_sk) +{ +return tcp_v6_md5_do_lookup (sk, &addr_sk->sk_v6_daddr); +} + +void tcp_md5_time_wait (struct sock *sk,struct inet_timewait_sock *tw) +{ +struct tcp_timewait_sock *tcptw =tcp_twsk ((struct sock *)tw); +struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; + +/* The timewait bucket does not have the key DB from the +* sock structure. We just make a quick copy of the +* md5 key being used (if indeed we are using one) +* so the timewait ack generating code has the key. +*/ + tcptw->tw_md5_key =NULL ; + key = tp->af_specific->md5_lookup (sk, sk); +if (key) { + tcptw->tw_md5_key =kmemdup (key,sizeof (*key),GFP_ATOMIC ); +if (tcptw->tw_md5_key && !tcp_alloc_md5sig_pool ()) +BUG (); + } +} + +static void tcp_diag_md5sig_fill (struct tcp_diag_md5sig *info, +const struct tcp_md5sig_key *key) +{ + info->tcpm_family = key->family; + info->tcpm_prefixlen = key->prefixlen; + info->tcpm_keylen = key->keylen; +memcpy (info->tcpm_key, key->key, key->keylen); + +if (key->family ==AF_INET ) + info->tcpm_addr[0 ] = key->addr.a4.s_addr; +#if IS_ENABLED (CONFIG_IPV6 ) + else if (key->family == AF_INET6) + memcpy(&info->tcpm_addr, &key->addr.a6, + sizeof(info->tcpm_addr)); +#endif +} + +static int tcp_diag_put_md5sig (struct sk_buff *skb, +const struct tcp_md5sig_info *md5sig) +{ +const struct tcp_md5sig_key *key; +struct tcp_diag_md5sig *info; +struct nlattr *attr; +int md5sig_count =0 ; + +hlist_for_each_entry_rcu (key, &md5sig->head, node) + md5sig_count++; +if (md5sig_count ==0 ) +return 0 ; + + attr =nla_reserve (skb,INET_DIAG_MD5SIG , + md5sig_count *sizeof (struct tcp_diag_md5sig )); +if (!attr) +return -EMSGSIZE ; + + info =nla_data (attr); +memset (info,0 , md5sig_count *sizeof (struct tcp_diag_md5sig )); +hlist_for_each_entry_rcu (key, &md5sig->head, node) { +tcp_diag_md5sig_fill (info++, key); +if (--md5sig_count ==0 ) +break ; + } + +return 0 ; +} + +int tcp_md5_diag_get_aux (struct sock *sk,bool net_admin,struct sk_buff *skb) +{ +if (net_admin) { +struct tcp_md5sig_info *md5sig; +int err =0 ; + +rcu_read_lock (); + md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); +if (md5sig) + err =tcp_diag_put_md5sig (skb, md5sig); +rcu_read_unlock (); +if (err <0 ) +return err; + } + +return 0 ; +} + +int tcp_md5_diag_get_aux_size (struct sock *sk,bool net_admin) +{ +int size =0 ; + +if (net_admin &&sk_fullsock (sk)) { +const struct tcp_md5sig_info *md5sig; +const struct tcp_md5sig_key *key; +size_t md5sig_count =0 ; + +rcu_read_lock (); + md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); +if (md5sig) { +hlist_for_each_entry_rcu (key, &md5sig->head, node) + md5sig_count++; + } +rcu_read_unlock (); + size +=nla_total_size (md5sig_count * +sizeof (struct tcp_diag_md5sig )); + } + +return size; +} + +const struct tcp_sock_af_ops tcp_sock_ipv4_specific = { + .md5_lookup = tcp_v4_md5_lookup, + .calc_md5_hash = tcp_v4_md5_hash_skb, + .md5_parse = tcp_v4_parse_md5_keys, +}; + +const struct tcp_sock_af_ops tcp_sock_ipv6_specific = { + .md5_lookup = tcp_v6_md5_lookup, + .calc_md5_hash = tcp_v6_md5_hash_skb, + .md5_parse = tcp_v6_parse_md5_keys, +}; + +const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific = { + .md5_lookup = tcp_v4_md5_lookup, + .calc_md5_hash = tcp_v4_md5_hash_skb, + .md5_parse = tcp_v6_parse_md5_keys, +}; +net/ipv4/tcp_minisocks.c +4
-23@@ -22,6 +22,7 @@#include <linux/module.h> #include <linux/slab.h> #include <linux/sysctl.h> +#include <linux/tcp_md5.h> #include <linux/workqueue.h> #include <net/tcp.h> #include <net/inet_common.h> @@ -286,22 +287,7 @@ void tcp_time_wait(struct sock *sk, int state, int timeo)#endif #ifdef CONFIG_TCP_MD5SIG -/* -* The timewait bucket does not have the key DB from the -* sock structure. We just make a quick copy of the -* md5 key being used (if indeed we are using one) -* so the timewait ack generating code has the key. -*/ -do { -struct tcp_md5sig_key *key; - tcptw->tw_md5_key =NULL ; - key = tp->af_specific->md5_lookup (sk, sk); -if (key) { - tcptw->tw_md5_key =kmemdup (key,sizeof (*key),GFP_ATOMIC ); -if (tcptw->tw_md5_key && !tcp_alloc_md5sig_pool ()) -BUG (); - } - }while (0 ); +tcp_md5_time_wait (sk, tw);#endif /* Get the TIME_WAIT timeout firing. */ @@ -331,10 +317,7 @@ void tcp_time_wait(struct sock *sk, int state, int timeo)void tcp_twsk_destructor (struct sock *sk) {#ifdef CONFIG_TCP_MD5SIG -struct tcp_timewait_sock *twsk =tcp_twsk (sk); - -if (twsk->tw_md5_key) -kfree_rcu (twsk->tw_md5_key, rcu); +tcp_md5_twsk_destructor (sk);#endif }EXPORT_SYMBOL_GPL (tcp_twsk_destructor);@@ -521,9 +504,7 @@ struct sock *tcp_create_openreq_child(const struct sock *sk, } newtp->tsoffset = treq->ts_off;#ifdef CONFIG_TCP_MD5SIG - newtp->md5sig_info =NULL ;/*XXX*/ -if (newtp->af_specific->md5_lookup (sk, newsk)) - newtp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +tcp_md5_add_header_len (sk, newsk);#endif if (static_branch_unlikely (&tcp_extra_options_enabled)) newtp->tcp_header_len +=tcp_extra_options_add_header (sk, newsk);net/ipv4/tcp_output.c +2
-2@@ -42,6 +42,7 @@#include <linux/gfp.h> #include <linux/module.h> #include <linux/static_key.h> +#include <linux/tcp_md5.h> /* People can turn this off for buggy TCP's found in printers etc. */ int sysctl_tcp_retrans_collapse__read_mostly =1 ;@@ -3249,8 +3250,7 @@ static void tcp_connect_init(struct sock *sk) tp->tcp_header_len +=TCPOLEN_TSTAMP_ALIGNED ;#ifdef CONFIG_TCP_MD5SIG -if (tp->af_specific->md5_lookup (sk, sk)) - tp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +tcp_md5_add_header_len (sk, sk);#endif if (static_branch_unlikely (&tcp_extra_options_enabled))net/ipv6/tcp_ipv6.c +3
-310@@ -43,6 +43,7 @@#include <linux/ipv6.h> #include <linux/icmpv6.h> #include <linux/random.h> +#include <linux/tcp_md5.h> #include <net/tcp.h> #include <net/ndisc.h> @@ -77,16 +78,6 @@ static int tcp_v6_do_rcv(struct sock *sk, struct sk_buff *skb);static const struct inet_connection_sock_af_ops ipv6_mapped;static const struct inet_connection_sock_af_ops ipv6_specific; -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv6_specific; -static const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific; -#else -static struct tcp_md5sig_key *tcp_v6_md5_do_lookup (const struct sock *sk, -const struct in6_addr *addr) -{ -return NULL ; -} -#endif static void inet6_sk_rx_dst_set (struct sock *sk,const struct sk_buff *skb) {@@ -502,218 +493,6 @@ static void tcp_v6_reqsk_destructor(struct request_sock *req)kfree_skb (inet_rsk (req)->pktopts); } -#ifdef CONFIG_TCP_MD5SIG -static struct tcp_md5sig_key *tcp_v6_md5_do_lookup (const struct sock *sk, -const struct in6_addr *addr) -{ -return tcp_md5_do_lookup (sk, (union tcp_md5_addr *)addr,AF_INET6 ); -} - -static struct tcp_md5sig_key *tcp_v6_md5_lookup (const struct sock *sk, -const struct sock *addr_sk) -{ -return tcp_v6_md5_do_lookup (sk, &addr_sk->sk_v6_daddr); -} - -static int tcp_v6_parse_md5_keys (struct sock *sk,int optname, -char __user *optval,int optlen) -{ -struct tcp_md5sig cmd; -struct sockaddr_in6 *sin6 = (struct sockaddr_in6 *)&cmd.tcpm_addr; -u8 prefixlen; - -if (optlen <sizeof (cmd)) -return -EINVAL ; - -if (copy_from_user (&cmd, optval,sizeof (cmd))) -return -EFAULT ; - -if (sin6->sin6_family !=AF_INET6 ) -return -EINVAL ; - -if (optname ==TCP_MD5SIG_EXT && - cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { - prefixlen = cmd.tcpm_prefixlen; -if (prefixlen >128 || (ipv6_addr_v4mapped (&sin6->sin6_addr) && - prefixlen >32 )) -return -EINVAL ; - }else { - prefixlen =ipv6_addr_v4mapped (&sin6->sin6_addr) ?32 :128 ; - } - -if (!cmd.tcpm_keylen) { -if (ipv6_addr_v4mapped (&sin6->sin6_addr)) -return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], -AF_INET , prefixlen); -return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr, -AF_INET6 , prefixlen); - } - -if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) -return -EINVAL ; - -if (ipv6_addr_v4mapped (&sin6->sin6_addr)) -return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], -AF_INET , prefixlen, cmd.tcpm_key, - cmd.tcpm_keylen,GFP_KERNEL ); - -return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr, -AF_INET6 , prefixlen, cmd.tcpm_key, - cmd.tcpm_keylen,GFP_KERNEL ); -} - -static int tcp_v6_md5_hash_headers (struct tcp_md5sig_pool *hp, -const struct in6_addr *daddr, -const struct in6_addr *saddr, -const struct tcphdr *th,int nbytes) -{ -struct tcp6_pseudohdr *bp; -struct scatterlist sg; -struct tcphdr *_th; - - bp = hp->scratch; -/* 1. TCP pseudo-header (RFC2460) */ - bp->saddr = *saddr; - bp->daddr = *daddr; - bp->protocol =cpu_to_be32 (IPPROTO_TCP ); - bp->len =cpu_to_be32 (nbytes); - - _th = (struct tcphdr *)(bp +1 ); -memcpy (_th, th,sizeof (*th)); - _th->check =0 ; - -sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); -ahash_request_set_crypt (hp->md5_req, &sg,NULL , -sizeof (*bp) +sizeof (*th)); -return crypto_ahash_update (hp->md5_req); -} - -static int tcp_v6_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, -const struct in6_addr *daddr,struct in6_addr *saddr, -const struct tcphdr *th) -{ -struct tcp_md5sig_pool *hp; -struct ahash_request *req; - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; -if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} - -static int tcp_v6_md5_hash_skb (char *md5_hash, -const struct tcp_md5sig_key *key, -const struct sock *sk, -const struct sk_buff *skb) -{ -const struct in6_addr *saddr, *daddr; -struct tcp_md5sig_pool *hp; -struct ahash_request *req; -const struct tcphdr *th =tcp_hdr (skb); - -if (sk) {/* valid for establish/request sockets */ - saddr = &sk->sk_v6_rcv_saddr; - daddr = &sk->sk_v6_daddr; - }else { -const struct ipv6hdr *ip6h =ipv6_hdr (skb); - saddr = &ip6h->saddr; - daddr = &ip6h->daddr; - } - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; - -if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, skb->len)) - goto clear_hash; -if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} - -#endif - -static bool tcp_v6_inbound_md5_hash (const struct sock *sk, -const struct sk_buff *skb) -{ -#ifdef CONFIG_TCP_MD5SIG -const __u8 *hash_location =NULL ; -struct tcp_md5sig_key *hash_expected; -const struct ipv6hdr *ip6h =ipv6_hdr (skb); -const struct tcphdr *th =tcp_hdr (skb); -int genhash; -u8 newhash[16 ]; - - hash_expected =tcp_v6_md5_do_lookup (sk, &ip6h->saddr); - hash_location =tcp_parse_md5sig_option (th); - -/* We've parsed the options - do we have a hash? */ -if (!hash_expected && !hash_location) -return false; - -if (hash_expected && !hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); -return true; - } - -if (!hash_expected && hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); -return true; - } - -/* check the signature */ - genhash =tcp_v6_md5_hash_skb (newhash, - hash_expected, -NULL , skb); - -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); -net_info_ratelimited ("MD5 Hash %s for [%pI6c]:%u->[%pI6c]:%u\n" , - genhash ?"failed" :"mismatch" , - &ip6h->saddr,ntohs (th->source), - &ip6h->daddr,ntohs (th->dest)); -return true; - } -#endif -return false; -} -static void tcp_v6_init_req (struct request_sock *req,const struct sock *sk_listener,struct sk_buff *skb)@@ -788,12 +567,6 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct dst_entry *dst;__be32 *topt; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key =NULL ; -const __u8 *hash_location =NULL ; -struct ipv6hdr *ipv6h =ipv6_hdr (skb); -#endif - buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -827,57 +600,7 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 }#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); - }else if (sk && sk->sk_state ==TCP_TIME_WAIT ) { -struct tcp_timewait_sock *tcptw =tcp_twsk (sk); - - key =tcp_twsk_md5_key (tcptw); - }else if (sk && sk->sk_state ==TCP_NEW_SYN_RECV ) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->daddr); - }else if (hash_location) { -unsigned char newhash[16 ]; -struct sock *sk1 =NULL ; -int genhash; - -/* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), - &tcp_hashinfo,NULL ,0 , - &ipv6h->saddr, - th->source, &ipv6h->daddr, -ntohs (th->source),tcp_v6_iif (skb), -tcp_v6_sdif (skb)); -if (!sk1) - goto go_on; - - key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); -if (!key) - goto go_on; - - genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto go_on; - } - -go_on: -rcu_read_unlock (); - -if (key) { - *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | - (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG ); -tcp_v6_md5_hash_hdr ((__u8 *)topt, key, - &ipv6_hdr (skb)->saddr, - &ipv6_hdr (skb)->daddr, t1); - - reduce +=TCPOLEN_MD5SIG_ALIGNED ; - } + reduce +=tcp_v6_md5_send_response_write (skb, t1, topt, sk);#endif buff->tail -= reduce;@@ -1044,9 +767,6 @@ static struct sock *tcp_v6_syn_recv_sock(const struct sock *sk, struct sk_buff *struct inet_sock *newinet;struct tcp_sock *newtp;struct sock *newsk; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key; -#endif struct flowi6 fl6;if (skb->protocol ==htons (ETH_P_IP )) {@@ -1191,18 +911,7 @@ static struct sock *tcp_v6_syn_recv_sock(const struct sock *sk, struct sk_buff * newinet->inet_rcv_saddr =LOOPBACK4_IPV6 ;#ifdef CONFIG_TCP_MD5SIG -/* Copy over the MD5 key from the original socket */ - key =tcp_v6_md5_do_lookup (sk, &newsk->sk_v6_daddr); -if (key) { -/* We're using one, so create a matching key -* on the newsk structure. If we fail to get -* memory, then we end up not copying the key -* across. Shucks. -*/ -tcp_md5_do_add (newsk, (union tcp_md5_addr *)&newsk->sk_v6_daddr, -AF_INET6 ,128 , key->key, key->keylen, -sk_gfp_mask (sk,GFP_ATOMIC )); - } +tcp_v6_md5_syn_recv_sock (sk, newsk);#endif if (__inet_inherit_port (sk, newsk) <0 ) {@@ -1657,14 +1366,6 @@ static const struct inet_connection_sock_af_ops ipv6_specific = { .mtu_reduced = tcp_v6_mtu_reduced, }; -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv6_specific = { - .md5_lookup = tcp_v6_md5_lookup, - .calc_md5_hash = tcp_v6_md5_hash_skb, - .md5_parse = tcp_v6_parse_md5_keys, -}; -#endif -/* * TCP over IPv4 via INET6 API */ @@ -1687,14 +1388,6 @@ static const struct inet_connection_sock_af_ops ipv6_mapped = { .mtu_reduced = tcp_v4_mtu_reduced, }; -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific = { - .md5_lookup = tcp_v4_md5_lookup, - .calc_md5_hash = tcp_v4_md5_hash_skb, - .md5_parse = tcp_v6_parse_md5_keys, -}; -#endif -/* NOTE: A lot of things set to zero explicitly by call to * sk_alloc() so need not be done here. */ Signature · 1 line
2.14.1
--
Mat Martineau
Intel OTC
Christoph Paasch
Re: [MPTCP] [PATCH 15/18] tcp: Move TCP-MD5 code out of TCP itself
Quoted 1,849 lines · Mat Martineau
Quoted 1,846 lines · Christoph Paasch
This is all just copy-pasting the TCP_MD5-code into functions that are placed in
net/ipv4/tcp_md5.c.Signed-off-by Christoph Paasch <cpaasch(a)apple.com>---
include/linux/inet_diag.h | 1 + include/linux/tcp_md5.h | 129 ++++++ include/net/tcp.h | 77 ---- net/ipv4/Makefile | 1 + net/ipv4/tcp.c | 133 +----- net/ipv4/tcp_diag.c | 81 +--- net/ipv4/tcp_input.c | 38 -- net/ipv4/tcp_ipv4.c | 498 +-------------------- net/ipv4/tcp_md5.c | 1080 +++++++++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_minisocks.c | 27 +- net/ipv4/tcp_output.c | 4 +- net/ipv6/tcp_ipv6.c | 313 +------------ 12 files changed, 1234 insertions(+), 1148 deletions(-)create mode 100644
include/linux/tcp_md5.h
create mode 100644net/ipv4/tcp_md5.cinclude/linux/inet_diag.h +1
-0@@ -1,6 +1,7 @@#ifndef _INET_DIAG_H_#define _INET_DIAG_H_ 1 +#include <linux/user_namespace.h> #include <uapi/linux/inet_diag.h> struct net ;include/linux/tcp_md5.h new file +129
-0@@ -0,0 +1,129 @@ +#ifndef _LINUX_TCP_MD5_H +#define _LINUX_TCP_MD5_H + +#ifdef CONFIG_TCP_MD5SIG + +#include <linux/types.h> + +#include <net/tcp.h> + +union tcp_md5_addr { +struct in_addr a4; +#if IS_ENABLED (CONFIG_IPV6 ) +struct in6_addr a6; +#endif +}; + +/* - key database */ +struct tcp_md5sig_key { +struct hlist_node node; +u8 keylen; +u8 family;/* AF_INET or AF_INET6 */ +union tcp_md5_addr addr; +u8 prefixlen; +u8 key[TCP_MD5SIG_MAXKEYLEN ]; +struct rcu_head rcu; +}; + +/* - sock block */ +struct tcp_md5sig_info { +struct hlist_head head; +struct rcu_head rcu; +}; + +union tcp_md5sum_block { +struct tcp4_pseudohdr ip4; +#if IS_ENABLED (CONFIG_IPV6 ) +struct tcp6_pseudohdr ip6; +#endif +}; + +/* - pool: digest algorithm, hash description and scratch buffer */ +struct tcp_md5sig_pool { +struct ahash_request *md5_req; +void *scratch; +}; + +extern const struct tcp_sock_af_ops tcp_sock_ipv4_specific; +extern const struct tcp_sock_af_ops tcp_sock_ipv6_specific; +extern const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific; + +/* - functions */ +int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, +const struct sock *sk,const struct sk_buff *skb); + +struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, +const struct sock *addr_sk); + +void tcp_v4_md5_destroy_sock (struct sock *sk); + +int tcp_v4_md5_send_reset (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt); + +void tcp_v4_md5_send_ack (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt); + +int tcp_v6_md5_send_response_write (struct sk_buff *skb,struct tcphdr *t1, +__be32 *topt,const struct sock *sk); + +bool tcp_v4_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb); + +void tcp_v4_md5_syn_recv_sock (const struct sock *listener,struct sock *sk); + +void tcp_v6_md5_syn_recv_sock (const struct sock *listener,struct sock *sk); + +void tcp_md5_time_wait (struct sock *sk,struct inet_timewait_sock *tw); + +struct tcp_md5sig_key *tcp_v6_md5_lookup (const struct sock *sk, +const struct sock *addr_sk); + +int tcp_v6_md5_hash_skb (char *md5_hash, +const struct tcp_md5sig_key *key, +const struct sock *sk, +const struct sk_buff *skb); + +bool tcp_v6_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb); + +static inline void tcp_md5_twsk_destructor (struct sock *sk) +{ +struct tcp_timewait_sock *twsk =tcp_twsk (sk); + +if (twsk->tw_md5_key) +kfree_rcu (twsk->tw_md5_key, rcu); +} + +static inline void tcp_md5_add_header_len (const struct sock *listener, +struct sock *sk) +{ +struct tcp_sock *tp =tcp_sk (sk); + + tp->md5sig_info =NULL ;/*XXX*/ +if (tp->af_specific->md5_lookup (listener, sk)) + tp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +} + +int tcp_md5_diag_get_aux (struct sock *sk,bool net_admin,struct sk_buff *skb); + +int tcp_md5_diag_get_aux_size (struct sock *sk,bool net_admin); + +#else + +static inline bool tcp_v4_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +return false; +} + +static inline bool tcp_v6_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +return false; +} + +#endif + +#endif /* _LINUX_TCP_MD5_H */ include/net/tcp.h +0
-77@@ -435,7 +435,6 @@ void tcp_parse_options(const struct net *net, const struct sk_buff *skb,struct tcp_options_received *opt_rx, int estab, struct tcp_fastopen_cookie *foc, struct tcp_sock *tp); -const u8 *tcp_parse_md5sig_option (const struct tcphdr *th);/* * TCP v4 functions exported for the inet6 API @@ -1443,30 +1442,6 @@ static inline void tcp_clear_all_retrans_hints(struct tcp_sock *tp) tp->retransmit_skb_hint =NULL ; } -union tcp_md5_addr { -struct in_addr a4; -#if IS_ENABLED (CONFIG_IPV6 ) -struct in6_addr a6; -#endif -}; - -/* - key database */ -struct tcp_md5sig_key { -struct hlist_node node; -u8 keylen; -u8 family;/* AF_INET or AF_INET6 */ -union tcp_md5_addr addr; -u8 prefixlen; -u8 key[TCP_MD5SIG_MAXKEYLEN ]; -struct rcu_head rcu; -}; - -/* - sock block */ -struct tcp_md5sig_info { -struct hlist_head head; -struct rcu_head rcu; -}; -/* - pseudo header */ struct tcp4_pseudohdr {__be32 saddr;@@ -1483,58 +1458,6 @@ struct tcp6_pseudohdr {__be32 protocol;/* including padding */ }; -union tcp_md5sum_block { -struct tcp4_pseudohdr ip4; -#if IS_ENABLED (CONFIG_IPV6 ) -struct tcp6_pseudohdr ip6; -#endif -}; - -/* - pool: digest algorithm, hash description and scratch buffer */ -struct tcp_md5sig_pool { -struct ahash_request *md5_req; -void *scratch; -}; - -/* - functions */ -int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, -const struct sock *sk,const struct sk_buff *skb); -int tcp_md5_do_add (struct sock *sk,const union tcp_md5_addr *addr, -int family,u8 prefixlen,const u8 *newkey,u8 newkeylen, -gfp_t gfp); -int tcp_md5_do_del (struct sock *sk,const union tcp_md5_addr *addr, -int family,u8 prefixlen); -struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, -const struct sock *addr_sk); - -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, -const union tcp_md5_addr *addr, -int family); -#define tcp_twsk_md5_key (twsk) ((twsk)->tw_md5_key) -#else -static inline struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, -const union tcp_md5_addr *addr, -int family) -{ -return NULL ; -} -#define tcp_twsk_md5_key (twsk) NULL -#endif - -bool tcp_alloc_md5sig_pool (void ); - -struct tcp_md5sig_pool *tcp_get_md5sig_pool (void ); -static inline void tcp_put_md5sig_pool (void ) -{ -local_bh_enable (); -} - -int tcp_md5_hash_skb_data (struct tcp_md5sig_pool *,const struct sk_buff *, -unsigned int header_len); -int tcp_md5_hash_key (struct tcp_md5sig_pool *hp, -const struct tcp_md5sig_key *key); -/* From tcp_fastopen.c */ void tcp_fastopen_cache_get(struct sock *sk, u16 *mss, struct tcp_fastopen_cookie *cookie, int *syn_loss,net/ipv4/Makefile +0
-0@@ -60,6 +60,7 @@ obj-$(CONFIG_TCP_CONG_LP) += tcp_lp.oobj-$(CONFIG_TCP_CONG_YEAH) += tcp_yeah.o
obj-$(CONFIG_TCP_CONG_ILLINOIS) += tcp_illinois.o
obj-$(CONFIG_NETLABEL) += cipso_ipv4.o
+obj-$(CONFIG_TCP_MD5SIG) += tcp_md5.oobj-$(CONFIG_XFRM) += xfrm4_policy.o xfrm4_state.o xfrm4_input.o \
xfrm4_output.o xfrm4_protocol.onet/ipv4/tcp.c +1
-132@@ -271,6 +271,7 @@#include <linux/slab.h> #include <linux/errqueue.h> #include <linux/static_key.h> +#include <linux/tcp_md5.h> #include <net/icmp.h> #include <net/inet_common.h> @@ -3249,138 +3250,6 @@ int compat_tcp_getsockopt(struct sock *sk, int level, int optname,EXPORT_SYMBOL (compat_tcp_getsockopt);#endif -#ifdef CONFIG_TCP_MD5SIG -static DEFINE_PER_CPU(struct tcp_md5sig_pool, tcp_md5sig_pool); -static DEFINE_MUTEX (tcp_md5sig_mutex); -static bool tcp_md5sig_pool_populated = false; - -static void __tcp_alloc_md5sig_pool (void ) -{ -struct crypto_ahash *hash; -int cpu; - - hash =crypto_alloc_ahash ("md5" ,0 ,CRYPTO_ALG_ASYNC ); -if (IS_ERR (hash)) -return ; - -for_each_possible_cpu (cpu) { -void *scratch =per_cpu (tcp_md5sig_pool, cpu).scratch; -struct ahash_request *req; - -if (!scratch) { - scratch =kmalloc_node (sizeof (union tcp_md5sum_block ) + -sizeof (struct tcphdr ), -GFP_KERNEL , -cpu_to_node (cpu)); -if (!scratch) -return ; -per_cpu (tcp_md5sig_pool, cpu).scratch = scratch; - } -if (per_cpu (tcp_md5sig_pool, cpu).md5_req) -continue ; - - req =ahash_request_alloc (hash,GFP_KERNEL ); -if (!req) -return ; - -ahash_request_set_callback (req,0 ,NULL ,NULL ); - -per_cpu (tcp_md5sig_pool, cpu).md5_req = req; - } -/* before setting tcp_md5sig_pool_populated, we must commit all writes -* to memory. See smp_rmb() in tcp_get_md5sig_pool() -*/ -smp_wmb (); - tcp_md5sig_pool_populated = true; -} - -bool tcp_alloc_md5sig_pool (void ) -{ -if (unlikely (!tcp_md5sig_pool_populated)) { -mutex_lock (&tcp_md5sig_mutex); - -if (!tcp_md5sig_pool_populated) -__tcp_alloc_md5sig_pool (); - -mutex_unlock (&tcp_md5sig_mutex); - } -return tcp_md5sig_pool_populated; -} -EXPORT_SYMBOL (tcp_alloc_md5sig_pool); - - -/** -* tcp_get_md5sig_pool - get md5sig_pool for this user -* -* We use percpu structure, so if we succeed, we exit with preemption -* and BH disabled, to make sure another thread or softirq handling -* wont try to get same context. -*/ -struct tcp_md5sig_pool *tcp_get_md5sig_pool (void ) -{ -local_bh_disable (); - -if (tcp_md5sig_pool_populated) { -/* coupled with smp_wmb() in __tcp_alloc_md5sig_pool() */ -smp_rmb (); -return this_cpu_ptr (&tcp_md5sig_pool); - } -local_bh_enable (); -return NULL ; -} -EXPORT_SYMBOL (tcp_get_md5sig_pool); - -int tcp_md5_hash_skb_data (struct tcp_md5sig_pool *hp, -const struct sk_buff *skb,unsigned int header_len) -{ -struct scatterlist sg; -const struct tcphdr *tp =tcp_hdr (skb); -struct ahash_request *req = hp->md5_req; -unsigned int i; -const unsigned int head_data_len =skb_headlen (skb) > header_len ? -skb_headlen (skb) - header_len :0 ; -const struct skb_shared_info *shi =skb_shinfo (skb); -struct sk_buff *frag_iter; - -sg_init_table (&sg,1 ); - -sg_set_buf (&sg, ((u8 *) tp) + header_len, head_data_len); -ahash_request_set_crypt (req, &sg,NULL , head_data_len); -if (crypto_ahash_update (req)) -return 1 ; - -for (i =0 ; i < shi->nr_frags; ++i) { -const struct skb_frag_struct *f = &shi->frags[i]; -unsigned int offset = f->page_offset; -struct page *page =skb_frag_page (f) + (offset >>PAGE_SHIFT ); - -sg_set_page (&sg, page,skb_frag_size (f), -offset_in_page (offset)); -ahash_request_set_crypt (req, &sg,NULL ,skb_frag_size (f)); -if (crypto_ahash_update (req)) -return 1 ; - } - - skb_walk_frags(skb, frag_iter) -if (tcp_md5_hash_skb_data (hp, frag_iter,0 )) -return 1 ; - -return 0 ; -} -EXPORT_SYMBOL (tcp_md5_hash_skb_data); - -int tcp_md5_hash_key (struct tcp_md5sig_pool *hp,const struct tcp_md5sig_key *key) -{ -struct scatterlist sg; - -sg_init_one (&sg, key->key, key->keylen); -ahash_request_set_crypt (hp->md5_req, &sg,NULL , key->keylen); -return crypto_ahash_update (hp->md5_req); -} -EXPORT_SYMBOL (tcp_md5_hash_key); - -#endif -/* Linear search, few entries are expected. The RCU read lock must * be held before calling. */ net/ipv4/tcp_diag.c +6
-75@@ -15,6 +15,7 @@#include <linux/inet_diag.h> #include <linux/tcp.h> +#include <linux/tcp_md5.h> #include <net/netlink.h> #include <net/tcp.h> @@ -37,70 +38,14 @@ static void tcp_diag_get_info(struct sock *sk, struct inet_diag_msg *r,tcp_get_info (sk, info); } -#ifdef CONFIG_TCP_MD5SIG -static void tcp_diag_md5sig_fill (struct tcp_diag_md5sig *info, -const struct tcp_md5sig_key *key) -{ - info->tcpm_family = key->family; - info->tcpm_prefixlen = key->prefixlen; - info->tcpm_keylen = key->keylen; -memcpy (info->tcpm_key, key->key, key->keylen); - -if (key->family ==AF_INET ) - info->tcpm_addr[0 ] = key->addr.a4.s_addr; -#if IS_ENABLED (CONFIG_IPV6 ) - else if (key->family == AF_INET6) - memcpy(&info->tcpm_addr, &key->addr.a6, - sizeof(info->tcpm_addr)); -#endif -} - -static int tcp_diag_put_md5sig (struct sk_buff *skb, -const struct tcp_md5sig_info *md5sig) -{ -const struct tcp_md5sig_key *key; -struct tcp_diag_md5sig *info; -struct nlattr *attr; -int md5sig_count =0 ; - -hlist_for_each_entry_rcu (key, &md5sig->head, node) - md5sig_count++; -if (md5sig_count ==0 ) -return 0 ; - - attr =nla_reserve (skb,INET_DIAG_MD5SIG , - md5sig_count *sizeof (struct tcp_diag_md5sig )); -if (!attr) -return -EMSGSIZE ; - - info =nla_data (attr); -memset (info,0 , md5sig_count *sizeof (struct tcp_diag_md5sig )); -hlist_for_each_entry_rcu (key, &md5sig->head, node) { -tcp_diag_md5sig_fill (info++, key); -if (--md5sig_count ==0 ) -break ; - } - -return 0 ; -} -#endif -static int tcp_diag_get_aux (struct sock *sk,bool net_admin,struct sk_buff *skb) {#ifdef CONFIG_TCP_MD5SIG -if (net_admin) { -struct tcp_md5sig_info *md5sig; -int err =0 ; - -rcu_read_lock (); - md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); -if (md5sig) - err =tcp_diag_put_md5sig (skb, md5sig); -rcu_read_unlock (); -if (err <0 ) -return err; - } +int err =tcp_md5_diag_get_aux (sk, net_admin, skb); + +if (err <0 ) +return err;#endif return 0 ;@@ -111,21 +56,7 @@ static size_t tcp_diag_get_aux_size(struct sock *sk, bool net_admin)size_t size =0 ;#ifdef CONFIG_TCP_MD5SIG -if (net_admin &&sk_fullsock (sk)) { -const struct tcp_md5sig_info *md5sig; -const struct tcp_md5sig_key *key; -size_t md5sig_count =0 ; - -rcu_read_lock (); - md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); -if (md5sig) { -hlist_for_each_entry_rcu (key, &md5sig->head, node) - md5sig_count++; - } -rcu_read_unlock (); - size +=nla_total_size (md5sig_count * -sizeof (struct tcp_diag_md5sig )); - } + size +=tcp_md5_diag_get_aux_size (sk, net_admin);#endif return size;net/ipv4/tcp_input.c +0
-38@@ -3887,44 +3887,6 @@ static bool tcp_fast_parse_options(const struct net *net,return true; } -#ifdef CONFIG_TCP_MD5SIG -/* -* Parse MD5 Signature option -*/ -const u8 *tcp_parse_md5sig_option (const struct tcphdr *th) -{ -int length = (th->doff <<2 ) -sizeof (*th); -const u8 *ptr = (const u8 *)(th +1 ); - -/* If the TCP option is too short, we can short cut */ -if (length <TCPOLEN_MD5SIG ) -return NULL ; - -while (length >0 ) { -int opcode = *ptr++; -int opsize; - -switch (opcode) { -case TCPOPT_EOL : -return NULL ; -case TCPOPT_NOP : - length--; -continue ; -default : - opsize = *ptr++; -if (opsize <2 || opsize > length) -return NULL ; -if (opcode ==TCPOPT_MD5SIG ) -return opsize ==TCPOLEN_MD5SIG ? ptr :NULL ; - } - ptr += opsize -2 ; - length -= opsize; - } -return NULL ; -} -EXPORT_SYMBOL (tcp_parse_md5sig_option); -#endif -/* Sorry, PAWS as specified is broken wrt. pure-ACKs -DaveM * * It is not fatal. If this ACK does _not_ change critical state (seqs, window) net/ipv4/tcp_ipv4.c +7
-491@@ -62,6 +62,7 @@#include <linux/init.h> #include <linux/times.h> #include <linux/slab.h> +#include <linux/tcp_md5.h> #include <net/net_namespace.h> #include <net/icmp.h> @@ -85,11 +86,6 @@#include <crypto/hash.h> #include <linux/scatterlist.h> -#ifdef CONFIG_TCP_MD5SIG -static int tcp_v4_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, -__be32 daddr,__be32 saddr,const struct tcphdr *th); -#endif -struct inet_hashinfo tcp_hashinfo;EXPORT_SYMBOL (tcp_hashinfo);@@ -603,13 +599,6 @@ static void tcp_v4_send_reset(const struct sock *sk, struct sk_buff *skb)#endif } rep;struct ip_reply_arg arg; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key =NULL ; -const __u8 *hash_location =NULL ; -unsigned char newhash[16 ]; -int genhash; -struct sock *sk1 =NULL ; -#endif struct net *net;/* Never send a reset in response to a reset. */ @@ -643,53 +632,8 @@ static void tcp_v4_send_reset(const struct sock *sk, struct sk_buff *skb) net = sk ?sock_net (sk) :dev_net (skb_dst (skb)->dev);#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *) - &ip_hdr (skb)->saddr,AF_INET ); - }else if (hash_location) { -/* -* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =__inet_lookup_listener (net, &tcp_hashinfo,NULL ,0 , -ip_hdr (skb)->saddr, - th->source,ip_hdr (skb)->daddr, -ntohs (th->source),inet_iif (skb), -tcp_v4_sdif (skb)); -/* don't send rst if it can't find key */ -if (!sk1) - goto out; - - key =tcp_md5_do_lookup (sk1, (union tcp_md5_addr *) - &ip_hdr (skb)->saddr,AF_INET ); -if (!key) - goto out; - - - genhash =tcp_v4_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto out; - - } - -if (key) { - rep.opt[0 ] =htonl ((TCPOPT_NOP <<24 ) | - (TCPOPT_NOP <<16 ) | - (TCPOPT_MD5SIG <<8 ) | -TCPOLEN_MD5SIG ); -/* Update length and the length the header thinks exists */ - arg.iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; - rep.th.doff = arg.iov[0 ].iov_len /4 ; - -tcp_v4_md5_hash_hdr ((__u8 *) &rep.opt[1 ], - key,ip_hdr (skb)->saddr, -ip_hdr (skb)->daddr, &rep.th); - } +if (tcp_v4_md5_send_reset (skb, sk, &arg, &rep.th, rep.opt)) +return ;#endif arg.csum = csum_tcpudp_nofold(ip_hdr(skb)->daddr, ip_hdr(skb)->saddr, /* XXX */@@ -718,11 +662,6 @@ static void tcp_v4_send_reset(const struct sock *sk, struct sk_buff *skb)__TCP_INC_STATS (net,TCP_MIB_OUTSEGS );__TCP_INC_STATS (net,TCP_MIB_OUTRSTS );local_bh_enable (); - -#ifdef CONFIG_TCP_MD5SIG -out: -rcu_read_unlock (); -#endif }/* The code following below sending ACKs in SYN-RECV and TIME-WAIT states @@ -743,9 +682,6 @@ static void tcp_v4_send_ack(const struct sock *sk,#endif ]; } rep; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key; -#endif struct net *net =sock_net (sk);struct ip_reply_arg arg;@@ -773,31 +709,8 @@ static void tcp_v4_send_ack(const struct sock *sk, rep.th.window =htons (win);#ifdef CONFIG_TCP_MD5SIG -if (sk->sk_state ==TCP_TIME_WAIT ) { -struct tcp_timewait_sock *tcptw =tcp_twsk (sk); - - key =tcp_twsk_md5_key (tcptw); - }else if (sk->sk_state ==TCP_NEW_SYN_RECV ) { - key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&ip_hdr (skb)->daddr, -AF_INET ); - }else { -BUG (); - } - -if (key) { -int offset = (tsecr) ?3 :0 ; - - rep.opt[offset++] =htonl ((TCPOPT_NOP <<24 ) | - (TCPOPT_NOP <<16 ) | - (TCPOPT_MD5SIG <<8 ) | -TCPOLEN_MD5SIG ); - arg.iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; - rep.th.doff = arg.iov[0 ].iov_len/4 ; - -tcp_v4_md5_hash_hdr ((__u8 *) &rep.opt[offset], - key,ip_hdr (skb)->saddr, -ip_hdr (skb)->daddr, &rep.th); - } +tcp_v4_md5_send_ack (skb, sk, &arg, &rep.th, + (tsecr) ? &rep.opt[3 ] : &rep.opt[0 ]);#endif arg.flags = reply_flags; arg.csum = csum_tcpudp_nofold(ip_hdr(skb)->daddr,@@ -902,374 +815,6 @@ static void tcp_v4_reqsk_destructor(struct request_sock *req)kfree (inet_rsk (req)->opt); } -#ifdef CONFIG_TCP_MD5SIG -/* -* RFC2385 MD5 checksumming requires a mapping of -* IP address->MD5 Key. -* We need to maintain these in the sk structure. -*/ - -/* Find the Key structure for an address. */ -struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, -const union tcp_md5_addr *addr, -int family) -{ -const struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_key *key; -const struct tcp_md5sig_info *md5sig; -__be32 mask; -struct tcp_md5sig_key *best_match =NULL ; -bool match; - -/* caller either holds rcu_read_lock() or socket lock */ - md5sig =rcu_dereference_check (tp->md5sig_info, -lockdep_sock_is_held (sk)); -if (!md5sig) -return NULL ; - -hlist_for_each_entry_rcu (key, &md5sig->head, node) { -if (key->family != family) -continue ; - -if (family ==AF_INET ) { - mask =inet_make_mask (key->prefixlen); - match = (key->addr.a4.s_addr & mask) == - (addr->a4.s_addr & mask); -#if IS_ENABLED (CONFIG_IPV6 ) - } else if (family == AF_INET6) { - match =ipv6_prefix_equal (&key->addr.a6, &addr->a6, - key->prefixlen); -#endif - }else { - match = false; - } - -if (match && (!best_match || - key->prefixlen > best_match->prefixlen)) - best_match = key; - } -return best_match; -} -EXPORT_SYMBOL (tcp_md5_do_lookup); - -static struct tcp_md5sig_key *tcp_md5_do_lookup_exact (const struct sock *sk, -const union tcp_md5_addr *addr, -int family,u8 prefixlen) -{ -const struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_key *key; -unsigned int size =sizeof (struct in_addr ); -const struct tcp_md5sig_info *md5sig; - -/* caller either holds rcu_read_lock() or socket lock */ - md5sig =rcu_dereference_check (tp->md5sig_info, -lockdep_sock_is_held (sk)); -if (!md5sig) -return NULL ; -#if IS_ENABLED (CONFIG_IPV6 ) -if (family ==AF_INET6 ) - size =sizeof (struct in6_addr ); -#endif -hlist_for_each_entry_rcu (key, &md5sig->head, node) { -if (key->family != family) -continue ; -if (!memcmp (&key->addr, addr, size) && - key->prefixlen == prefixlen) -return key; - } -return NULL ; -} - -struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, -const struct sock *addr_sk) -{ -const union tcp_md5_addr *addr; - - addr = (const union tcp_md5_addr *)&addr_sk->sk_daddr; -return tcp_md5_do_lookup (sk, addr,AF_INET ); -} -EXPORT_SYMBOL (tcp_v4_md5_lookup); - -/* This can be called on a newly created socket, from other files */ -int tcp_md5_do_add (struct sock *sk,const union tcp_md5_addr *addr, -int family,u8 prefixlen,const u8 *newkey,u8 newkeylen, -gfp_t gfp) -{ -/* Add Key to the list */ -struct tcp_md5sig_key *key; -struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_info *md5sig; - - key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); -if (key) { -/* Pre-existing entry - just update that one. */ -memcpy (key->key, newkey, newkeylen); - key->keylen = newkeylen; -return 0 ; - } - - md5sig =rcu_dereference_protected (tp->md5sig_info, -lockdep_sock_is_held (sk)); -if (!md5sig) { - md5sig =kmalloc (sizeof (*md5sig), gfp); -if (!md5sig) -return -ENOMEM ; - -sk_nocaps_add (sk,NETIF_F_GSO_MASK ); -INIT_HLIST_HEAD (&md5sig->head); -rcu_assign_pointer (tp->md5sig_info, md5sig); - } - - key =sock_kmalloc (sk,sizeof (*key), gfp); -if (!key) -return -ENOMEM ; -if (!tcp_alloc_md5sig_pool ()) { -sock_kfree_s (sk, key,sizeof (*key)); -return -ENOMEM ; - } - -memcpy (key->key, newkey, newkeylen); - key->keylen = newkeylen; - key->family = family; - key->prefixlen = prefixlen; -memcpy (&key->addr, addr, - (family ==AF_INET6 ) ?sizeof (struct in6_addr ) : -sizeof (struct in_addr )); -hlist_add_head_rcu (&key->node, &md5sig->head); -return 0 ; -} -EXPORT_SYMBOL (tcp_md5_do_add); - -int tcp_md5_do_del (struct sock *sk,const union tcp_md5_addr *addr,int family, -u8 prefixlen) -{ -struct tcp_md5sig_key *key; - - key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); -if (!key) -return -ENOENT ; -hlist_del_rcu (&key->node); -atomic_sub (sizeof (*key), &sk->sk_omem_alloc); -kfree_rcu (key, rcu); -return 0 ; -} -EXPORT_SYMBOL (tcp_md5_do_del); - -static void tcp_clear_md5_list (struct sock *sk) -{ -struct tcp_sock *tp =tcp_sk (sk); -struct tcp_md5sig_key *key; -struct hlist_node *n; -struct tcp_md5sig_info *md5sig; - - md5sig =rcu_dereference_protected (tp->md5sig_info,1 ); - -hlist_for_each_entry_safe (key, n, &md5sig->head, node) { -hlist_del_rcu (&key->node); -atomic_sub (sizeof (*key), &sk->sk_omem_alloc); -kfree_rcu (key, rcu); - } -} - -static int tcp_v4_parse_md5_keys (struct sock *sk,int optname, -char __user *optval,int optlen) -{ -struct tcp_md5sig cmd; -struct sockaddr_in *sin = (struct sockaddr_in *)&cmd.tcpm_addr; -u8 prefixlen =32 ; - -if (optlen <sizeof (cmd)) -return -EINVAL ; - -if (copy_from_user (&cmd, optval,sizeof (cmd))) -return -EFAULT ; - -if (sin->sin_family !=AF_INET ) -return -EINVAL ; - -if (optname ==TCP_MD5SIG_EXT && - cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { - prefixlen = cmd.tcpm_prefixlen; -if (prefixlen >32 ) -return -EINVAL ; - } - -if (!cmd.tcpm_keylen) -return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, -AF_INET , prefixlen); - -if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) -return -EINVAL ; - -return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, -AF_INET , prefixlen, cmd.tcpm_key, cmd.tcpm_keylen, -GFP_KERNEL ); -} - -static int tcp_v4_md5_hash_headers (struct tcp_md5sig_pool *hp, -__be32 daddr,__be32 saddr, -const struct tcphdr *th,int nbytes) -{ -struct tcp4_pseudohdr *bp; -struct scatterlist sg; -struct tcphdr *_th; - - bp = hp->scratch; - bp->saddr = saddr; - bp->daddr = daddr; - bp->pad =0 ; - bp->protocol =IPPROTO_TCP ; - bp->len =cpu_to_be16 (nbytes); - - _th = (struct tcphdr *)(bp +1 ); -memcpy (_th, th,sizeof (*th)); - _th->check =0 ; - -sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); -ahash_request_set_crypt (hp->md5_req, &sg,NULL , -sizeof (*bp) +sizeof (*th)); -return crypto_ahash_update (hp->md5_req); -} - -static int tcp_v4_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, -__be32 daddr,__be32 saddr,const struct tcphdr *th) -{ -struct tcp_md5sig_pool *hp; -struct ahash_request *req; - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; -if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} - -int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, -const struct sock *sk, -const struct sk_buff *skb) -{ -struct tcp_md5sig_pool *hp; -struct ahash_request *req; -const struct tcphdr *th =tcp_hdr (skb); -__be32 saddr, daddr; - -if (sk) {/* valid for establish/request sockets */ - saddr = sk->sk_rcv_saddr; - daddr = sk->sk_daddr; - }else { -const struct iphdr *iph =ip_hdr (skb); - saddr = iph->saddr; - daddr = iph->daddr; - } - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; - -if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, skb->len)) - goto clear_hash; -if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} -EXPORT_SYMBOL (tcp_v4_md5_hash_skb); - -#endif - -/* Called with rcu_read_lock() */ -static bool tcp_v4_inbound_md5_hash (const struct sock *sk, -const struct sk_buff *skb) -{ -#ifdef CONFIG_TCP_MD5SIG -/* -* This gets called for each TCP segment that arrives -* so we want to be efficient. -* We have 3 drop cases: -* o No MD5 hash and one expected. -* o MD5 hash and we're not expecting one. -* o MD5 hash and its wrong. -*/ -const __u8 *hash_location =NULL ; -struct tcp_md5sig_key *hash_expected; -const struct iphdr *iph =ip_hdr (skb); -const struct tcphdr *th =tcp_hdr (skb); -int genhash; -unsigned char newhash[16 ]; - - hash_expected =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&iph->saddr, -AF_INET ); - hash_location =tcp_parse_md5sig_option (th); - -/* We've parsed the options - do we have a hash? */ -if (!hash_expected && !hash_location) -return false; - -if (hash_expected && !hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); -return true; - } - -if (!hash_expected && hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); -return true; - } - -/* Okay, so this is hash_expected and hash_location - -* so we need to calculate the checksum. -*/ - genhash =tcp_v4_md5_hash_skb (newhash, - hash_expected, -NULL , skb); - -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); -net_info_ratelimited ("MD5 Hash failed for (%pI4, %d)->(%pI4, %d)%s\n" , - &iph->saddr,ntohs (th->source), - &iph->daddr,ntohs (th->dest), - genhash ?" tcp_v4_calc_md5_hash failed" - :"" ); -return true; - } -return false; -#endif -return false; -} -static void tcp_v4_init_req (struct request_sock *req,const struct sock *sk_listener,struct sk_buff *skb)@@ -1344,9 +889,6 @@ struct sock *tcp_v4_syn_recv_sock(const struct sock *sk, struct sk_buff *skb,struct inet_sock *newinet;struct tcp_sock *newtp;struct sock *newsk; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key; -#endif struct ip_options_rcu *inet_opt;if (sk_acceptq_is_full (sk))@@ -1394,20 +936,7 @@ struct sock *tcp_v4_syn_recv_sock(const struct sock *sk, struct sk_buff *skb,tcp_initialize_rcv_mss (newsk);#ifdef CONFIG_TCP_MD5SIG -/* Copy over the MD5 key from the original socket */ - key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&newinet->inet_daddr, -AF_INET ); -if (key) { -/* -* We're using one, so create a matching key -* on the newsk structure. If we fail to get -* memory, then we end up not copying the key -* across. Shucks. -*/ -tcp_md5_do_add (newsk, (union tcp_md5_addr *)&newinet->inet_daddr, -AF_INET ,32 , key->key, key->keylen,GFP_ATOMIC ); -sk_nocaps_add (newsk,NETIF_F_GSO_MASK ); - } +tcp_v4_md5_syn_recv_sock (sk, newsk);#endif if (__inet_inherit_port (sk, newsk) <0 )@@ -1839,14 +1368,6 @@ const struct inet_connection_sock_af_ops ipv4_specific = { };EXPORT_SYMBOL (ipv4_specific); -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv4_specific = { - .md5_lookup = tcp_v4_md5_lookup, - .calc_md5_hash = tcp_v4_md5_hash_skb, - .md5_parse = tcp_v4_parse_md5_keys, -}; -#endif -/* NOTE: A lot of things set to zero explicitly by call to * sk_alloc() so need not be done here. */ @@ -1885,12 +1406,7 @@ void tcp_v4_destroy_sock(struct sock *sk)skb_rbtree_purge (&tp->out_of_order_queue);#ifdef CONFIG_TCP_MD5SIG -/* Clean up the MD5 key list, if any */ -if (tp->md5sig_info) { -tcp_clear_md5_list (sk); -kfree_rcu (tp->md5sig_info, rcu); - tp->md5sig_info =NULL ; - } +tcp_v4_md5_destroy_sock (sk);#endif /* Clean up a referenced TCP bind bucket. */ net/ipv4/tcp_md5.c new file +662
-0@@ -0,0 +1,1080 @@ +#include <linux/inet_diag.h> +#include <linux/inetdevice.h> +#include <linux/tcp.h> +#include <linux/tcp_md5.h> + +#include <crypto/hash.h> + +#include <net/inet6_hashtables.h> + +static DEFINE_PER_CPU(struct tcp_md5sig_pool, tcp_md5sig_pool); +static DEFINE_MUTEX (tcp_md5sig_mutex); +static bool tcp_md5sig_pool_populated; + +#define tcp_twsk_md5_key (twsk) ((twsk)->tw_md5_key) + +static void __tcp_alloc_md5sig_pool (void ) +{ +struct crypto_ahash *hash; +int cpu; + + hash =crypto_alloc_ahash ("md5" ,0 ,CRYPTO_ALG_ASYNC ); +if (IS_ERR (hash)) +return ; + +for_each_possible_cpu (cpu) { +void *scratch =per_cpu (tcp_md5sig_pool, cpu).scratch; +struct ahash_request *req; + +if (!scratch) { + scratch =kmalloc_node (sizeof (union tcp_md5sum_block ) + +sizeof (struct tcphdr ), +GFP_KERNEL , +cpu_to_node (cpu)); +if (!scratch) +return ; +per_cpu (tcp_md5sig_pool, cpu).scratch = scratch; + } +if (per_cpu (tcp_md5sig_pool, cpu).md5_req) +continue ; + + req =ahash_request_alloc (hash,GFP_KERNEL ); +if (!req) +return ; + +ahash_request_set_callback (req,0 ,NULL ,NULL ); + +per_cpu (tcp_md5sig_pool, cpu).md5_req = req; + } +/* before setting tcp_md5sig_pool_populated, we must commit all writes +* to memory. See smp_rmb() in tcp_get_md5sig_pool() +*/ +smp_wmb (); + tcp_md5sig_pool_populated = true; +} + +static bool tcp_alloc_md5sig_pool (void ) +{ +if (unlikely (!tcp_md5sig_pool_populated)) { +mutex_lock (&tcp_md5sig_mutex); + +if (!tcp_md5sig_pool_populated) +__tcp_alloc_md5sig_pool (); + +mutex_unlock (&tcp_md5sig_mutex); + } +return tcp_md5sig_pool_populated; +} + +static void tcp_put_md5sig_pool (void ) +{ +local_bh_enable (); +} + +/** +* tcp_get_md5sig_pool - get md5sig_pool for this user +* +* We use percpu structure, so if we succeed, we exit with preemption +* and BH disabled, to make sure another thread or softirq handling +* wont try to get same context. +*/ +static struct tcp_md5sig_pool *tcp_get_md5sig_pool (void ) +{ +local_bh_disable (); + +if (tcp_md5sig_pool_populated) { +/* coupled with smp_wmb() in __tcp_alloc_md5sig_pool() */ +smp_rmb (); +return this_cpu_ptr (&tcp_md5sig_pool); + } +local_bh_enable (); +return NULL ; +} + +static struct tcp_md5sig_key *tcp_md5_do_lookup_exact (const struct sock *sk, +const union tcp_md5_addr *addr, +int family,u8 prefixlen) +{ +const struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; +unsigned int size =sizeof (struct in_addr ); +const struct tcp_md5sig_info *md5sig; + +/* caller either holds rcu_read_lock() or socket lock */ + md5sig =rcu_dereference_check (tp->md5sig_info, +lockdep_sock_is_held (sk)); +if (!md5sig) +return NULL ; +#if IS_ENABLED (CONFIG_IPV6 ) +if (family ==AF_INET6 ) + size =sizeof (struct in6_addr ); +#endif +hlist_for_each_entry_rcu (key, &md5sig->head, node) { +if (key->family != family) +continue ; +if (!memcmp (&key->addr, addr, size) && + key->prefixlen == prefixlen) +return key; + } +return NULL ; +} + +/* This can be called on a newly created socket, from other files */ +static int tcp_md5_do_add (struct sock *sk,const union tcp_md5_addr *addr, +int family,u8 prefixlen,const u8 *newkey, +u8 newkeylen,gfp_t gfp) +{ +/* Add Key to the list */ +struct tcp_md5sig_key *key; +struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_info *md5sig; + + key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); +if (key) { +/* Pre-existing entry - just update that one. */ +memcpy (key->key, newkey, newkeylen); + key->keylen = newkeylen; +return 0 ; + } + + md5sig =rcu_dereference_protected (tp->md5sig_info, +lockdep_sock_is_held (sk)); +if (!md5sig) { + md5sig =kmalloc (sizeof (*md5sig), gfp); +if (!md5sig) +return -ENOMEM ; + +sk_nocaps_add (sk,NETIF_F_GSO_MASK ); +INIT_HLIST_HEAD (&md5sig->head); +rcu_assign_pointer (tp->md5sig_info, md5sig); + } + + key =sock_kmalloc (sk,sizeof (*key), gfp); +if (!key) +return -ENOMEM ; +if (!tcp_alloc_md5sig_pool ()) { +sock_kfree_s (sk, key,sizeof (*key)); +return -ENOMEM ; + } + +memcpy (key->key, newkey, newkeylen); + key->keylen = newkeylen; + key->family = family; + key->prefixlen = prefixlen; +memcpy (&key->addr, addr, + (family ==AF_INET6 ) ?sizeof (struct in6_addr ) : +sizeof (struct in_addr )); +hlist_add_head_rcu (&key->node, &md5sig->head); +return 0 ; +} + +static void tcp_clear_md5_list (struct sock *sk) +{ +struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; +struct hlist_node *n; +struct tcp_md5sig_info *md5sig; + + md5sig =rcu_dereference_protected (tp->md5sig_info,1 ); + +hlist_for_each_entry_safe (key, n, &md5sig->head, node) { +hlist_del_rcu (&key->node); +atomic_sub (sizeof (*key), &sk->sk_omem_alloc); +kfree_rcu (key, rcu); + } +} + +static int tcp_md5_do_del (struct sock *sk,const union tcp_md5_addr *addr, +int family,u8 prefixlen) +{ +struct tcp_md5sig_key *key; + + key =tcp_md5_do_lookup_exact (sk, addr, family, prefixlen); +if (!key) +return -ENOENT ; +hlist_del_rcu (&key->node); +atomic_sub (sizeof (*key), &sk->sk_omem_alloc); +kfree_rcu (key, rcu); +return 0 ; +} + +static int tcp_md5_hash_key (struct tcp_md5sig_pool *hp, +const struct tcp_md5sig_key *key) +{ +struct scatterlist sg; + +sg_init_one (&sg, key->key, key->keylen); +ahash_request_set_crypt (hp->md5_req, &sg,NULL , key->keylen); +return crypto_ahash_update (hp->md5_req); +} + +static int tcp_v4_parse_md5_keys (struct sock *sk,int optname, +char __user *optval,int optlen) +{ +struct tcp_md5sig cmd; +struct sockaddr_in *sin = (struct sockaddr_in *)&cmd.tcpm_addr; +u8 prefixlen =32 ; + +if (optlen <sizeof (cmd)) +return -EINVAL ; + +if (copy_from_user (&cmd, optval,sizeof (cmd))) +return -EFAULT ; + +if (sin->sin_family !=AF_INET ) +return -EINVAL ; + +if (optname ==TCP_MD5SIG_EXT && + cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { + prefixlen = cmd.tcpm_prefixlen; +if (prefixlen >32 ) +return -EINVAL ; + } + +if (!cmd.tcpm_keylen) +return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, +AF_INET , prefixlen); + +if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) +return -EINVAL ; + +return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin->sin_addr.s_addr, +AF_INET , prefixlen, cmd.tcpm_key, cmd.tcpm_keylen, +GFP_KERNEL ); +} + +static int tcp_v6_parse_md5_keys (struct sock *sk,int optname, +char __user *optval,int optlen) +{ +struct tcp_md5sig cmd; +struct sockaddr_in6 *sin6 = (struct sockaddr_in6 *)&cmd.tcpm_addr; +u8 prefixlen; + +if (optlen <sizeof (cmd)) +return -EINVAL ; + +if (copy_from_user (&cmd, optval,sizeof (cmd))) +return -EFAULT ; + +if (sin6->sin6_family !=AF_INET6 ) +return -EINVAL ; + +if (optname ==TCP_MD5SIG_EXT && + cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { + prefixlen = cmd.tcpm_prefixlen; +if (prefixlen >128 || (ipv6_addr_v4mapped (&sin6->sin6_addr) && + prefixlen >32 )) +return -EINVAL ; + }else { + prefixlen =ipv6_addr_v4mapped (&sin6->sin6_addr) ?32 :128 ; + } + +if (!cmd.tcpm_keylen) { +if (ipv6_addr_v4mapped (&sin6->sin6_addr)) +return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], +AF_INET , prefixlen); +return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr, +AF_INET6 , prefixlen); + } + +if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) +return -EINVAL ; + +if (ipv6_addr_v4mapped (&sin6->sin6_addr)) +return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], +AF_INET , prefixlen, cmd.tcpm_key, + cmd.tcpm_keylen,GFP_KERNEL ); + +return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr, +AF_INET6 , prefixlen, cmd.tcpm_key, + cmd.tcpm_keylen,GFP_KERNEL ); +} + +static int tcp_v4_md5_hash_headers (struct tcp_md5sig_pool *hp, +__be32 daddr,__be32 saddr, +const struct tcphdr *th,int nbytes) +{ +struct tcp4_pseudohdr *bp; +struct scatterlist sg; +struct tcphdr *_th; + + bp = hp->scratch; + bp->saddr = saddr; + bp->daddr = daddr; + bp->pad =0 ; + bp->protocol =IPPROTO_TCP ; + bp->len =cpu_to_be16 (nbytes); + + _th = (struct tcphdr *)(bp +1 ); +memcpy (_th, th,sizeof (*th)); + _th->check =0 ; + +sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); +ahash_request_set_crypt (hp->md5_req, &sg,NULL , +sizeof (*bp) +sizeof (*th)); +return crypto_ahash_update (hp->md5_req); +} + +static int tcp_v6_md5_hash_headers (struct tcp_md5sig_pool *hp, +const struct in6_addr *daddr, +const struct in6_addr *saddr, +const struct tcphdr *th,int nbytes) +{ +struct tcp6_pseudohdr *bp; +struct scatterlist sg; +struct tcphdr *_th; + + bp = hp->scratch; +/* 1. TCP pseudo-header (RFC2460) */ + bp->saddr = *saddr; + bp->daddr = *daddr; + bp->protocol =cpu_to_be32 (IPPROTO_TCP ); + bp->len =cpu_to_be32 (nbytes); + + _th = (struct tcphdr *)(bp +1 ); +memcpy (_th, th,sizeof (*th)); + _th->check =0 ; + +sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); +ahash_request_set_crypt (hp->md5_req, &sg,NULL , +sizeof (*bp) +sizeof (*th)); +return crypto_ahash_update (hp->md5_req); +} + +static int tcp_v4_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, +__be32 daddr,__be32 saddr, +const struct tcphdr *th) +{ +struct tcp_md5sig_pool *hp; +struct ahash_request *req; + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; +if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} + +static int tcp_v6_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, +const struct in6_addr *daddr, +struct in6_addr *saddr,const struct tcphdr *th) +{ +struct tcp_md5sig_pool *hp; +struct ahash_request *req; + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; +if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} + +/* RFC2385 MD5 checksumming requires a mapping of +* IP address->MD5 Key. +* We need to maintain these in the sk structure. +*/ + +/* Find the Key structure for an address. */ +static struct tcp_md5sig_key *tcp_md5_do_lookup (const struct sock *sk, +const union tcp_md5_addr *addr, +int family) +{ +const struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; +const struct tcp_md5sig_info *md5sig; +__be32 mask; +struct tcp_md5sig_key *best_match =NULL ; +bool match; + +/* caller either holds rcu_read_lock() or socket lock */ + md5sig =rcu_dereference_check (tp->md5sig_info, +lockdep_sock_is_held (sk)); +if (!md5sig) +return NULL ; + +hlist_for_each_entry_rcu (key, &md5sig->head, node) { +if (key->family != family) +continue ; + +if (family ==AF_INET ) { + mask =inet_make_mask (key->prefixlen); + match = (key->addr.a4.s_addr & mask) == + (addr->a4.s_addr & mask); +#if IS_ENABLED (CONFIG_IPV6 ) + } else if (family == AF_INET6) { + match =ipv6_prefix_equal (&key->addr.a6, &addr->a6, + key->prefixlen); +#endif + }else { + match = false; + } + +if (match && (!best_match || + key->prefixlen > best_match->prefixlen)) + best_match = key; + } +return best_match; +} + +/* Parse MD5 Signature option */ +static const u8 *tcp_parse_md5sig_option (const struct tcphdr *th) +{ +int length = (th->doff <<2 ) -sizeof (*th); +const u8 *ptr = (const u8 *)(th +1 ); + +/* If the TCP option is too short, we can short cut */ +if (length <TCPOLEN_MD5SIG ) +return NULL ; + +while (length >0 ) { +int opcode = *ptr++; +int opsize; + +switch (opcode) { +case TCPOPT_EOL : +return NULL ; +case TCPOPT_NOP : + length--; +continue ; +default : + opsize = *ptr++; +if (opsize <2 || opsize > length) +return NULL ; +if (opcode ==TCPOPT_MD5SIG ) +return opsize ==TCPOLEN_MD5SIG ? ptr :NULL ; + } + ptr += opsize -2 ; + length -= opsize; + } +return NULL ; +} + +static struct tcp_md5sig_key *tcp_v6_md5_do_lookup (const struct sock *sk, +const struct in6_addr *addr) +{ +return tcp_md5_do_lookup (sk, (union tcp_md5_addr *)addr,AF_INET6 ); +} + +static int tcp_md5_hash_skb_data (struct tcp_md5sig_pool *hp, +const struct sk_buff *skb, +unsigned int header_len) +{ +struct scatterlist sg; +const struct tcphdr *tp =tcp_hdr (skb); +struct ahash_request *req = hp->md5_req; +unsigned int i; +const unsigned int head_data_len =skb_headlen (skb) > header_len ? +skb_headlen (skb) - header_len :0 ; +const struct skb_shared_info *shi =skb_shinfo (skb); +struct sk_buff *frag_iter; + +sg_init_table (&sg,1 ); + +sg_set_buf (&sg, ((u8 *)tp) + header_len, head_data_len); +ahash_request_set_crypt (req, &sg,NULL , head_data_len); +if (crypto_ahash_update (req)) +return 1 ; + +for (i =0 ; i < shi->nr_frags; ++i) { +const struct skb_frag_struct *f = &shi->frags[i]; +unsigned int offset = f->page_offset; +struct page *page =skb_frag_page (f) + (offset >>PAGE_SHIFT ); + +sg_set_page (&sg, page,skb_frag_size (f), +offset_in_page (offset)); +ahash_request_set_crypt (req, &sg,NULL ,skb_frag_size (f)); +if (crypto_ahash_update (req)) +return 1 ; + } + + skb_walk_frags(skb, frag_iter) +if (tcp_md5_hash_skb_data (hp, frag_iter,0 )) +return 1 ; + +return 0 ; +} + +int tcp_v4_md5_send_reset (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt) +{ +const struct tcphdr *th =tcp_hdr (skb); +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +unsigned char newhash[16 ]; +struct sock *sk1 =NULL ; +struct net *net; +int genhash; + + net = sk ?sock_net (sk) :dev_net (skb_dst (skb)->dev); + +rcu_read_lock (); + hash_location =tcp_parse_md5sig_option (th); +if (sk &&sk_fullsock (sk)) { + key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *) + &ip_hdr (skb)->saddr,AF_INET ); + }else if (hash_location) { +/* active side is lost. Try to find listening socket through +* source port, and then find md5 key through listening socket. +* we are not loose security here: +* Incoming packet is checked with md5 hash with finding key, +* no RST generated if md5 hash doesn't match. +*/ + sk1 =__inet_lookup_listener (net, &tcp_hashinfo,NULL ,0 , +ip_hdr (skb)->saddr, + th->source,ip_hdr (skb)->daddr, +ntohs (th->source),inet_iif (skb), +tcp_v4_sdif (skb)); +/* don't send rst if it can't find key */ +if (!sk1) + goto out; + + key =tcp_md5_do_lookup (sk1, (union tcp_md5_addr *) + &ip_hdr (skb)->saddr,AF_INET ); +if (!key) + goto out; + + genhash =tcp_v4_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto out; + } + +if (key) { + opt[0 ] =htonl ((TCPOPT_NOP <<24 ) | + (TCPOPT_NOP <<16 ) | + (TCPOPT_MD5SIG <<8 ) | +TCPOLEN_MD5SIG ); +/* Update length and the length the header thinks exists */ + arg->iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; + repth->doff = arg->iov[0 ].iov_len /4 ; + +tcp_v4_md5_hash_hdr ((__u8 *)&opt[1 ], + key,ip_hdr (skb)->saddr, +ip_hdr (skb)->daddr, repth); + } + +rcu_read_unlock (); + +return 0 ; +out: +rcu_read_unlock (); +return -1 ; +} + +void tcp_v4_md5_send_ack (struct sk_buff *skb,const struct sock *sk, +struct ip_reply_arg *arg,struct tcphdr *repth, +__be32 *opt) +{ +struct tcp_md5sig_key *key; + +if (sk->sk_state ==TCP_TIME_WAIT ) { +struct tcp_timewait_sock *tcptw =tcp_twsk (sk); + + key =tcp_twsk_md5_key (tcptw); + }else if (sk->sk_state ==TCP_NEW_SYN_RECV ) { + key =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&ip_hdr (skb)->daddr, +AF_INET ); + }else { +BUG (); + } + +if (key) { + opt[0 ] =htonl ((TCPOPT_NOP <<24 ) | + (TCPOPT_NOP <<16 ) | + (TCPOPT_MD5SIG <<8 ) | +TCPOLEN_MD5SIG ); + arg->iov[0 ].iov_len +=TCPOLEN_MD5SIG_ALIGNED ; + repth->doff = arg->iov[0 ].iov_len /4 ; + +tcp_v4_md5_hash_hdr ((__u8 *)&opt[1 ], + key,ip_hdr (skb)->saddr, +ip_hdr (skb)->daddr, repth); + } +} + +int tcp_v6_md5_send_response_write (struct sk_buff *skb,struct tcphdr *t1, +__be32 *topt,const struct sock *sk) +{ +const struct tcphdr *th =tcp_hdr (skb); +struct ipv6hdr *ipv6h =ipv6_hdr (skb); +struct tcp_md5sig_key *key =NULL ; +const __u8 *hash_location =NULL ; +int ret =0 ; + +rcu_read_lock (); + hash_location =tcp_parse_md5sig_option (th); +if (sk &&sk_fullsock (sk)) { + key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); + }else if (sk && sk->sk_state ==TCP_TIME_WAIT ) { +struct tcp_timewait_sock *tcptw =tcp_twsk (sk); + + key =tcp_twsk_md5_key (tcptw); + }else if (sk && sk->sk_state ==TCP_NEW_SYN_RECV ) { + key =tcp_v6_md5_do_lookup (sk, &ipv6h->daddr); + }else if (hash_location) { +unsigned char newhash[16 ]; +struct sock *sk1 =NULL ; +int genhash; + +/* active side is lost. Try to find listening socket through +* source port, and then find md5 key through listening socket. +* we are not loose security here: +* Incoming packet is checked with md5 hash with finding key, +* no RST generated if md5 hash doesn't match. +*/ + sk1 = inet6_lookup_listener(dev_net(skb_dst(skb)->dev), + &tcp_hashinfo, NULL, 0,
Quoted 8 lines
net/ipv4/tcp_md5.c line 666
Quoted 4 lines
net/ipv4/tcp_md5.c new file +4
-0+ &ipv6h->saddr, + th->source, &ipv6h->daddr, +ntohs (th->source),tcp_v6_iif (skb), + tcp_v6_sdif(skb));This code (and other v6 code) gets compiled even when IPv6 is not configured
-inet6_lookup_listener(for example) is not defined when IPv6 is not configured.
Oups, you are right. I did not compile-test with IPV6. Will fix this in the next version.
Quoted 8 lines
IPv6 support can be in a module, which makes things trickier - especially if you consider that MD5 can possibly be moved to a module once it is fully transitioned to the extra options framework. Maybe there would need to be two MD5 modules,
tcp_md5andtcp_md5_ipv6(the latter depending on bothtcp_md5and ipv6). I may be getting ahead of myself with modularizingTCP_MD5, it would be simpler to leave the config as-is, splitting off the ipv6 parts ofTCP_MD5and including them in the ipv6 module.
Yes, let's leave the config as-is for now. That could be done later in follow-up patches.
Christoph
Quoted 888 lines
Mat
Quoted 879 lines
net/ipv4/tcp_md5.c new file +414
-0+if (!sk1) + goto exit; + + key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); +if (!key) + goto exit; + + genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) + goto exit; + } + +if (key) { + *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | + (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG ); +tcp_v6_md5_hash_hdr ((__u8 *)topt, key, + &ipv6_hdr (skb)->saddr, + &ipv6_hdr (skb)->daddr, t1); + + ret =TCPOLEN_MD5SIG_ALIGNED ; + } + +exit: +rcu_read_unlock (); + +return ret; +} + +struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, +const struct sock *addr_sk) +{ +const union tcp_md5_addr *addr; + + addr = (const union tcp_md5_addr *)&addr_sk->sk_daddr; +return tcp_md5_do_lookup (sk, addr,AF_INET ); +} +EXPORT_SYMBOL (tcp_v4_md5_lookup); + +int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, +const struct sock *sk, +const struct sk_buff *skb) +{ +struct tcp_md5sig_pool *hp; +struct ahash_request *req; +const struct tcphdr *th =tcp_hdr (skb); +__be32 saddr, daddr; + +if (sk) {/* valid for establish/request sockets */ + saddr = sk->sk_rcv_saddr; + daddr = sk->sk_daddr; + }else { +const struct iphdr *iph =ip_hdr (skb); + + saddr = iph->saddr; + daddr = iph->daddr; + } + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; + +if (tcp_v4_md5_hash_headers (hp, daddr, saddr, th, skb->len)) + goto clear_hash; +if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} +EXPORT_SYMBOL (tcp_v4_md5_hash_skb); + +int tcp_v6_md5_hash_skb (char *md5_hash, +const struct tcp_md5sig_key *key, +const struct sock *sk, +const struct sk_buff *skb) +{ +const struct in6_addr *saddr, *daddr; +struct tcp_md5sig_pool *hp; +struct ahash_request *req; +const struct tcphdr *th =tcp_hdr (skb); + +if (sk) {/* valid for establish/request sockets */ + saddr = &sk->sk_v6_rcv_saddr; + daddr = &sk->sk_v6_daddr; + }else { +const struct ipv6hdr *ip6h =ipv6_hdr (skb); + + saddr = &ip6h->saddr; + daddr = &ip6h->daddr; + } + + hp =tcp_get_md5sig_pool (); +if (!hp) + goto clear_hash_noput; + req = hp->md5_req; + +if (crypto_ahash_init (req)) + goto clear_hash; + +if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, skb->len)) + goto clear_hash; +if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) + goto clear_hash; +if (tcp_md5_hash_key (hp, key)) + goto clear_hash; +ahash_request_set_crypt (req,NULL , md5_hash,0 ); +if (crypto_ahash_final (req)) + goto clear_hash; + +tcp_put_md5sig_pool (); +return 0 ; + +clear_hash: +tcp_put_md5sig_pool (); +clear_hash_noput: +memset (md5_hash,0 ,16 ); +return 1 ; +} + +/* Called with rcu_read_lock() */ +bool tcp_v4_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +/* This gets called for each TCP segment that arrives +* so we want to be efficient. +* We have 3 drop cases: +* o No MD5 hash and one expected. +* o MD5 hash and we're not expecting one. +* o MD5 hash and its wrong. +*/ +const __u8 *hash_location =NULL ; +struct tcp_md5sig_key *hash_expected; +const struct iphdr *iph =ip_hdr (skb); +const struct tcphdr *th =tcp_hdr (skb); +int genhash; +unsigned char newhash[16 ]; + + hash_expected =tcp_md5_do_lookup (sk, (union tcp_md5_addr *)&iph->saddr, +AF_INET ); + hash_location =tcp_parse_md5sig_option (th); + +/* We've parsed the options - do we have a hash? */ +if (!hash_expected && !hash_location) +return false; + +if (hash_expected && !hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); +return true; + } + +if (!hash_expected && hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); +return true; + } + +/* Okay, so this is hash_expected and hash_location - +* so we need to calculate the checksum. +*/ + genhash =tcp_v4_md5_hash_skb (newhash, + hash_expected, +NULL , skb); + +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); +net_info_ratelimited ("MD5 Hash failed for (%pI4, %d)->(%pI4, %d)%s\n" , + &iph->saddr,ntohs (th->source), + &iph->daddr,ntohs (th->dest), + genhash ?" tcp_v4_calc_md5_hash failed" + :"" ); +return true; + } +return false; +} + +bool tcp_v6_inbound_md5_hash (const struct sock *sk, +const struct sk_buff *skb) +{ +const __u8 *hash_location =NULL ; +struct tcp_md5sig_key *hash_expected; +const struct ipv6hdr *ip6h =ipv6_hdr (skb); +const struct tcphdr *th =tcp_hdr (skb); +int genhash; +u8 newhash[16 ]; + + hash_expected =tcp_v6_md5_do_lookup (sk, &ip6h->saddr); + hash_location =tcp_parse_md5sig_option (th); + +/* We've parsed the options - do we have a hash? */ +if (!hash_expected && !hash_location) +return false; + +if (hash_expected && !hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); +return true; + } + +if (!hash_expected && hash_location) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); +return true; + } + +/* check the signature */ + genhash =tcp_v6_md5_hash_skb (newhash, + hash_expected, +NULL , skb); + +if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { +NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); +net_info_ratelimited ("MD5 Hash %s for [%pI6c]:%u->[%pI6c]:%u\n" , + genhash ?"failed" :"mismatch" , + &ip6h->saddr,ntohs (th->source), + &ip6h->daddr,ntohs (th->dest)); +return true; + } + +return false; +} + +void tcp_v4_md5_destroy_sock (struct sock *sk) +{ +struct tcp_sock *tp =tcp_sk (sk); + +/* Clean up the MD5 key list, if any */ +if (tp->md5sig_info) { +tcp_clear_md5_list (sk); +kfree_rcu (tp->md5sig_info, rcu); + tp->md5sig_info =NULL ; + } +} + +void tcp_v4_md5_syn_recv_sock (const struct sock *listener,struct sock *sk) +{ +struct inet_sock *inet =inet_sk (sk); +struct tcp_md5sig_key *key; + +/* Copy over the MD5 key from the original socket */ + key =tcp_md5_do_lookup (listener, (union tcp_md5_addr *)&inet->inet_daddr, +AF_INET ); +if (key) { +/* We're using one, so create a matching key +* on the sk structure. If we fail to get +* memory, then we end up not copying the key +* across. Shucks. +*/ +tcp_md5_do_add (sk, (union tcp_md5_addr *)&inet->inet_daddr, +AF_INET ,32 , key->key, key->keylen,GFP_ATOMIC ); +sk_nocaps_add (sk,NETIF_F_GSO_MASK ); + } +} + +void tcp_v6_md5_syn_recv_sock (const struct sock *listener,struct sock *sk) +{ +struct tcp_md5sig_key *key; + +/* Copy over the MD5 key from the original socket */ + key =tcp_v6_md5_do_lookup (listener, &sk->sk_v6_daddr); +if (key) { +/* We're using one, so create a matching key +* on the newsk structure. If we fail to get +* memory, then we end up not copying the key +* across. Shucks. +*/ +tcp_md5_do_add (sk, (union tcp_md5_addr *)&sk->sk_v6_daddr, +AF_INET6 ,128 , key->key, key->keylen, +sk_gfp_mask (sk,GFP_ATOMIC )); + } +} + +struct tcp_md5sig_key *tcp_v6_md5_lookup (const struct sock *sk, +const struct sock *addr_sk) +{ +return tcp_v6_md5_do_lookup (sk, &addr_sk->sk_v6_daddr); +} + +void tcp_md5_time_wait (struct sock *sk,struct inet_timewait_sock *tw) +{ +struct tcp_timewait_sock *tcptw =tcp_twsk ((struct sock *)tw); +struct tcp_sock *tp =tcp_sk (sk); +struct tcp_md5sig_key *key; + +/* The timewait bucket does not have the key DB from the +* sock structure. We just make a quick copy of the +* md5 key being used (if indeed we are using one) +* so the timewait ack generating code has the key. +*/ + tcptw->tw_md5_key =NULL ; + key = tp->af_specific->md5_lookup (sk, sk); +if (key) { + tcptw->tw_md5_key =kmemdup (key,sizeof (*key),GFP_ATOMIC ); +if (tcptw->tw_md5_key && !tcp_alloc_md5sig_pool ()) +BUG (); + } +} + +static void tcp_diag_md5sig_fill (struct tcp_diag_md5sig *info, +const struct tcp_md5sig_key *key) +{ + info->tcpm_family = key->family; + info->tcpm_prefixlen = key->prefixlen; + info->tcpm_keylen = key->keylen; +memcpy (info->tcpm_key, key->key, key->keylen); + +if (key->family ==AF_INET ) + info->tcpm_addr[0 ] = key->addr.a4.s_addr; +#if IS_ENABLED (CONFIG_IPV6 ) + else if (key->family == AF_INET6) + memcpy(&info->tcpm_addr, &key->addr.a6, + sizeof(info->tcpm_addr)); +#endif +} + +static int tcp_diag_put_md5sig (struct sk_buff *skb, +const struct tcp_md5sig_info *md5sig) +{ +const struct tcp_md5sig_key *key; +struct tcp_diag_md5sig *info; +struct nlattr *attr; +int md5sig_count =0 ; + +hlist_for_each_entry_rcu (key, &md5sig->head, node) + md5sig_count++; +if (md5sig_count ==0 ) +return 0 ; + + attr =nla_reserve (skb,INET_DIAG_MD5SIG , + md5sig_count *sizeof (struct tcp_diag_md5sig )); +if (!attr) +return -EMSGSIZE ; + + info =nla_data (attr); +memset (info,0 , md5sig_count *sizeof (struct tcp_diag_md5sig )); +hlist_for_each_entry_rcu (key, &md5sig->head, node) { +tcp_diag_md5sig_fill (info++, key); +if (--md5sig_count ==0 ) +break ; + } + +return 0 ; +} + +int tcp_md5_diag_get_aux (struct sock *sk,bool net_admin,struct sk_buff *skb) +{ +if (net_admin) { +struct tcp_md5sig_info *md5sig; +int err =0 ; + +rcu_read_lock (); + md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); +if (md5sig) + err =tcp_diag_put_md5sig (skb, md5sig); +rcu_read_unlock (); +if (err <0 ) +return err; + } + +return 0 ; +} + +int tcp_md5_diag_get_aux_size (struct sock *sk,bool net_admin) +{ +int size =0 ; + +if (net_admin &&sk_fullsock (sk)) { +const struct tcp_md5sig_info *md5sig; +const struct tcp_md5sig_key *key; +size_t md5sig_count =0 ; + +rcu_read_lock (); + md5sig =rcu_dereference (tcp_sk (sk)->md5sig_info); +if (md5sig) { +hlist_for_each_entry_rcu (key, &md5sig->head, node) + md5sig_count++; + } +rcu_read_unlock (); + size +=nla_total_size (md5sig_count * +sizeof (struct tcp_diag_md5sig )); + } + +return size; +} + +const struct tcp_sock_af_ops tcp_sock_ipv4_specific = { + .md5_lookup = tcp_v4_md5_lookup, + .calc_md5_hash = tcp_v4_md5_hash_skb, + .md5_parse = tcp_v4_parse_md5_keys, +}; + +const struct tcp_sock_af_ops tcp_sock_ipv6_specific = { + .md5_lookup = tcp_v6_md5_lookup, + .calc_md5_hash = tcp_v6_md5_hash_skb, + .md5_parse = tcp_v6_parse_md5_keys, +}; + +const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific = { + .md5_lookup = tcp_v4_md5_lookup, + .calc_md5_hash = tcp_v4_md5_hash_skb, + .md5_parse = tcp_v6_parse_md5_keys, +}; +net/ipv4/tcp_minisocks.c +4
-23@@ -22,6 +22,7 @@#include <linux/module.h> #include <linux/slab.h> #include <linux/sysctl.h> +#include <linux/tcp_md5.h> #include <linux/workqueue.h> #include <net/tcp.h> #include <net/inet_common.h> @@ -286,22 +287,7 @@ void tcp_time_wait(struct sock *sk, int state, int timeo)#endif #ifdef CONFIG_TCP_MD5SIG -/* -* The timewait bucket does not have the key DB from the -* sock structure. We just make a quick copy of the -* md5 key being used (if indeed we are using one) -* so the timewait ack generating code has the key. -*/ -do { -struct tcp_md5sig_key *key; - tcptw->tw_md5_key =NULL ; - key = tp->af_specific->md5_lookup (sk, sk); -if (key) { - tcptw->tw_md5_key =kmemdup (key,sizeof (*key),GFP_ATOMIC ); -if (tcptw->tw_md5_key && !tcp_alloc_md5sig_pool ()) -BUG (); - } - }while (0 ); +tcp_md5_time_wait (sk, tw);#endif /* Get the TIME_WAIT timeout firing. */ @@ -331,10 +317,7 @@ void tcp_time_wait(struct sock *sk, int state, int timeo)void tcp_twsk_destructor (struct sock *sk) {#ifdef CONFIG_TCP_MD5SIG -struct tcp_timewait_sock *twsk =tcp_twsk (sk); - -if (twsk->tw_md5_key) -kfree_rcu (twsk->tw_md5_key, rcu); +tcp_md5_twsk_destructor (sk);#endif }EXPORT_SYMBOL_GPL (tcp_twsk_destructor);@@ -521,9 +504,7 @@ struct sock *tcp_create_openreq_child(const struct sock *sk, } newtp->tsoffset = treq->ts_off;#ifdef CONFIG_TCP_MD5SIG - newtp->md5sig_info =NULL ;/*XXX*/ -if (newtp->af_specific->md5_lookup (sk, newsk)) - newtp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +tcp_md5_add_header_len (sk, newsk);#endif if (static_branch_unlikely (&tcp_extra_options_enabled)) newtp->tcp_header_len +=tcp_extra_options_add_header (sk, newsk);net/ipv4/tcp_output.c +2
-2@@ -42,6 +42,7 @@#include <linux/gfp.h> #include <linux/module.h> #include <linux/static_key.h> +#include <linux/tcp_md5.h> /* People can turn this off for buggy TCP's found in printers etc. */ int sysctl_tcp_retrans_collapse__read_mostly =1 ;@@ -3249,8 +3250,7 @@ static void tcp_connect_init(struct sock *sk) tp->tcp_header_len +=TCPOLEN_TSTAMP_ALIGNED ;#ifdef CONFIG_TCP_MD5SIG -if (tp->af_specific->md5_lookup (sk, sk)) - tp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; +tcp_md5_add_header_len (sk, sk);#endif if (static_branch_unlikely (&tcp_extra_options_enabled))net/ipv6/tcp_ipv6.c +3
-310@@ -43,6 +43,7 @@#include <linux/ipv6.h> #include <linux/icmpv6.h> #include <linux/random.h> +#include <linux/tcp_md5.h> #include <net/tcp.h> #include <net/ndisc.h> @@ -77,16 +78,6 @@ static int tcp_v6_do_rcv(struct sock *sk, struct sk_buff *skb);static const struct inet_connection_sock_af_ops ipv6_mapped;static const struct inet_connection_sock_af_ops ipv6_specific; -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv6_specific; -static const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific; -#else -static struct tcp_md5sig_key *tcp_v6_md5_do_lookup (const struct sock *sk, -const struct in6_addr *addr) -{ -return NULL ; -} -#endif static void inet6_sk_rx_dst_set (struct sock *sk,const struct sk_buff *skb) {@@ -502,218 +493,6 @@ static void tcp_v6_reqsk_destructor(struct request_sock *req)kfree_skb (inet_rsk (req)->pktopts); } -#ifdef CONFIG_TCP_MD5SIG -static struct tcp_md5sig_key *tcp_v6_md5_do_lookup (const struct sock *sk, -const struct in6_addr *addr) -{ -return tcp_md5_do_lookup (sk, (union tcp_md5_addr *)addr,AF_INET6 ); -} - -static struct tcp_md5sig_key *tcp_v6_md5_lookup (const struct sock *sk, -const struct sock *addr_sk) -{ -return tcp_v6_md5_do_lookup (sk, &addr_sk->sk_v6_daddr); -} - -static int tcp_v6_parse_md5_keys (struct sock *sk,int optname, -char __user *optval,int optlen) -{ -struct tcp_md5sig cmd; -struct sockaddr_in6 *sin6 = (struct sockaddr_in6 *)&cmd.tcpm_addr; -u8 prefixlen; - -if (optlen <sizeof (cmd)) -return -EINVAL ; - -if (copy_from_user (&cmd, optval,sizeof (cmd))) -return -EFAULT ; - -if (sin6->sin6_family !=AF_INET6 ) -return -EINVAL ; - -if (optname ==TCP_MD5SIG_EXT && - cmd.tcpm_flags &TCP_MD5SIG_FLAG_PREFIX ) { - prefixlen = cmd.tcpm_prefixlen; -if (prefixlen >128 || (ipv6_addr_v4mapped (&sin6->sin6_addr) && - prefixlen >32 )) -return -EINVAL ; - }else { - prefixlen =ipv6_addr_v4mapped (&sin6->sin6_addr) ?32 :128 ; - } - -if (!cmd.tcpm_keylen) { -if (ipv6_addr_v4mapped (&sin6->sin6_addr)) -return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], -AF_INET , prefixlen); -return tcp_md5_do_del (sk, (union tcp_md5_addr *)&sin6->sin6_addr, -AF_INET6 , prefixlen); - } - -if (cmd.tcpm_keylen >TCP_MD5SIG_MAXKEYLEN ) -return -EINVAL ; - -if (ipv6_addr_v4mapped (&sin6->sin6_addr)) -return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr.s6_addr32[3 ], -AF_INET , prefixlen, cmd.tcpm_key, - cmd.tcpm_keylen,GFP_KERNEL ); - -return tcp_md5_do_add (sk, (union tcp_md5_addr *)&sin6->sin6_addr, -AF_INET6 , prefixlen, cmd.tcpm_key, - cmd.tcpm_keylen,GFP_KERNEL ); -} - -static int tcp_v6_md5_hash_headers (struct tcp_md5sig_pool *hp, -const struct in6_addr *daddr, -const struct in6_addr *saddr, -const struct tcphdr *th,int nbytes) -{ -struct tcp6_pseudohdr *bp; -struct scatterlist sg; -struct tcphdr *_th; - - bp = hp->scratch; -/* 1. TCP pseudo-header (RFC2460) */ - bp->saddr = *saddr; - bp->daddr = *daddr; - bp->protocol =cpu_to_be32 (IPPROTO_TCP ); - bp->len =cpu_to_be32 (nbytes); - - _th = (struct tcphdr *)(bp +1 ); -memcpy (_th, th,sizeof (*th)); - _th->check =0 ; - -sg_init_one (&sg, bp,sizeof (*bp) +sizeof (*th)); -ahash_request_set_crypt (hp->md5_req, &sg,NULL , -sizeof (*bp) +sizeof (*th)); -return crypto_ahash_update (hp->md5_req); -} - -static int tcp_v6_md5_hash_hdr (char *md5_hash,const struct tcp_md5sig_key *key, -const struct in6_addr *daddr,struct in6_addr *saddr, -const struct tcphdr *th) -{ -struct tcp_md5sig_pool *hp; -struct ahash_request *req; - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; -if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} - -static int tcp_v6_md5_hash_skb (char *md5_hash, -const struct tcp_md5sig_key *key, -const struct sock *sk, -const struct sk_buff *skb) -{ -const struct in6_addr *saddr, *daddr; -struct tcp_md5sig_pool *hp; -struct ahash_request *req; -const struct tcphdr *th =tcp_hdr (skb); - -if (sk) {/* valid for establish/request sockets */ - saddr = &sk->sk_v6_rcv_saddr; - daddr = &sk->sk_v6_daddr; - }else { -const struct ipv6hdr *ip6h =ipv6_hdr (skb); - saddr = &ip6h->saddr; - daddr = &ip6h->daddr; - } - - hp =tcp_get_md5sig_pool (); -if (!hp) - goto clear_hash_noput; - req = hp->md5_req; - -if (crypto_ahash_init (req)) - goto clear_hash; - -if (tcp_v6_md5_hash_headers (hp, daddr, saddr, th, skb->len)) - goto clear_hash; -if (tcp_md5_hash_skb_data (hp, skb, th->doff <<2 )) - goto clear_hash; -if (tcp_md5_hash_key (hp, key)) - goto clear_hash; -ahash_request_set_crypt (req,NULL , md5_hash,0 ); -if (crypto_ahash_final (req)) - goto clear_hash; - -tcp_put_md5sig_pool (); -return 0 ; - -clear_hash: -tcp_put_md5sig_pool (); -clear_hash_noput: -memset (md5_hash,0 ,16 ); -return 1 ; -} - -#endif - -static bool tcp_v6_inbound_md5_hash (const struct sock *sk, -const struct sk_buff *skb) -{ -#ifdef CONFIG_TCP_MD5SIG -const __u8 *hash_location =NULL ; -struct tcp_md5sig_key *hash_expected; -const struct ipv6hdr *ip6h =ipv6_hdr (skb); -const struct tcphdr *th =tcp_hdr (skb); -int genhash; -u8 newhash[16 ]; - - hash_expected =tcp_v6_md5_do_lookup (sk, &ip6h->saddr); - hash_location =tcp_parse_md5sig_option (th); - -/* We've parsed the options - do we have a hash? */ -if (!hash_expected && !hash_location) -return false; - -if (hash_expected && !hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5NOTFOUND ); -return true; - } - -if (!hash_expected && hash_location) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5UNEXPECTED ); -return true; - } - -/* check the signature */ - genhash =tcp_v6_md5_hash_skb (newhash, - hash_expected, -NULL , skb); - -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) { -NET_INC_STATS (sock_net (sk),LINUX_MIB_TCPMD5FAILURE ); -net_info_ratelimited ("MD5 Hash %s for [%pI6c]:%u->[%pI6c]:%u\n" , - genhash ?"failed" :"mismatch" , - &ip6h->saddr,ntohs (th->source), - &ip6h->daddr,ntohs (th->dest)); -return true; - } -#endif -return false; -} -static void tcp_v6_init_req (struct request_sock *req,const struct sock *sk_listener,struct sk_buff *skb)@@ -788,12 +567,6 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32struct dst_entry *dst;__be32 *topt; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key =NULL ; -const __u8 *hash_location =NULL ; -struct ipv6hdr *ipv6h =ipv6_hdr (skb); -#endif - buff =alloc_skb (MAX_HEADER +sizeof (struct ipv6hdr ) + tot_len,GFP_ATOMIC );if (!buff)@@ -827,57 +600,7 @@ static void tcp_v6_send_response(const struct sock *sk, struct sk_buff *skb, u32 }#ifdef CONFIG_TCP_MD5SIG -rcu_read_lock (); - hash_location =tcp_parse_md5sig_option (th); -if (sk &&sk_fullsock (sk)) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->saddr); - }else if (sk && sk->sk_state ==TCP_TIME_WAIT ) { -struct tcp_timewait_sock *tcptw =tcp_twsk (sk); - - key =tcp_twsk_md5_key (tcptw); - }else if (sk && sk->sk_state ==TCP_NEW_SYN_RECV ) { - key =tcp_v6_md5_do_lookup (sk, &ipv6h->daddr); - }else if (hash_location) { -unsigned char newhash[16 ]; -struct sock *sk1 =NULL ; -int genhash; - -/* active side is lost. Try to find listening socket through -* source port, and then find md5 key through listening socket. -* we are not loose security here: -* Incoming packet is checked with md5 hash with finding key, -* no RST generated if md5 hash doesn't match. -*/ - sk1 =inet6_lookup_listener (dev_net (skb_dst (skb)->dev), - &tcp_hashinfo,NULL ,0 , - &ipv6h->saddr, - th->source, &ipv6h->daddr, -ntohs (th->source),tcp_v6_iif (skb), -tcp_v6_sdif (skb)); -if (!sk1) - goto go_on; - - key =tcp_v6_md5_do_lookup (sk1, &ipv6h->saddr); -if (!key) - goto go_on; - - genhash =tcp_v6_md5_hash_skb (newhash, key,NULL , skb); -if (genhash ||memcmp (hash_location, newhash,16 ) !=0 ) - goto go_on; - } - -go_on: -rcu_read_unlock (); - -if (key) { - *topt++ =htonl ((TCPOPT_NOP <<24 ) | (TCPOPT_NOP <<16 ) | - (TCPOPT_MD5SIG <<8 ) |TCPOLEN_MD5SIG ); -tcp_v6_md5_hash_hdr ((__u8 *)topt, key, - &ipv6_hdr (skb)->saddr, - &ipv6_hdr (skb)->daddr, t1); - - reduce +=TCPOLEN_MD5SIG_ALIGNED ; - } + reduce +=tcp_v6_md5_send_response_write (skb, t1, topt, sk);#endif buff->tail -= reduce;@@ -1044,9 +767,6 @@ static struct sock *tcp_v6_syn_recv_sock(const struct sock *sk, struct sk_buff *struct inet_sock *newinet;struct tcp_sock *newtp;struct sock *newsk; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *key; -#endif struct flowi6 fl6;if (skb->protocol ==htons (ETH_P_IP )) {@@ -1191,18 +911,7 @@ static struct sock *tcp_v6_syn_recv_sock(const struct sock *sk, struct sk_buff * newinet->inet_rcv_saddr =LOOPBACK4_IPV6 ;#ifdef CONFIG_TCP_MD5SIG -/* Copy over the MD5 key from the original socket */ - key =tcp_v6_md5_do_lookup (sk, &newsk->sk_v6_daddr); -if (key) { -/* We're using one, so create a matching key -* on the newsk structure. If we fail to get -* memory, then we end up not copying the key -* across. Shucks. -*/ -tcp_md5_do_add (newsk, (union tcp_md5_addr *)&newsk->sk_v6_daddr, -AF_INET6 ,128 , key->key, key->keylen, -sk_gfp_mask (sk,GFP_ATOMIC )); - } +tcp_v6_md5_syn_recv_sock (sk, newsk);#endif if (__inet_inherit_port (sk, newsk) <0 ) {@@ -1657,14 +1366,6 @@ static const struct inet_connection_sock_af_ops ipv6_specific = { .mtu_reduced = tcp_v6_mtu_reduced, }; -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv6_specific = { - .md5_lookup = tcp_v6_md5_lookup, - .calc_md5_hash = tcp_v6_md5_hash_skb, - .md5_parse = tcp_v6_parse_md5_keys, -}; -#endif -/* * TCP over IPv4 via INET6 API */ @@ -1687,14 +1388,6 @@ static const struct inet_connection_sock_af_ops ipv6_mapped = { .mtu_reduced = tcp_v4_mtu_reduced, }; -#ifdef CONFIG_TCP_MD5SIG -static const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific = { - .md5_lookup = tcp_v4_md5_lookup, - .calc_md5_hash = tcp_v4_md5_hash_skb, - .md5_parse = tcp_v6_parse_md5_keys, -}; -#endif -/* NOTE: A lot of things set to zero explicitly by call to * sk_alloc() so need not be done here. */ Signature · 1 line
2.14.1--
Mat Martineau
Intel OTC
Christoph Paasch
PATCH 16/18 tcp_md5: Don't pass along md5-key
In reply to Christoph PaaschIt is much cleaner to store the key-pointer in tcp_out_options.
--- include/linux/tcp.h | 1 + net/ipv4/tcp_output.c | 46 ++++++++++++++++++++-------------------------- 2 files changed, 21 insertions(+), 26 deletions(-)
include/linux/tcp.h +1 -0
@@ -127,6 +127,7 @@ struct tcp_out_options {__u8 *hash_location;/* temporary pointer, overloaded */ __u32 tsval, tsecr;/* need to include OPTION_TS */ struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ +struct tcp_md5sig_key *md5;/* TCP_MD5 signature key */ };/* This is the max number of SACKS that we'll generate and process. It's safe
net/ipv4/tcp_output.c +20 -26
150 lines not on this page · raw message
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 17/18 tcp_md5: Use tcp_extra_options in output path
In reply to Christoph PaaschThis patch starts making use of the extra_option framework for TCP_MD5.
One tricky part is that extra_options are called at the end of the option-functions while TCP_MD5 is called at the beginning.
TCP_MD5 is called at the beginning because it wants to disable TCP-timestamps (for option-space reasons). So, in the _prepare-function of the extra options we need to undo the work that was done when enabling TCP timestamps.
--- include/linux/tcp.h | 2 - include/linux/tcp_md5.h | 14 ++---- net/ipv4/tcp.c | 2 + net/ipv4/tcp_md5.c | 118 +++++++++++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_minisocks.c | 3 -- net/ipv4/tcp_output.c | 69 +-------------------------- 6 files changed, 125 insertions(+), 83 deletions(-)
include/linux/tcp.h +0 -2
@@ -123,8 +123,6 @@ struct tcp_out_options {u16 mss;/* 0 to disable */ u8 ws;/* window scale, 0 to disable */ u8 num_sack_blocks;/* number of SACK blocks to include */ -u8 hash_size;/* bytes in hash_location */ -__u8 *hash_location;/* temporary pointer, overloaded */ __u32 tsval, tsecr;/* need to include OPTION_TS */ struct tcp_fastopen_cookie *fastopen_cookie;/* Fast open cookie */ struct tcp_md5sig_key *md5;/* TCP_MD5 signature key */
include/linux/tcp_md5.h +4 -10
@@ -96,20 +96,12 @@ static inline void tcp_md5_twsk_destructor(struct sock *sk)kfree_rcu (twsk->tw_md5_key, rcu); } -static inline void tcp_md5_add_header_len (const struct sock *listener, -struct sock *sk) -{ -struct tcp_sock *tp =tcp_sk (sk); - - tp->md5sig_info =NULL ;/*XXX*/ -if (tp->af_specific->md5_lookup (listener, sk)) - tp->tcp_header_len +=TCPOLEN_MD5SIG_ALIGNED ; -} -int tcp_md5_diag_get_aux (struct sock *sk,bool net_admin,struct sk_buff *skb);int tcp_md5_diag_get_aux_size (struct sock *sk,bool net_admin); +void tcp_md5_register (void ); +#else static inline bool tcp_v4_inbound_md5_hash(const struct sock *sk,
@@ -124,6 +116,8 @@ static inline bool tcp_v6_inbound_md5_hash(const struct sock *sk,return false; } +static inline void tcp_md5_register (void ) {} +#endif #endif /* _LINUX_TCP_MD5_H */
net/ipv4/tcp.c +2 -0
@@ -3567,4 +3567,6 @@ void __init tcp_init(void)tcp_metrics_init ();BUG_ON (tcp_register_congestion_control (&tcp_reno) !=0 );tcp_tasklet_init (); + +tcp_md5_register (); }
net/ipv4/tcp_md5.c +118 -0
127 lines not on this page · raw message
net/ipv4/tcp_minisocks.c +0 -3
@@ -503,9 +503,6 @@ struct sock *tcp_create_openreq_child(const struct sock *sk, newtp->tcp_header_len =sizeof (struct tcphdr ); } newtp->tsoffset = treq->ts_off; -#ifdef CONFIG_TCP_MD5SIG -tcp_md5_add_header_len (sk, newsk); -#endif if (static_branch_unlikely (&tcp_extra_options_enabled)) newtp->tcp_header_len +=tcp_extra_options_add_header (sk, newsk);
net/ipv4/tcp_output.c +1 -68
123 lines not on this page · raw message
Signature · 1 line
2.14.1
Christoph Paasch
PATCH 18/18 tcp_md5: Cleanup TCP-code
In reply to Christoph PaaschNow that we have consolidated the TCP_MD5 output path, we can cleanup TCP and its callbacks to MD5.
These callbacks are solely there to handle the different address-familiese (v4, v6 and v4mapped).
Now that we have isolated the TCP_MD5-code it is acceptable to add a bit more complexity inside tcp_md5.c to handle these address-families at the benefit of getting rid of these callbacks in tcp_sock, together with its assignments in tcp_v4/6_connect,...
--- include/linux/tcp.h | 3 - include/linux/tcp_md5.h | 18 +-- include/net/tcp.h | 24 ---- net/ipv4/tcp.c | 2 +- net/ipv4/tcp_ipv4.c | 8 -- net/ipv4/tcp_md5.c | 327 ++++++++++++++++++++++-------------------------- net/ipv6/tcp_ipv6.c | 17 --- 7 files changed, 152 insertions(+), 247 deletions(-)
include/linux/tcp.h +0 -3
@@ -364,9 +364,6 @@ struct tcp_sock {*/ #ifdef CONFIG_TCP_MD5SIG -/* TCP AF-Specific parts; only used by MD5 Signature support so far */ -const struct tcp_sock_af_ops *af_specific; -/* TCP MD5 Signature Option information */ struct tcp_md5sig_info __rcu *md5sig_info;#endif
include/linux/tcp_md5.h +2 -16
@@ -44,16 +44,10 @@ struct tcp_md5sig_pool {void *scratch; }; -extern const struct tcp_sock_af_ops tcp_sock_ipv4_specific; -extern const struct tcp_sock_af_ops tcp_sock_ipv6_specific; -extern const struct tcp_sock_af_ops tcp_sock_ipv6_mapped_specific; -/* - functions */ -int tcp_v4_md5_hash_skb (char *md5_hash,const struct tcp_md5sig_key *key, -const struct sock *sk,const struct sk_buff *skb); -struct tcp_md5sig_key *tcp_v4_md5_lookup (const struct sock *sk, -const struct sock *addr_sk); +int tcp_md5_parse_keys (struct sock *sk,int optname,char __user *optval, +int optlen);void tcp_v4_md5_destroy_sock (struct sock *sk);
@@ -77,14 +71,6 @@ void tcp_v6_md5_syn_recv_sock(const struct sock *listener, struct sock *sk);void tcp_md5_time_wait (struct sock *sk,struct inet_timewait_sock *tw); -struct tcp_md5sig_key *tcp_v6_md5_lookup (const struct sock *sk, -const struct sock *addr_sk); - -int tcp_v6_md5_hash_skb (char *md5_hash, -const struct tcp_md5sig_key *key, -const struct sock *sk, -const struct sk_buff *skb); -bool tcp_v6_inbound_md5_hash (const struct sock *sk,const struct sk_buff *skb);
include/net/tcp.h +0 -24
@@ -1775,32 +1775,8 @@ int tcp_conn_request(struct request_sock_ops *rsk_ops,const struct tcp_request_sock_ops *af_ops, struct sock *sk, struct sk_buff *skb); -/* TCP af-specific functions */ -struct tcp_sock_af_ops { -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *(*md5_lookup) (const struct sock *sk, -const struct sock *addr_sk); -int (*calc_md5_hash)(char *location, -const struct tcp_md5sig_key *md5, -const struct sock *sk, -const struct sk_buff *skb); -int (*md5_parse)(struct sock *sk, -int optname, -char __user *optval, -int optlen); -#endif -}; -struct tcp_request_sock_ops {u16 mss_clamp; -#ifdef CONFIG_TCP_MD5SIG -struct tcp_md5sig_key *(*req_md5_lookup)(const struct sock *sk, -const struct sock *addr_sk); -int (*calc_md5_hash) (char *location, -const struct tcp_md5sig_key *md5, -const struct sock *sk, -const struct sk_buff *skb); -#endif void (*init_req)(struct request_sock *req,const struct sock *sk_listener,struct sk_buff *skb);
net/ipv4/tcp.c +1 -1
@@ -2740,7 +2740,7 @@ static int do_tcp_setsockopt(struct sock *sk, int level,case TCP_MD5SIG :case TCP_MD5SIG_EXT :/* Read the IP->Key mappings from userspace */ - err = tp->af_specific->md5_parse (sk, optname, optval, optlen); +tcp_md5_parse_keys (sk, optname, optval, optlen);break ;#endif case TCP_USER_TIMEOUT :
net/ipv4/tcp_ipv4.c +0 -8
@@ -845,10 +845,6 @@ struct request_sock_ops tcp_request_sock_ops __read_mostly = {static const struct tcp_request_sock_ops tcp_request_sock_ipv4_ops = { .mss_clamp =TCP_MSS_DEFAULT , -#ifdef CONFIG_TCP_MD5SIG - .req_md5_lookup = tcp_v4_md5_lookup, - .calc_md5_hash = tcp_v4_md5_hash_skb, -#endif .init_req = tcp_v4_init_req, #ifdef CONFIG_SYN_COOKIES .cookie_init_seq = cookie_v4_init_sequence,
@@ -1379,10 +1375,6 @@ static int tcp_v4_init_sock(struct sock *sk) icsk->icsk_af_ops = &ipv4_specific; -#ifdef CONFIG_TCP_MD5SIG -tcp_sk (sk)->af_specific = &tcp_sock_ipv4_specific; -#endif -return 0 ; }
net/ipv4/tcp_md5.c +149 -178
420 lines not on this page · raw message
net/ipv6/tcp_ipv6.c +0 -17
@@ -206,9 +206,6 @@ static int tcp_v6_connect(struct sock *sk, struct sockaddr *uaddr, icsk->icsk_af_ops = &ipv6_mapped; sk->sk_backlog_rcv = tcp_v4_do_rcv; -#ifdef CONFIG_TCP_MD5SIG - tp->af_specific = &tcp_sock_ipv6_mapped_specific; -#endif err =tcp_v4_connect (sk, (struct sockaddr *)&sin,sizeof (sin));
@@ -216,9 +213,6 @@ static int tcp_v6_connect(struct sock *sk, struct sockaddr *uaddr, icsk->icsk_ext_hdr_len = exthdrlen; icsk->icsk_af_ops = &ipv6_specific; sk->sk_backlog_rcv = tcp_v6_do_rcv; -#ifdef CONFIG_TCP_MD5SIG - tp->af_specific = &tcp_sock_ipv6_specific; -#endif goto failure; } np->saddr = sk->sk_v6_rcv_saddr;
@@ -538,10 +532,6 @@ struct request_sock_ops tcp6_request_sock_ops __read_mostly = {static const struct tcp_request_sock_ops tcp_request_sock_ipv6_ops = { .mss_clamp =IPV6_MIN_MTU -sizeof (struct tcphdr ) -sizeof (struct ipv6hdr ), -#ifdef CONFIG_TCP_MD5SIG - .req_md5_lookup = tcp_v6_md5_lookup, - .calc_md5_hash = tcp_v6_md5_hash_skb, -#endif .init_req = tcp_v6_init_req, #ifdef CONFIG_SYN_COOKIES .cookie_init_seq = cookie_v6_init_sequence,
@@ -793,9 +783,6 @@ static struct sock *tcp_v6_syn_recv_sock(const struct sock *sk, struct sk_buff *inet_csk (newsk)->icsk_af_ops = &ipv6_mapped; newsk->sk_backlog_rcv = tcp_v4_do_rcv; -#ifdef CONFIG_TCP_MD5SIG - newtp->af_specific = &tcp_sock_ipv6_mapped_specific; -#endif newnp->ipv6_mc_list =NULL ; newnp->ipv6_ac_list =NULL ;
@@ -1399,10 +1386,6 @@ static int tcp_v6_init_sock(struct sock *sk) icsk->icsk_af_ops = &ipv6_specific; -#ifdef CONFIG_TCP_MD5SIG -tcp_sk (sk)->af_specific = &tcp_sock_ipv6_specific; -#endif -return 0 ; }
Signature · 1 line
2.14.1
Christoph Paasch
Oh, and btw., I still need to test this :)
I will be writing some tests using TCP_MD5 in the next days.
Christoph
Quoted 122 lines · Christoph Paasch
Tried to split it in several patches.
Here is the overview:
Patch 1 to 5: Solely TCP-level changes to prepare the stack. Mostly cosmetic,
besides #1 and #5. #1 should be ok, #5 is a bit more fundamental change but I think it's still ok.
Patch 6 to 11: Mat's patch, together with some more changes to it. My changes
should be merged into Mat's patch, but I let them out for now so that it's clear what I had to change.
Patch 12 to 14: Changes toTCP_MD5to enable it to opt-in to the framework.
Should be all fairly straight-forward.
Patch 15: Here, I move all TCP_MD5-code to its own file.
Patch 16: I should probably move this to the patchset 12 to 14. Patch 17: Here, I start using the framework
Patch 18: Cleanup thanks to the use of the framework.In particular, patch 18 shows how the framework allows to cleanup TCP from TCP_MD5-changes.
Some comments about the extra-option framework:
1) As already discussed, it would be good to have the callbacks on a per-socket basis. Basically, I think the list should be in
tcp_sockwhere this list would simply be a list of structs:struct tcp_extra_option { struct list_head teo_list; struct tcp_extra_options_opts *teo_ops; };Users of this framework would allocate these elements like this (e.g.,
TCP_MD5):struct tcp_md5_extra_option { struct tcp_extra_option tcp_md5_eo; struct tcp_md5sig_info __rcu *md5sig_info; };This allows MD5 to store its state info inside there. We could nicely fit MPTCP into this.
2)
I chose to leave theextra_optionsat the end oftcp_syn_options.
This however means that we have to undo what TCP timestamps did intcp_syn_options. Unsetting the flags is easy, but the nasty part is with:(quoted diff) +3
-0+ /* Don't use TCP timestamps with TCP_MD5 */ + if (opts->options & OPTION_TS) + ret -= TCPOLEN_TSTAMP_ALIGNED;Yes, this is ugly. But, the only way from what I see if we want to fully remove
TCP_MD5out of TCP.3) With
request_socksnow being full socks, the prepare andprepare_reqcallbacks could be merged.4) We also need this framwork for
time_wait_socks. So, in general, we could have the callback list in structsock_commonas well, that waytcp_sock,tcp_time_wait_sockandrequest_socksget it.This implies that we need to initialize this in
tcp_time_wait()and destroy it intcp_twsk_destructor. That would allow to remove even more MD5-code out of TCP.I can work on these changes to the extra-option framework.
Any thoughts? :)
Christoph Paasch (17):
tcp: Write options after the header has been fully done
tcp: Pass sock totcp_options_writeinstead oftcp_sock
tcp: Pass skb intcp_options_write
tcp: Pass sock totcp_synack_options
tcp6: Prepare for maximum TCP option-space
tcp_extra_option:add_headercallback for TCP extra options
tcp_extra_option: Add missing static branch for
tcp_extra_options_prepare
tcp_extra_option: Use sock instead oftcp_sockin
tcp_extra_options_parse/prepare/write
tcp_extra_option: Pass skb totcp_extra_options_write
tcp_extra_option: Pass sock toprepare_req
tcp_md5: Detect key insidetcp_v4_send_ackinstead of passing it as an
argument
tcp_md5: Detect key insidetcp_v6_send_responseinstead of passing it
as an argument
tcp_md5: Check forTCP_MD5after TCP Timestamps in
tcp_established_options
tcp: Move TCP-MD5 code out of TCP itself
tcp_md5: Don't pass along md5-key
tcp_md5: Usetcp_extra_optionsin output path
tcp_md5: Cleanup TCP-codeMat Martineau (1):
tcp: Register handlers for extra TCP optionsdrivers/infiniband/hw/cxgb4/cm.c | 2 +- include/linux/inet_diag.h | 1 + include/linux/tcp.h | 19 +- include/linux/tcp_md5.h | 109 ++++ include/net/tcp.h | 157 ++--- net/ipv4/Makefile | 1 + net/ipv4/syncookies.c | 2 +- net/ipv4/tcp.c | 219 +++---- net/ipv4/tcp_diag.c | 81 +-- net/ipv4/tcp_input.c | 54 +- net/ipv4/tcp_ipv4.c | 496 +--------------- net/ipv4/tcp_md5.c | 1169 ++++++++++++++++++++++++++++++++++++++ net/ipv4/tcp_minisocks.c | 35 +- net/ipv4/tcp_output.c | 139 ++--- net/ipv6/syncookies.c | 2 +- net/ipv6/tcp_ipv6.c | 352 +----------- 16 files changed, 1560 insertions(+), 1278 deletions(-) create mode 100644 include/linux/tcp_md5.h create mode 100644 net/ipv4/tcp_md5.cSignature · 6 lines
2.14.1 _______________________________________________ mptcp mailing list mptcp(a)lists.01.org https://lists.01.org/mailman/listinfo/mptcp