ip: improve tcp sock multipath routing
Subsystems (5)
v2 cover ip: improve tcp sock multipath routing
From: Willem de Bruijn <[email protected]>
Improve layer 4 multipath hash policy for local tcp connections:
patch 1: Select a source address that matches the nexthop device.
Due to tcp_v4_connect making separate route lookups for saddr and route, the two can currently be inconsistent.
patch 2: Use all paths when opening multiple local tcp connections to
the same ip address and port.
patch 3: Test the behavior. Extend the fib_tests.sh testsuite with one
opening many connections, and count SYNs on both egress devices, for packets matching the source address of the dev.
Changelog in the individual patches
Willem de Bruijn (3):
ipv4: prefer multipath nexthop that matches source address
ip: load balance tcp connections to single dst addr and port selftests/net: test tcp connection load balancing
include/net/flow.h | 1 + include/net/ip_fib.h | 3 +- include/net/route.h | 3 + net/ipv4/fib_semantics.c | 39 +++++--- net/ipv4/route.c | 15 ++- net/ipv6/route.c | 13 ++- net/ipv6/tcp_ipv6.c | 2 + tools/testing/selftests/net/fib_tests.sh | 120 ++++++++++++++++++++++- tools/testing/selftests/net/lib.sh | 24 +++++ 9 files changed, 197 insertions(+), 23 deletions(-)
Signature · 1 line
2.49.0.805.g082f7c87e0-goog
PATCH v2 1/3 ipv4: prefer multipath nexthop that matches source address
From: Willem de Bruijn <[email protected]>
With multipath routes, try to ensure that packets leave on the device that is associated with the source address.
Avoid the following tcpdump example:
veth0 Out IP 10.1.0.2.38640 > 10.2.0.3.8000: Flags [S]
veth1 Out IP 10.1.0.2.38648 > 10.2.0.3.8000: Flags [S]Which can happen easily with the most straightforward setup:
ip addr add 10.0.0.1/24 dev veth0
ip addr add 10.1.0.1/24 dev veth1
ip route add 10.2.0.3 nexthop via 10.0.0.2 dev veth0 \
nexthop via 10.1.0.2 dev veth1This is apparently considered WAI, based on the comment in ip_route_output_key_hash_rcu:
* 2. Moreover, we are allowed to send packets with saddr
* of another iface. --ANK
It may be ok for some uses of multipath, but not all. For instance, when using two ISPs, a router may drop packets with unknown source.
The behavior occurs because tcp_v4_connect makes three route lookups when establishing a connection:
1. ip_route_connect calls to select a source address, with saddr zero.
2. ip_route_connect calls again now that saddr and daddr are known.
3. ip_route_newports calls again after a source port is also chosen.
With a route with multiple nexthops, each lookup may make a different choice depending on available entropy to fib_select_multipath. So it is possible for 1 to select the saddr from the first entry, but 3 to select the second entry. Leading to the above situation.
Address this by preferring a match that matches the flowi4 saddr. This will make 2 and 3 make the same choice as 1. Continue to update the backup choice until a choice that matches saddr is found.
Do this in fib_select_multipath itself, rather than passing an fl4_oif constraint, to avoid changing non-multipath route selection. Commit e6b45241c57a ("ipv4: reset flowi parameters on route connect") shows how that may cause regressions.
Also read ipv4.sysctl_fib_multipath_use_neigh only once. No need to refresh in the loop.
This does not happen in IPv6, which performs only one lookup.
--- include/net/ip_fib.h | 3 ++- net/ipv4/fib_semantics.c | 39 +++++++++++++++++++++++++-------------- net/ipv4/route.c | 2 +- 3 files changed, 28 insertions(+), 16 deletions(-)
include/net/ip_fib.h +2 -1
@@ -574,7 +574,8 @@ static inline u32 fib_multipath_hash_from_keys(const struct net *net,int fib_check_nh (struct net *net,struct fib_nh *nh,u32 table,u8 scope,struct netlink_ext_ack *extack); -void fib_select_multipath (struct fib_result *res,int hash); +void fib_select_multipath (struct fib_result *res,int hash, +const struct flowi4 *fl4);void fib_select_path (struct net *net,struct fib_result *res,struct flowi4 *fl4,const struct sk_buff *skb);
net/ipv4/fib_semantics.c +25 -14
@@ -2170,34 +2170,45 @@ static bool fib_good_nh(const struct fib_nh *nh)return !!(state &NUD_VALID ); } -void fib_select_multipath (struct fib_result *res,int hash) +void fib_select_multipath (struct fib_result *res,int hash, +const struct flowi4 *fl4) {struct fib_info *fi = res->fi;struct net *net = fi->fib_net; -bool first = false; +bool found = false; +bool use_neigh; +__be32 saddr;if (unlikely (res->fi->nh)) {nexthop_path_fib_result (res, hash);return ; } + use_neigh =READ_ONCE (net->ipv4.sysctl_fib_multipath_use_neigh); + saddr = fl4 ? fl4->saddr :0 ; +change_nexthops (fi) { -if (READ_ONCE (net->ipv4.sysctl_fib_multipath_use_neigh)) { -if (!fib_good_nh (nexthop_nh)) -continue ; -if (!first) { - res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; - first = true; - } +if (use_neigh && !fib_good_nh (nexthop_nh)) +continue ; + +if (!found) { + res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; + found = !saddr || nexthop_nh->nh_saddr == saddr; }if (hash >atomic_read (&nexthop_nh->fib_nh_upper_bound))continue ; - res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; -return ; +if (!saddr || nexthop_nh->nh_saddr == saddr) { + res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; +return ; + } + +if (found) +return ; + }endfor_nexthops (fi); }#endif
@@ -2212,7 +2223,7 @@ void fib_select_path(struct net *net, struct fib_result *res,if (fib_info_num_path (res->fi) >1 ) {int h =fib_multipath_hash (net, fl4, skb,NULL ); -fib_select_multipath (res, h); +fib_select_multipath (res, h, fl4); } else#endif
net/ipv4/route.c +1 -1
@@ -2154,7 +2154,7 @@ ip_mkroute_input(struct sk_buff *skb, struct fib_result *res,if (res->fi &&fib_info_num_path (res->fi) >1 ) {int h =fib_multipath_hash (res->fi->fib_net,NULL , skb, hkeys); -fib_select_multipath (res, h); +fib_select_multipath (res, h,NULL );IPCB (skb)->flags |=IPSKB_MULTIPATH ; }#endif
Signature · 1 line
2.49.0.805.g082f7c87e0-goog
Re: [PATCH net-next v2 1/3] ipv4: prefer multipath nexthop that matches source address
Quoted 49 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
With multipath routes, try to ensure that packets leave on the device that is associated with the source address.
Avoid the following tcpdump example:
veth0 Out IP 10.1.0.2.38640 > 10.2.0.3.8000: Flags [S] veth1 Out IP 10.1.0.2.38648 > 10.2.0.3.8000: Flags [S]Which can happen easily with the most straightforward setup:
ip addr add 10.0.0.1/24 dev veth0 ip addr add 10.1.0.1/24 dev veth1 ip route add 10.2.0.3 nexthop via 10.0.0.2 dev veth0 \ nexthop via 10.1.0.2 dev veth1This is apparently considered WAI, based on the comment in
ip_route_output_key_hash_rcu:* 2. Moreover, we are allowed to send packets with saddr
* of another iface. --ANKIt may be ok for some uses of multipath, but not all. For instance, when using two ISPs, a router may drop packets with unknown source.
The behavior occurs because
tcp_v4_connectmakes three route lookups when establishing a connection:1.
ip_route_connectcalls to select a source address, with saddr zero.
2.ip_route_connectcalls again now that saddr and daddr are known.
3.ip_route_newportscalls again after a source port is also chosen.With a route with multiple nexthops, each lookup may make a different choice depending on available entropy to
fib_select_multipath. So it is possible for 1 to select the saddr from the first entry, but 3 to select the second entry. Leading to the above situation.Address this by preferring a match that matches the flowi4 saddr. This will make 2 and 3 make the same choice as 1. Continue to update the backup choice until a choice that matches saddr is found.
Do this in
fib_select_multipathitself, rather than passing anfl4_oifconstraint, to avoid changing non-multipath route selection. Commite6b45241c57a("ipv4: reset flowi parameters on route connect") shows how that may cause regressions.
Quoted 7 lines
Also read ipv4.sysctl_fib_multipath_use_neigh only once. No need to refresh in the loop.
This does not happen in IPv6, which performs only one lookup.
Signed-off-by Willem de Bruijn <[email protected]>Reviewed-by David Ahern <[email protected]>
Re: [PATCH net-next v2 1/3] ipv4: prefer multipath nexthop that matches source address
In reply to Willem de BruijnQuoted 48 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
With multipath routes, try to ensure that packets leave on the device that is associated with the source address.
Avoid the following tcpdump example:
veth0 Out IP 10.1.0.2.38640 > 10.2.0.3.8000: Flags [S] veth1 Out IP 10.1.0.2.38648 > 10.2.0.3.8000: Flags [S]Which can happen easily with the most straightforward setup:
ip addr add 10.0.0.1/24 dev veth0 ip addr add 10.1.0.1/24 dev veth1 ip route add 10.2.0.3 nexthop via 10.0.0.2 dev veth0 \ nexthop via 10.1.0.2 dev veth1This is apparently considered WAI, based on the comment in
ip_route_output_key_hash_rcu:* 2. Moreover, we are allowed to send packets with saddr
* of another iface. --ANKIt may be ok for some uses of multipath, but not all. For instance, when using two ISPs, a router may drop packets with unknown source.
The behavior occurs because
tcp_v4_connectmakes three route lookups when establishing a connection:1.
ip_route_connectcalls to select a source address, with saddr zero.
2.ip_route_connectcalls again now that saddr and daddr are known.
3.ip_route_newportscalls again after a source port is also chosen.With a route with multiple nexthops, each lookup may make a different choice depending on available entropy to
fib_select_multipath. So it is possible for 1 to select the saddr from the first entry, but 3 to select the second entry. Leading to the above situation.Address this by preferring a match that matches the flowi4 saddr. This will make 2 and 3 make the same choice as 1. Continue to update the backup choice until a choice that matches saddr is found.
Do this in
fib_select_multipathitself, rather than passing anfl4_oifconstraint, to avoid changing non-multipath route selection. Commite6b45241c57a("ipv4: reset flowi parameters on route connect") shows how that may cause regressions.
Quoted 7 lines
Also read ipv4.sysctl_fib_multipath_use_neigh only once. No need to refresh in the loop.
This does not happen in IPv6, which performs only one lookup.
Signed-off-by Willem de Bruijn <[email protected]>Reviewed-by David Ahern <[email protected]>
One note below
[...]
Quoted 29 lines
net/ipv4/fib_semantics.c +9
-10-void fib_select_multipath (struct fib_result *res,int hash) +void fib_select_multipath (struct fib_result *res,int hash, +const struct flowi4 *fl4) {struct fib_info *fi = res->fi;struct net *net = fi->fib_net; -bool first = false; +bool found = false; +bool use_neigh; +__be32 saddr;if (unlikely (res->fi->nh)) {nexthop_path_fib_result (res, hash);return ; } + use_neigh =READ_ONCE (net->ipv4.sysctl_fib_multipath_use_neigh); + saddr = fl4 ? fl4->saddr :0 ; +change_nexthops (fi) { -if (READ_ONCE (net->ipv4.sysctl_fib_multipath_use_neigh)) { -if (!fib_good_nh (nexthop_nh)) -continue ; -if (!first) { - res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; - first = true; - } +if (use_neigh && !fib_good_nh (nexthop_nh))
net/ipv4/fib_semantics.c static bool fib_good_nh(const struct fib_nh *nh) · line 2201
Quoted 10 lines
net/ipv4/fib_semantics.c +6
-0+continue ; + +if (!found) { + res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; + found = !saddr || nexthop_nh->nh_saddr == saddr; }if (hash >atomic_read (&nexthop_nh->fib_nh_upper_bound))continue ;
Note that because 'res' is set before comparing the hash with the hash threshold, it's possible to choose a nexthop that does not have a carrier (they are assigned a hash threshold of -1), whereas this did not happen before. Tested with [1].
I guess it's not a problem in practice because the initial route lookup for the source address wouldn't have chosen the linkdown nexthop to begin with.
Quoted 5 lines
net/ipv4/fib_semantics.c +1
-3- res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; -return ; +if (!saddr || nexthop_nh->nh_saddr == saddr) {
net/ipv4/fib_semantics.c static bool fib_good_nh(const struct fib_nh *nh) · line 2213
Quoted 10 lines
net/ipv4/fib_semantics.c +8
-0+ res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; +return ; + } + +if (found) +return ; + }endfor_nexthops (fi); }
[1]
#!/bin/bash
ip link del dev dummy1 &> /dev/null
ip link del dev dummy2 &> /dev/null
ip link add name dummy1 up type dummy
ip link add name dummy2 up type dummy
ip address add 192.0.2.1/28 dev dummy1
ip address add 192.0.2.17/28 dev dummy2
ip route add 192.0.2.32/28 \ nexthop via 192.0.2.2 dev dummy1 \ nexthop via 192.0.2.18 dev dummy2
ip link set dev dummy2 carrier off
sysctl -wq net.ipv4.fib_multipath_hash_policy=1 sysctl -wq net.ipv4.conf.all.ignore_routes_with_linkdown=1
sleep 1
ip route show 192.0.2.32/28
for i in {1..100}; do
ip route get to 192.0.2.33 from 192.0.2.17 ipproto tcp sport $i dport $i | grep dummy2
done
Re: [PATCH net-next v2 1/3] ipv4: prefer multipath nexthop that matches source address
Quoted 100 lines · Ido Schimmel
Quoted 48 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
With multipath routes, try to ensure that packets leave on the device that is associated with the source address.
Avoid the following tcpdump example:
veth0 Out IP 10.1.0.2.38640 > 10.2.0.3.8000: Flags [S] veth1 Out IP 10.1.0.2.38648 > 10.2.0.3.8000: Flags [S]Which can happen easily with the most straightforward setup:
ip addr add 10.0.0.1/24 dev veth0 ip addr add 10.1.0.1/24 dev veth1 ip route add 10.2.0.3 nexthop via 10.0.0.2 dev veth0 \ nexthop via 10.1.0.2 dev veth1This is apparently considered WAI, based on the comment in
ip_route_output_key_hash_rcu:* 2. Moreover, we are allowed to send packets with saddr
* of another iface. --ANKIt may be ok for some uses of multipath, but not all. For instance, when using two ISPs, a router may drop packets with unknown source.
The behavior occurs because
tcp_v4_connectmakes three route lookups when establishing a connection:1.
ip_route_connectcalls to select a source address, with saddr zero.
2.ip_route_connectcalls again now that saddr and daddr are known.
3.ip_route_newportscalls again after a source port is also chosen.With a route with multiple nexthops, each lookup may make a different choice depending on available entropy to
fib_select_multipath. So it is possible for 1 to select the saddr from the first entry, but 3 to select the second entry. Leading to the above situation.Address this by preferring a match that matches the flowi4 saddr. This will make 2 and 3 make the same choice as 1. Continue to update the backup choice until a choice that matches saddr is found.
Do this in
fib_select_multipathitself, rather than passing anfl4_oifconstraint, to avoid changing non-multipath route selection. Commite6b45241c57a("ipv4: reset flowi parameters on route connect") shows how that may cause regressions.Quoted 7 lines
Also read ipv4.sysctl_fib_multipath_use_neigh only once. No need to refresh in the loop.
This does not happen in IPv6, which performs only one lookup.
Signed-off-by Willem de Bruijn <[email protected]>Reviewed-by David Ahern <[email protected]>Reviewed-by Ido Schimmel <[email protected]>One note below
[...]
Quoted 37 lines
net/ipv4/fib_semantics.c +15
-10-void fib_select_multipath (struct fib_result *res,int hash) +void fib_select_multipath (struct fib_result *res,int hash, +const struct flowi4 *fl4) {struct fib_info *fi = res->fi;struct net *net = fi->fib_net; -bool first = false; +bool found = false; +bool use_neigh; +__be32 saddr;if (unlikely (res->fi->nh)) {nexthop_path_fib_result (res, hash);return ; } + use_neigh =READ_ONCE (net->ipv4.sysctl_fib_multipath_use_neigh); + saddr = fl4 ? fl4->saddr :0 ; +change_nexthops (fi) { -if (READ_ONCE (net->ipv4.sysctl_fib_multipath_use_neigh)) { -if (!fib_good_nh (nexthop_nh)) -continue ; -if (!first) { - res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; - first = true; - } +if (use_neigh && !fib_good_nh (nexthop_nh)) +continue ; + +if (!found) { + res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; + found = !saddr || nexthop_nh->nh_saddr == saddr; }
Quoted 7 lines
net/ipv4/fib_semantics.c static bool fib_good_nh(const struct fib_nh *nh) · line 2201
Quoted 2 lines
net/ipv4/fib_semantics.c +0
-0if (hash >atomic_read (&nexthop_nh->fib_nh_upper_bound))continue ;Note that because 'res' is set before comparing the hash with the hash threshold, it's possible to choose a nexthop that does not have a carrier (they are assigned a hash threshold of -1), whereas this did not happen before. Tested with [1].
This is different from the previous pre-threshold choice if !first, because that choice was always tested with fib_good_nh(), while now that is optional?
Quoted 3 lines
I guess it's not a problem in practice because the initial route lookup for the source address wouldn't have chosen the linkdown nexthop to begin with.
Agreed. Thanks for the thorough review.
Quoted 40 lines
Quoted 5 lines
net/ipv4/fib_semantics.c +1
-3- res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; -return ; +if (!saddr || nexthop_nh->nh_saddr == saddr) {net/ipv4/fib_semantics.c static bool fib_good_nh(const struct fib_nh *nh) · line 2213
Quoted 10 lines
net/ipv4/fib_semantics.c +8
-0+ res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; +return ; + } + +if (found) +return ; + }endfor_nexthops (fi); }[1]
#!/bin/baship link del dev dummy1 &>
/dev/null
ip link del dev dummy2 &>/dev/nullip link add name dummy1 up type dummy
ip link add name dummy2 up type dummy
ip address add 192.0.2.1/28 dev dummy1
ip address add 192.0.2.17/28 dev dummy2ip route add 192.0.2.32/28 \ nexthop via 192.0.2.2 dev dummy1 \ nexthop via 192.0.2.18 dev dummy2ip link set dev dummy2 carrier off
sysctl -wq net.ipv4.fib_multipath_hash_policy=1 sysctl -wq net.ipv4.conf.all.ignore_routes_with_linkdown=1sleep 1
ip route show 192.0.2.32/28
for i in {1..100}; doip route get to 192.0.2.33 from 192.0.2.17 ipproto tcp sport $i dport $i | grep dummy2done
Ido Schimmel
maintainerRe: [PATCH net-next v2 1/3] ipv4: prefer multipath nexthop that matches source address
Quoted 109 lines · Willem de Bruijn
Quoted 100 lines · Ido Schimmel
Quoted 48 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
With multipath routes, try to ensure that packets leave on the device that is associated with the source address.
Avoid the following tcpdump example:
veth0 Out IP 10.1.0.2.38640 > 10.2.0.3.8000: Flags [S] veth1 Out IP 10.1.0.2.38648 > 10.2.0.3.8000: Flags [S]Which can happen easily with the most straightforward setup:
ip addr add 10.0.0.1/24 dev veth0 ip addr add 10.1.0.1/24 dev veth1 ip route add 10.2.0.3 nexthop via 10.0.0.2 dev veth0 \ nexthop via 10.1.0.2 dev veth1This is apparently considered WAI, based on the comment in
ip_route_output_key_hash_rcu:* 2. Moreover, we are allowed to send packets with saddr
* of another iface. --ANKIt may be ok for some uses of multipath, but not all. For instance, when using two ISPs, a router may drop packets with unknown source.
The behavior occurs because
tcp_v4_connectmakes three route lookups when establishing a connection:1.
ip_route_connectcalls to select a source address, with saddr zero.
2.ip_route_connectcalls again now that saddr and daddr are known.
3.ip_route_newportscalls again after a source port is also chosen.With a route with multiple nexthops, each lookup may make a different choice depending on available entropy to
fib_select_multipath. So it is possible for 1 to select the saddr from the first entry, but 3 to select the second entry. Leading to the above situation.Address this by preferring a match that matches the flowi4 saddr. This will make 2 and 3 make the same choice as 1. Continue to update the backup choice until a choice that matches saddr is found.
Do this in
fib_select_multipathitself, rather than passing anfl4_oifconstraint, to avoid changing non-multipath route selection. Commite6b45241c57a("ipv4: reset flowi parameters on route connect") shows how that may cause regressions.Quoted 7 lines
Also read ipv4.sysctl_fib_multipath_use_neigh only once. No need to refresh in the loop.
This does not happen in IPv6, which performs only one lookup.
Signed-off-by Willem de Bruijn <[email protected]>Reviewed-by David Ahern <[email protected]>Reviewed-by Ido Schimmel <[email protected]>One note below
[...]
Quoted 37 lines
(quoted diff) +15
-10-void fib_select_multipath(struct fib_result *res, int hash) +void fib_select_multipath(struct fib_result *res, int hash, + const struct flowi4 *fl4) { struct fib_info *fi = res->fi; struct net *net = fi->fib_net; - bool first = false; + bool found = false; + bool use_neigh; + __be32 saddr; if (unlikely(res->fi->nh)) { nexthop_path_fib_result(res, hash); return; } + use_neigh = READ_ONCE(net->ipv4.sysctl_fib_multipath_use_neigh); + saddr = fl4 ? fl4->saddr : 0; + change_nexthops(fi) { - if (READ_ONCE(net->ipv4.sysctl_fib_multipath_use_neigh)) { - if (!fib_good_nh(nexthop_nh)) - continue; - if (!first) { - res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; - first = true; - } + if (use_neigh && !fib_good_nh(nexthop_nh)) + continue; + + if (!found) { + res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; + found = !saddr || nexthop_nh->nh_saddr == saddr; }Quoted 7 lines
Review
Quoted 2 lines
(quoted diff) +0
-0if (hash > atomic_read(&nexthop_nh->fib_nh_upper_bound)) continue;Note that because 'res' is set before comparing the hash with the hash threshold, it's possible to choose a nexthop that does not have a carrier (they are assigned a hash threshold of -1), whereas this did not happen before. Tested with [1].
Quoted 3 lines
This is different from the previous pre-threshold choice if !first, because that choice was always tested with
fib_good_nh(), while now that is optional?
I'm not sure I understood the question, but my point is that we can make the code a bit clearer and more "correct" with something like this [1] as a follow-up. It honors the "ignore_routes_with_linkdown" sysctl and skips over nexthops that do not have a carrier.
I tested with [2] which fails without the patch. fib_tests.sh is also OK
[3] (including the new tests).
In practice, the patch shouldn't make a big difference. For the case of saddr==0 (e.g., forwarding), it shouldn't make any difference because you are guaranteed to find a nexthop whose upper bound covers the calculated hash.
For the case of saddr!=0 (e.g., locally generated traffic) this patch will not choose a nexthop if it has the correct address but no carrier. Like I said before, it probably doesn't matter in practice because the route lookup for the source address wouldn't choose this nexthop / address in the first place.
[1]
net/ipv4/fib_semantics.c +9 -2
@@ -2188,7 +2188,14 @@ void fib_select_multipath(struct fib_result *res, int hash, saddr = fl4 ? fl4->saddr :0 ;change_nexthops (fi) { -if (use_neigh && !fib_good_nh (nexthop_nh)) +int nh_upper_bound; + +/* Nexthops without a carrier are assigned an upper bound of +* minus one when "ignore_routes_with_linkdown" is set. +*/ + nh_upper_bound =atomic_read (&nexthop_nh->fib_nh_upper_bound); +if (nh_upper_bound ==-1 || + (use_neigh && !fib_good_nh (nexthop_nh)))continue ;if (!found) {
@@ -2197,7 +2204,7 @@ void fib_select_multipath(struct fib_result *res, int hash, found = !saddr || nexthop_nh->nh_saddr == saddr; } -if (hash >atomic_read (&nexthop_nh->fib_nh_upper_bound)) +if (hash > nh_upper_bound)continue ;if (!saddr || nexthop_nh->nh_saddr == saddr) {
[2]
#!/bin/bash
trap cleanup EXIT
cleanup() {
ip netns del ns1
}
ip netns add ns1
ip -n ns1 link set dev lo up
ip -n ns1 link add name dummy1 up type dummy
ip -n ns1 link add name dummy2 up type dummy
ip -n ns1 address add 192.0.2.1/28 dev dummy1
ip -n ns1 address add 192.0.2.17/28 dev dummy2
ip -n ns1 route add 198.51.100.0/24 \ nexthop via 192.0.2.2 dev dummy1 \ nexthop via 192.0.2.18 dev dummy2
ip netns exec ns1 sysctl -wq net.ipv4.fib_multipath_hash_policy=1 ip netns exec ns1 sysctl -wq net.ipv4.conf.all.ignore_routes_with_linkdown=1
ip -n ns1 link set dev dummy2 carrier off
for i in {1..128}; do
ip -n ns1 route get to 198.51.100.1 from 192.0.2.17 \ ipproto tcp sport $i dport $i | grep -q dummy2 [[ $? -eq 0 ]] && echo "FAIL" && exit
done
echo "SUCCESS"
[3]
# ./fib_tests.sh [...] Tests passed: 230 Tests failed: 0
Re: [PATCH net-next v2 1/3] ipv4: prefer multipath nexthop that matches source address
Quoted 155 lines · Ido Schimmel
Quoted 109 lines · Willem de Bruijn
Quoted 100 lines · Ido Schimmel
Quoted 48 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
With multipath routes, try to ensure that packets leave on the device that is associated with the source address.
Avoid the following tcpdump example:
veth0 Out IP 10.1.0.2.38640 > 10.2.0.3.8000: Flags [S] veth1 Out IP 10.1.0.2.38648 > 10.2.0.3.8000: Flags [S]Which can happen easily with the most straightforward setup:
ip addr add 10.0.0.1/24 dev veth0 ip addr add 10.1.0.1/24 dev veth1 ip route add 10.2.0.3 nexthop via 10.0.0.2 dev veth0 \ nexthop via 10.1.0.2 dev veth1This is apparently considered WAI, based on the comment in
ip_route_output_key_hash_rcu:* 2. Moreover, we are allowed to send packets with saddr
* of another iface. --ANKIt may be ok for some uses of multipath, but not all. For instance, when using two ISPs, a router may drop packets with unknown source.
The behavior occurs because
tcp_v4_connectmakes three route lookups when establishing a connection:1.
ip_route_connectcalls to select a source address, with saddr zero.
2.ip_route_connectcalls again now that saddr and daddr are known.
3.ip_route_newportscalls again after a source port is also chosen.With a route with multiple nexthops, each lookup may make a different choice depending on available entropy to
fib_select_multipath. So it is possible for 1 to select the saddr from the first entry, but 3 to select the second entry. Leading to the above situation.Address this by preferring a match that matches the flowi4 saddr. This will make 2 and 3 make the same choice as 1. Continue to update the backup choice until a choice that matches saddr is found.
Do this in
fib_select_multipathitself, rather than passing anfl4_oifconstraint, to avoid changing non-multipath route selection. Commite6b45241c57a("ipv4: reset flowi parameters on route connect") shows how that may cause regressions.Quoted 7 lines
Also read ipv4.sysctl_fib_multipath_use_neigh only once. No need to refresh in the loop.
This does not happen in IPv6, which performs only one lookup.
Signed-off-by Willem de Bruijn <[email protected]>Reviewed-by David Ahern <[email protected]>Reviewed-by Ido Schimmel <[email protected]>One note below
[...]
Quoted 37 lines
(quoted diff) +15
-10-void fib_select_multipath(struct fib_result *res, int hash) +void fib_select_multipath(struct fib_result *res, int hash, + const struct flowi4 *fl4) { struct fib_info *fi = res->fi; struct net *net = fi->fib_net; - bool first = false; + bool found = false; + bool use_neigh; + __be32 saddr; if (unlikely(res->fi->nh)) { nexthop_path_fib_result(res, hash); return; } + use_neigh = READ_ONCE(net->ipv4.sysctl_fib_multipath_use_neigh); + saddr = fl4 ? fl4->saddr : 0; + change_nexthops(fi) { - if (READ_ONCE(net->ipv4.sysctl_fib_multipath_use_neigh)) { - if (!fib_good_nh(nexthop_nh)) - continue; - if (!first) { - res->nh_sel = nhsel; - res->nhc = &nexthop_nh->nh_common; - first = true; - } + if (use_neigh && !fib_good_nh(nexthop_nh)) + continue; + + if (!found) { + res->nh_sel = nhsel; + res->nhc = &nexthop_nh->nh_common; + found = !saddr || nexthop_nh->nh_saddr == saddr; }Quoted 7 lines
Review
Quoted 2 lines
(quoted diff) +0
-0if (hash > atomic_read(&nexthop_nh->fib_nh_upper_bound)) continue;Note that because 'res' is set before comparing the hash with the hash threshold, it's possible to choose a nexthop that does not have a carrier (they are assigned a hash threshold of -1), whereas this did not happen before. Tested with [1].
Quoted 3 lines
This is different from the previous pre-threshold choice if !first, because that choice was always tested with
fib_good_nh(), while now that is optional?I'm not sure I understood the question, but my point is that we can make the code a bit clearer and more "correct" with something like this [1] as a follow-up. It honors the "
ignore_routes_with_linkdown" sysctl and skips over nexthops that do not have a carrier.I tested with [2] which fails without the patch.
fib_tests.shis also OK
[3] (including the new tests).In practice, the patch shouldn't make a big difference. For the case of saddr==0 (e.g., forwarding), it shouldn't make any difference because you are guaranteed to find a nexthop whose upper bound covers the calculated hash.
For the case of saddr!=0 (e.g., locally generated traffic) this patch will not choose a nexthop if it has the correct address but no carrier. Like I said before, it probably doesn't matter in practice because the route lookup for the source address wouldn't choose this nexthop / address in the first place.
[1]
net/ipv4/fib_semantics.c +8
-1@@ -2188,7 +2188,14 @@ void fib_select_multipath(struct fib_result *res, int hash, saddr = fl4 ? fl4->saddr :0 ;change_nexthops (fi) { -if (use_neigh && !fib_good_nh (nexthop_nh)) +int nh_upper_bound; + +/* Nexthops without a carrier are assigned an upper bound of +* minus one when "ignore_routes_with_linkdown" is set. +*/ + nh_upper_bound =atomic_read (&nexthop_nh->fib_nh_upper_bound); +if (nh_upper_bound ==-1 || + (use_neigh && !fib_good_nh (nexthop_nh)))continue ;if (!found) {
net/ipv4/fib_semantics.c void fib_select_multipath(struct fib_result *res, int hash, · line 2210
Quoted 8 lines
net/ipv4/fib_semantics.c +1
-1@@ -2197,7 +2204,7 @@ void fib_select_multipath(struct fib_result *res, int hash, found = !saddr || nexthop_nh->nh_saddr == saddr; } -if (hash >atomic_read (&nexthop_nh->fib_nh_upper_bound)) +if (hash > nh_upper_bound)continue ;if (!saddr || nexthop_nh->nh_saddr == saddr) {
Makes sense, thanks.
Do you want to send the follow up to net-next once the series lands there?
Quoted 40 lines
[2]
#!/bin/bashtrap cleanup EXIT
cleanup(){
ip netns del ns1
}ip netns add ns1
ip -n ns1 link set dev lo upip -n ns1 link add name dummy1 up type dummy
ip -n ns1 link add name dummy2 up type dummyip -n ns1 address add 192.0.2.1/28 dev dummy1
ip -n ns1 address add 192.0.2.17/28 dev dummy2ip -n ns1 route add 198.51.100.0/24 \ nexthop via 192.0.2.2 dev dummy1 \ nexthop via 192.0.2.18 dev dummy2ip netns exec ns1 sysctl -wq net.ipv4.fib_multipath_hash_policy=1 ip netns exec ns1 sysctl -wq net.ipv4.conf.all.ignore_routes_with_linkdown=1
ip -n ns1 link set dev dummy2 carrier off
for i in {1..128}; do
ip -n ns1 route get to 198.51.100.1 from 192.0.2.17 \ ipproto tcp sport $i dport $i | grep -q dummy2 [[ $? -eq 0 ]] && echo "FAIL" && exitdone
echo "SUCCESS"
[3]
# ./fib_tests.sh [...] Tests passed: 230 Tests failed: 0
Ido Schimmel
maintainerRe: [PATCH net-next v2 1/3] ipv4: prefer multipath nexthop that matches source address
Quoted 2 lines · Willem de Bruijn
Do you want to send the follow up to net-next once the series lands there?
OK, I can do that.
PATCH v2 2/3 ip: load balance tcp connections to single dst addr and port
In reply to Willem de BruijnFrom: Willem de Bruijn <[email protected]>
Load balance new TCP connections across nexthops also when they connect to the same service at a single remote address and port.
This affects only port-based multipath hashing:fib_multipath_hash_policy 1 or 3.
Local connections must choose both a source address and port when connecting to a remote service, in ip_route_connect. This "chicken-and-egg problem" (commit 2d7192d6cbab ("ipv4: Sanitize and simplify ip_route_{connect,newports}()")) is resolved by first selecting a source address, by looking up a route using the zero wildcard source port and address.
As a result multiple connections to the same destination address and port have no entropy in fib_multipath_hash.
This is not a problem when forwarding, as skb-based hashing has a 4-tuple. Nor when establishing UDP connections, as autobind there selects a port before reaching ip_route_connect.
Load balance also TCP, by using a random port in fib_multipath_hash. Port assignment in inet_hash_connect is not atomic with ip_route_connect. Thus ports are unpredictable, effectively random.
Implementation details:
Do not actually pass a random fl4_sport, as that affects not only hashing, but routing more broadly, and can match a source port based policy route, which existing wildcard port 0 will not. Instead, define a new wildcard flowi flag that is used only for hashing.
Selecting a random source is equivalent to just selecting a random hash entirely. But for code clarity, follow the normal 4-tuple hash process and only update this field.
fib_multipath_hash can be reached with zero sport from other code paths, so explicitly pass this flowi flag, rather than trying to infer this case in the function itself.
---
v1->v2
- add (__force __be16) to use random data as __be16
--- include/net/flow.h | 1 + include/net/route.h | 3 +++ net/ipv4/route.c | 13 ++++++++++--- net/ipv6/route.c | 13 ++++++++++--- net/ipv6/tcp_ipv6.c | 2 ++ 5 files changed, 26 insertions(+), 6 deletions(-)
include/net/flow.h +1 -0
@@ -39,6 +39,7 @@ struct flowi_common {#define FLOWI_FLAG_ANYSRC 0x01#define FLOWI_FLAG_KNOWN_NH 0x02#define FLOWI_FLAG_L3MDEV_OIF 0x04 +#define FLOWI_FLAG_ANY_SPORT 0x08__u32 flowic_secid;kuid_t flowic_uid;__u32 flowic_multipath_hash;
include/net/route.h +3 -0
@@ -326,6 +326,9 @@ static inline void ip_route_connect_init(struct flowi4 *fl4, __be32 dst,if (inet_test_bit (TRANSPARENT , sk)) flow_flags |=FLOWI_FLAG_ANYSRC ; +if (IS_ENABLED (CONFIG_IP_ROUTE_MULTIPATH ) && !sport) + flow_flags |=FLOWI_FLAG_ANY_SPORT ; +flowi4_init_output (fl4, oif,READ_ONCE (sk->sk_mark),ip_sock_rt_tos (sk),ip_sock_rt_scope (sk), protocol, flow_flags, dst, src, dport, sport, sk->sk_uid);
net/ipv4/route.c +10 -3
@@ -2037,8 +2037,12 @@ static u32 fib_multipath_custom_hash_fl4(const struct net *net, hash_keys.addrs.v4addrs.dst = fl4->daddr;if (hash_fields &FIB_MULTIPATH_HASH_FIELD_IP_PROTO ) hash_keys.basic.ip_proto = fl4->flowi4_proto; -if (hash_fields &FIB_MULTIPATH_HASH_FIELD_SRC_PORT ) - hash_keys.ports.src = fl4->fl4_sport; +if (hash_fields &FIB_MULTIPATH_HASH_FIELD_SRC_PORT ) { +if (fl4->flowi4_flags &FLOWI_FLAG_ANY_SPORT ) + hash_keys.ports.src = (__force __be16 )get_random_u16 (); +else + hash_keys.ports.src = fl4->fl4_sport; + }if (hash_fields &FIB_MULTIPATH_HASH_FIELD_DST_PORT ) hash_keys.ports.dst = fl4->fl4_dport;
@@ -2093,7 +2097,10 @@ int fib_multipath_hash(const struct net *net, const struct flowi4 *fl4, hash_keys.control.addr_type =FLOW_DISSECTOR_KEY_IPV4_ADDRS ; hash_keys.addrs.v4addrs.src = fl4->saddr; hash_keys.addrs.v4addrs.dst = fl4->daddr; - hash_keys.ports.src = fl4->fl4_sport; +if (fl4->flowi4_flags &FLOWI_FLAG_ANY_SPORT ) + hash_keys.ports.src = (__force __be16 )get_random_u16 (); +else + hash_keys.ports.src = fl4->fl4_sport; hash_keys.ports.dst = fl4->fl4_dport; hash_keys.basic.ip_proto = fl4->flowi4_proto; }
net/ipv6/route.c +10 -3
@@ -2492,8 +2492,12 @@ static u32 rt6_multipath_custom_hash_fl6(const struct net *net, hash_keys.basic.ip_proto = fl6->flowi6_proto;if (hash_fields &FIB_MULTIPATH_HASH_FIELD_FLOWLABEL ) hash_keys.tags.flow_label = (__force u32 )flowi6_get_flowlabel (fl6); -if (hash_fields &FIB_MULTIPATH_HASH_FIELD_SRC_PORT ) - hash_keys.ports.src = fl6->fl6_sport; +if (hash_fields &FIB_MULTIPATH_HASH_FIELD_SRC_PORT ) { +if (fl6->flowi6_flags &FLOWI_FLAG_ANY_SPORT ) + hash_keys.ports.src = (__force __be16 )get_random_u16 (); +else + hash_keys.ports.src = fl6->fl6_sport; + }if (hash_fields &FIB_MULTIPATH_HASH_FIELD_DST_PORT ) hash_keys.ports.dst = fl6->fl6_dport;
@@ -2547,7 +2551,10 @@ u32 rt6_multipath_hash(const struct net *net, const struct flowi6 *fl6, hash_keys.control.addr_type =FLOW_DISSECTOR_KEY_IPV6_ADDRS ; hash_keys.addrs.v6addrs.src = fl6->saddr; hash_keys.addrs.v6addrs.dst = fl6->daddr; - hash_keys.ports.src = fl6->fl6_sport; +if (fl6->flowi6_flags &FLOWI_FLAG_ANY_SPORT ) + hash_keys.ports.src = (__force __be16 )get_random_u16 (); +else + hash_keys.ports.src = fl6->fl6_sport; hash_keys.ports.dst = fl6->fl6_dport; hash_keys.basic.ip_proto = fl6->flowi6_proto; }
net/ipv6/tcp_ipv6.c +2 -0
@@ -267,6 +267,8 @@ static int tcp_v6_connect(struct sock *sk, struct sockaddr *uaddr, fl6.flowi6_mark = sk->sk_mark; fl6.fl6_dport = usin->sin6_port; fl6.fl6_sport = inet->inet_sport; +if (IS_ENABLED (CONFIG_IP_ROUTE_MULTIPATH ) && !fl6.fl6_sport) + fl6.flowi6_flags =FLOWI_FLAG_ANY_SPORT ; fl6.flowi6_uid = sk->sk_uid; opt =rcu_dereference_protected (np->opt,lockdep_sock_is_held (sk));
Signature · 1 line
2.49.0.805.g082f7c87e0-goog
Re: [PATCH net-next v2 2/3] ip: load balance tcp connections to single dst addr and port
Quoted 47 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
Load balance new TCP connections across nexthops also when they connect to the same service at a single remote address and port.
This affects only port-based multipath hashing:
fib_multipath_hash_policy1 or 3.Local connections must choose both a source address and port when connecting to a remote service, in
ip_route_connect. This "chicken-and-egg problem" (commit2d7192d6cbab("ipv4: Sanitize and simplify ip_route_{connect,newports}()")) is resolved by first selecting a source address, by looking up a route using the zero wildcard source port and address.As a result multiple connections to the same destination address and port have no entropy in
fib_multipath_hash.This is not a problem when forwarding, as skb-based hashing has a 4-tuple. Nor when establishing UDP connections, as autobind there selects a port before reaching
ip_route_connect.Load balance also TCP, by using a random port in
fib_multipath_hash. Port assignment ininet_hash_connectis not atomic withip_route_connect. Thus ports are unpredictable, effectively random.Implementation details:
Do not actually pass a random
fl4_sport, as that affects not only hashing, but routing more broadly, and can match a source port based policy route, which existing wildcard port 0 will not. Instead, define a new wildcard flowi flag that is used only for hashing.Selecting a random source is equivalent to just selecting a random hash entirely. But for code clarity, follow the normal 4-tuple hash process and only update this field.
fib_multipath_hashcan be reached with zero sport from other code paths, so explicitly pass this flowi flag, rather than trying to infer this case in the function itself.Signed-off-by Willem de Bruijn <[email protected]>---
v1->v2
- add (__force__be16) to use random data as__be16
Quoted 8 lines
--- include/net/flow.h | 1 + include/net/route.h | 3 +++ net/ipv4/route.c | 13 ++++++++++--- net/ipv6/route.c | 13 ++++++++++--- net/ipv6/tcp_ipv6.c | 2 ++ 5 files changed, 26 insertions(+), 6 deletions(-)
Re: [PATCH net-next v2 2/3] ip: load balance tcp connections to single dst addr and port
In reply to Willem de BruijnQuoted 38 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
Load balance new TCP connections across nexthops also when they connect to the same service at a single remote address and port.
This affects only port-based multipath hashing:
fib_multipath_hash_policy1 or 3.Local connections must choose both a source address and port when connecting to a remote service, in
ip_route_connect. This "chicken-and-egg problem" (commit2d7192d6cbab("ipv4: Sanitize and simplify ip_route_{connect,newports}()")) is resolved by first selecting a source address, by looking up a route using the zero wildcard source port and address.As a result multiple connections to the same destination address and port have no entropy in
fib_multipath_hash.This is not a problem when forwarding, as skb-based hashing has a 4-tuple. Nor when establishing UDP connections, as autobind there selects a port before reaching
ip_route_connect.Load balance also TCP, by using a random port in
fib_multipath_hash. Port assignment ininet_hash_connectis not atomic withip_route_connect. Thus ports are unpredictable, effectively random.Implementation details:
Do not actually pass a random
fl4_sport, as that affects not only hashing, but routing more broadly, and can match a source port based policy route, which existing wildcard port 0 will not. Instead, define a new wildcard flowi flag that is used only for hashing.Selecting a random source is equivalent to just selecting a random hash entirely. But for code clarity, follow the normal 4-tuple hash process and only update this field.
Quoted 5 lines
fib_multipath_hashcan be reached with zero sport from other code paths, so explicitly pass this flowi flag, rather than trying to infer this case in the function itself.Signed-off-by Willem de Bruijn <[email protected]>
Re: [PATCH net-next v2 2/3] ip: load balance tcp connections to single dst addr and port
In reply to Willem de BruijnQuoted 37 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
Load balance new TCP connections across nexthops also when they connect to the same service at a single remote address and port.
This affects only port-based multipath hashing:
fib_multipath_hash_policy1 or 3.Local connections must choose both a source address and port when connecting to a remote service, in
ip_route_connect. This "chicken-and-egg problem" (commit2d7192d6cbab("ipv4: Sanitize and simplify ip_route_{connect,newports}()")) is resolved by first selecting a source address, by looking up a route using the zero wildcard source port and address.As a result multiple connections to the same destination address and port have no entropy in
fib_multipath_hash.This is not a problem when forwarding, as skb-based hashing has a 4-tuple. Nor when establishing UDP connections, as autobind there selects a port before reaching
ip_route_connect.Load balance also TCP, by using a random port in
fib_multipath_hash. Port assignment ininet_hash_connectis not atomic withip_route_connect. Thus ports are unpredictable, effectively random.Implementation details:
Do not actually pass a random
fl4_sport, as that affects not only hashing, but routing more broadly, and can match a source port based policy route, which existing wildcard port 0 will not. Instead, define a new wildcard flowi flag that is used only for hashing.Selecting a random source is equivalent to just selecting a random hash entirely. But for code clarity, follow the normal 4-tuple hash process and only update this field.
Quoted 5 lines
fib_multipath_hashcan be reached with zero sport from other code paths, so explicitly pass this flowi flag, rather than trying to infer this case in the function itself.Signed-off-by Willem de Bruijn <[email protected]>
PATCH v2 3/3 selftests/net: test tcp connection load balancing
In reply to Willem de BruijnFrom: Willem de Bruijn <[email protected]>
Verify that TCP connections use both routes when connecting multiple times to a remote service over a two nexthop multipath route.
Use socat to create the connections. Use tc prio + tc filter to count routes taken, counting SYN packets across the two egress devices. Also verify that the saddr matches that of the device.
To avoid flaky tests when testing inherently randomized behavior, set a low bar and pass if even a single SYN is observed on each device.
---
v1->v2
- match also on saddr, not only SYN
- move from fib_nexthops.sh to fib_tests.sh
- move generic "count packets on dev" to lib.sh
- switch from netcat to socat, as different netcats go around
--- tools/testing/selftests/net/fib_tests.sh | 120 ++++++++++++++++++++++- tools/testing/selftests/net/lib.sh | 24 +++++ 2 files changed, 143 insertions(+), 1 deletion(-)
tools/testing/selftests/net/fib_tests.sh +119 -1
@@ -11,7 +11,7 @@ TESTS="unregister down carrier nexthop suppress ipv6_notify ipv4_notify \ ipv6_rt ipv4_rt ipv6_addr_metric ipv4_addr_metric ipv6_route_metrics \ ipv4_route_metrics ipv4_route_v6_gw rp_filter ipv4_del_addr \ ipv6_del_addr ipv4_mangle ipv6_mangle ipv4_bcast_neigh fib6_gc_test \ - ipv4_mpath_list ipv6_mpath_list" + ipv4_mpath_list ipv6_mpath_list ipv4_mpath_balance ipv6_mpath_balance" VERBOSE=0 PAUSE_ON_FAIL=no
@@ -1085,6 +1085,35 @@ route_setup() set +e } +forwarding_cleanup() +{ + cleanup_ns $ns3 + + route_cleanup +} + +# extend route_setup with an ns3 reachable through ns2 over both devices +forwarding_setup() +{ + forwarding_cleanup + + route_setup + + setup_ns ns3 + + ip link add veth5 netns $ns3 type veth peer name veth6 netns $ns2 + ip -netns $ns3 link set veth5 up + ip -netns $ns2 link set veth6 up + + ip -netns $ns3 -4 addr add dev veth5 172.16.105.1/24 + ip -netns $ns2 -4 addr add dev veth6 172.16.105.2/24 + ip -netns $ns3 -4 route add 172.16.100.0/22 via 172.16.105.2 + + ip -netns $ns3 -6 addr add dev veth5 2001:db8:105::1/64 nodad + ip -netns $ns2 -6 addr add dev veth6 2001:db8:105::2/64 nodad + ip -netns $ns3 -6 route add 2001:db8:101::/33 via 2001:db8:105::2 +} + # assumption is that basic add of a single path route works # otherwise just adding an address on an interface is broken ipv6_rt_add()
@@ -2600,6 +2629,93 @@ ipv6_mpath_list_test() route_cleanup } +tc_set_flower_counter__saddr_syn() { + tc_set_flower_counter $1 $2 $3 "src_ip $4 ip_proto tcp tcp_flags 0x2" +} + +ip_mpath_balance_dep_check() +{ + if [ ! -x "$(command -v socat)" ]; then + echo "socat command not found. Skipping test" + return 1 + fi + + if [ ! -x "$(command -v jq)" ]; then + echo "jq command not found. Skipping test" + return 1 + fi +} + +ip_mpath_balance() { + local -r ipver=$1 + local -r daddr=$2 + local -r num_conn=20 + + for i in $(seq 1 $num_conn); do + ip netns exec $ns3 socat $ipver TCP-LISTEN:8000 STDIO >/dev/null & + sleep 0.02 + echo -n a | ip netns exec $ns1 socat $ipver STDIO TCP:$daddr:8000 + done + + local -r syn0="$(tc_get_flower_counter $ns1 veth1)" + local -r syn1="$(tc_get_flower_counter $ns1 veth3)" + local -r syns=$((syn0+syn1)) + + [ "$VERBOSE" = "1" ] && echo "multipath: syns seen: ($syn0,$syn1)" + + [[ $syns -ge $num_conn ]] && [[ $syn0 -gt 0 ]] && [[ $syn1 -gt 0 ]] +} + +ipv4_mpath_balance_test() +{ + echo + echo "IPv4 multipath load balance test" + + ip_mpath_balance_dep_check || return 1 + forwarding_setup + + $IP route add 172.16.105.1 \ + nexthop via 172.16.101.2 \ + nexthop via 172.16.103.2 + + ip netns exec $ns1 \ + sysctl -q -w net.ipv4.fib_multipath_hash_policy=1 + + tc_set_flower_counter__saddr_syn $ns1 4 veth1 172.16.101.1 + tc_set_flower_counter__saddr_syn $ns1 4 veth3 172.16.103.1 + + ip_mpath_balance -4 172.16.105.1 + + log_test $? 0 "IPv4 multipath loadbalance" + + forwarding_cleanup +} + +ipv6_mpath_balance_test() +{ + echo + echo "IPv6 multipath load balance test" + + ip_mpath_balance_dep_check || return 1 + forwarding_setup + + $IP route add 2001:db8:105::1\ + nexthop via 2001:db8:101::2 \ + nexthop via 2001:db8:103::2 + + ip netns exec $ns1 \ + sysctl -q -w net.ipv6.fib_multipath_hash_policy=1 + + tc_set_flower_counter__saddr_syn $ns1 6 veth1 2001:db8:101::1 + tc_set_flower_counter__saddr_syn $ns1 6 veth3 2001:db8:103::1 + + ip_mpath_balance -6 "[2001:db8:105::1]" + + log_test $? 0 "IPv6 multipath loadbalance" + + forwarding_cleanup +} + ################################################################################ # usage
@@ -2683,6 +2799,8 @@ do fib6_gc_test|ipv6_gc) fib6_gc_test;; ipv4_mpath_list) ipv4_mpath_list_test;; ipv6_mpath_list) ipv6_mpath_list_test;; + ipv4_mpath_balance) ipv4_mpath_balance_test;; + ipv6_mpath_balance) ipv6_mpath_balance_test;; help) echo "Test names: $TESTS"; exit 0;; esac
tools/testing/selftests/net/lib.sh +24 -0
@@ -270,6 +270,30 @@ tc_rule_handle_stats_get() .options.actions[0].stats$selector" } +# attach a qdisc with two children match/no-match and a flower filter to match +tc_set_flower_counter() { + local -r ns=$1 + local -r ipver=$2 + local -r dev=$3 + local -r flower_expr=$4 + + tc -n $ns qdisc add dev $dev root handle 1: prio bands 2 \ + priomap 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 + + tc -n $ns qdisc add dev $dev parent 1:1 handle 11: pfifo + tc -n $ns qdisc add dev $dev parent 1:2 handle 12: pfifo + + tc -n $ns filter add dev $dev parent 1: protocol ipv$ipver \ + flower $flower_expr classid 1:2 +} + +tc_get_flower_counter() { + local -r ns=$1 + local -r dev=$2 + + tc -n $ns -j -s qdisc show dev $dev handle 12: | jq .[0].packets +} + ret_set_ksft_status() { local ksft_status=$1; shift
Signature · 1 line
2.49.0.805.g082f7c87e0-goog
Re: [PATCH net-next v2 3/3] selftests/net: test tcp connection load balancing
Quoted 9 lines · Willem de Bruijn
From: Willem de Bruijn <[email protected]>
Verify that TCP connections use both routes when connecting multiple times to a remote service over a two nexthop multipath route.
Use socat to create the connections. Use tc prio + tc filter to count routes taken, counting SYN packets across the two egress devices. Also verify that the saddr matches that of the device.
Quoted 5 lines
To avoid flaky tests when testing inherently randomized behavior, set a low bar and pass if even a single SYN is observed on each device.
Signed-off-by Willem de Bruijn <[email protected]>
Quoted 8 lines
---
v1->v2
- match also on saddr, not only SYN
- move fromfib_nexthops.shtofib_tests.sh
- move generic "count packets on dev" tolib.sh
- switch from netcat to socat, as different netcats go around
Thanks!
This series was applied to netdev/net-next.git (main) by Paolo Abeni <[email protected]>:
Hello:
This series was applied to netdev/net-next.git (main) by Paolo Abeni <[email protected]>:
Quoted 9 lines · On Thu, 24 Apr 2025 10:35:17 -0400 you wrote:
From: Willem de Bruijn <[email protected]>
Improve layer 4 multipath hash policy for local tcp connections:
patch 1: Select a source address that matches the nexthop device.
Due totcp_v4_connectmaking separate route lookups for saddr and route, the two can currently be inconsistent.[...]
Here is the summary with links:
- [net-next,v2,1/3] ipv4: prefer multipath nexthop that matches source address
https://git.kernel.org/netdev/net-next/c/32607a332cfe - [net-next,v2,2/3] ip: load balance tcp connections to single dst addr and port https://git.kernel.org/netdev/net-next/c/65e9024643c7 - [net-next,v2,3/3] selftests/net: test tcp connection load balancing https://git.kernel.org/netdev/net-next/c/4d0dac499bf3
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html