Netfilter/IPVS fixes for net
Subsystems (5)
Pablo Neira Ayuso
maintainercover Netfilter/IPVS fixes for net
Hi,
The following patchset contains Netfilter/IPVS fixes for net:
1) Call nf_expect_get_id() to delete expectation by ID. By trial and error it is possible to leak the LSB of the expectation address on x86_64. This bug is a leftover when converting the existing code to use nf_expect_get_id().
2) Incorrect initialization in pipapo set backend leads to packet mismatches. From Florian Westphal.
3) Extend netfilter's selftests to cover for the pipapo set backend, also from Florian.
4) Fix sparse warning in IPVS when adding service, from Chen Hanxiao.
Please, pull these changes from:
git://git.kernel.org/pub/scm/linux/kernel/git/netfilter/nf.git nf-24-07-17
Thanks.
----------------------------------------------------------------
The following changes since commit 0e03c643dc9389e61fa484562dae58c8d6e96d63:
eth: fbnic: fix s390 build. (2024-07-17 06:25:14 -0700)
are available in the Git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/netfilter/nf.git tags/nf-24-07-17
for you to fetch changes up to cbd070a4ae62f119058973f6d2c984e325bce6e7:
ipvs: properly dereference pe in ip_vs_add_service (2024-07-17 23:38:17 +0200)
----------------------------------------------------------------
netfilter pull request 24-07-17
----------------------------------------------------------------
Chen Hanxiao (1):
ipvs: properly dereference pe in ip_vs_add_service
Florian Westphal (2):
netfilter: nf_set_pipapo: fix initial map fill
selftests: netfilter: add test case for recent mismatch bug
Pablo Neira Ayuso (1):
netfilter: ctnetlink: use helper function to calculate expect ID
net/netfilter/ipvs/ip_vs_ctl.c | 10 +-- net/netfilter/nf_conntrack_netlink.c | 3 +- net/netfilter/nft_set_pipapo.c | 4 +- net/netfilter/nft_set_pipapo.h | 21 ++++++ net/netfilter/nft_set_pipapo_avx2.c | 10 +-- .../selftests/net/netfilter/nft_concat_range.sh | 76 +++++++++++++++++++++- 6 files changed, 111 insertions(+), 13 deletions(-)
Pablo Neira Ayuso
maintainerPATCH 1/4 netfilter: ctnetlink: use helper function to calculate expect ID
Delete expectation path is missing a call to the nf_expect_get_id() helper function to calculate the expectation ID, otherwise LSB of the expectation object address is leaked to userspace.
--- net/netfilter/nf_conntrack_netlink.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
net/netfilter/nf_conntrack_netlink.c +2 -1
@@ -3420,7 +3420,8 @@ static int ctnetlink_del_expect(struct sk_buff *skb,if (cda[CTA_EXPECT_ID ]) {__be32 id =nla_get_be32 (cda[CTA_EXPECT_ID ]); -if (ntohl (id) != (u32 )(unsigned long )exp) { + +if (id !=nf_expect_get_id (exp)) {nf_ct_expect_put (exp);return -ENOENT ; }
Signature · 1 line
2.30.2
Re: [PATCH net 1/4] netfilter: ctnetlink: use helper function to calculate expect ID
This series was applied to netdev/net.git (main) by Pablo Neira Ayuso <[email protected]>:
Hello:
This series was applied to netdev/net.git (main)
by Pablo Neira Ayuso <[email protected]>:
Quoted 9 lines · On Wed, 17 Jul 2024 23:52:11 +0200 you wrote:
Delete expectation path is missing a call to the
nf_expect_get_id()helper function to calculate the expectation ID, otherwise LSB of the expectation object address is leaked to userspace.Fixes 3c79107631db ("netfilter: ctnetlink: don't use conntrack/expect object addresses as id")Reported-by [email protected]Signed-off-by Pablo Neira Ayuso <[email protected]>[...]
Here is the summary with links:
- [net,1/4] netfilter: ctnetlink: use helper function to calculate expect ID
https://git.kernel.org/netdev/net/c/782161895eb4 - [net,2/4] netfilter: nf_set_pipapo: fix initial map fill https://git.kernel.org/netdev/net/c/791a615b7ad2 - [net,3/4] selftests: netfilter: add test case for recent mismatch bug https://git.kernel.org/netdev/net/c/0935ee6032df - [net,4/4] ipvs: properly dereference pe in ip_vs_add_service https://git.kernel.org/netdev/net/c/cbd070a4ae62
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html
Pablo Neira Ayuso
maintainerPATCH 2/4 netfilter: nf_set_pipapo: fix initial map fill
In reply to Pablo Neira AyusoFrom: Florian Westphal <[email protected]>
The initial buffer has to be inited to all-ones, but it must restrict it to the size of the first field, not the total field size.
After each round in the map search step, the result and the fill map are swapped, so if we have a set where f->bsize of the first element is smaller than m->bsize_max, those one-bits are leaked into future rounds result map.
This makes pipapo find an incorrect matching results for sets where first field size is not the largest.
Followup patch adds a test case to nft_concat_range.sh selftest script.
Thanks to Stefano Brivio for pointing out that we need to zero out the remainder explicitly, only correcting memset() argument isn't enough.
--- net/netfilter/nft_set_pipapo.c | 4 ++-- net/netfilter/nft_set_pipapo.h | 21 +++++++++++++++++++++ net/netfilter/nft_set_pipapo_avx2.c | 10 ++++++---- 3 files changed, 29 insertions(+), 6 deletions(-)
net/netfilter/nft_set_pipapo.c +2 -2
@@ -434,7 +434,7 @@ bool nft_pipapo_lookup(const struct net *net, const struct nft_set *set, res_map = scratch->map + (map_index ? m->bsize_max :0 ); fill_map = scratch->map + (map_index ?0 : m->bsize_max); -memset (res_map,0xff , m->bsize_max *sizeof (*res_map)); +pipapo_resmap_init (m, res_map);nft_pipapo_for_each_field (f, i, m) {bool last = i == m->field_count -1 ;
@@ -542,7 +542,7 @@ static struct nft_pipapo_elem *pipapo_get(const struct net *net, goto out; } -memset (res_map,0xff , m->bsize_max *sizeof (*res_map)); +pipapo_resmap_init (m, res_map);nft_pipapo_for_each_field (f, i, m) {bool last = i == m->field_count -1 ;
net/netfilter/nft_set_pipapo.h +21 -0
@@ -278,4 +278,25 @@ static u64 pipapo_estimate_size(const struct nft_set_desc *desc) return size; } +/** +* pipapo_resmap_init() - Initialise result map before first use +* @m: Matching data, including mapping table +* @res_map: Result map +* +* Initialize all bits covered by the first field to one, so that after +* the first step, only the matching bits of the first bit group remain. +* +* If other fields have a large bitmap, set remainder of res_map to 0. +*/ +static inline void pipapo_resmap_init (const struct nft_pipapo_match *m,unsigned long *res_map) +{ +const struct nft_pipapo_field *f = m->f; +int i; + +for (i =0 ; i < f->bsize; i++) + res_map[i] =ULONG_MAX ; + +for (i = f->bsize; i < m->bsize_max; i++) + res_map[i] =0ul ; +}#endif /* _NFT_SET_PIPAPO_H */
net/netfilter/nft_set_pipapo_avx2.c +6 -4
@@ -1036,6 +1036,7 @@ static int nft_pipapo_avx2_lookup_8b_16(unsigned long *map, unsigned long *fill,/** * nft_pipapo_avx2_lookup_slow() - Fallback function for uncommon field sizes +* @mdata: Matching data, including mapping table * @map: Previous match result, used as initial bitmap * @fill: Destination bitmap to be filled with current match result * @f: Field, containing lookup and mapping tables
@@ -1051,7 +1052,8 @@ static int nft_pipapo_avx2_lookup_8b_16(unsigned long *map, unsigned long *fill,* Return: -1 on no match, rule index of match if @last, otherwise first long * word index to be checked next (i.e. first filled word). */ -static int nft_pipapo_avx2_lookup_slow (unsigned long *map,unsigned long *fill, +static int nft_pipapo_avx2_lookup_slow (const struct nft_pipapo_match *mdata, +unsigned long *map,unsigned long *fill,const struct nft_pipapo_field *f,int offset,const u8 *pkt,bool first,bool last)
@@ -1060,7 +1062,7 @@ static int nft_pipapo_avx2_lookup_slow(unsigned long *map, unsigned long *fill,int i, ret =-1 , b;if (first) -memset (map,0xff , bsize *sizeof (*map)); +pipapo_resmap_init (mdata, map);for (i = offset; i < bsize; i++) {if (f->bb ==8 )
@@ -1186,7 +1188,7 @@ bool nft_pipapo_avx2_lookup(const struct net *net, const struct nft_set *set, }else if (f->groups ==16 ) {NFT_SET_PIPAPO_AVX2_LOOKUP (8 ,16 ); }else { - ret =nft_pipapo_avx2_lookup_slow (res, fill, f, + ret =nft_pipapo_avx2_lookup_slow (m, res, fill, f, ret, rp, first, last); }
@@ -1202,7 +1204,7 @@ bool nft_pipapo_avx2_lookup(const struct net *net, const struct nft_set *set, }else if (f->groups ==32 ) {NFT_SET_PIPAPO_AVX2_LOOKUP (4 ,32 ); }else { - ret =nft_pipapo_avx2_lookup_slow (res, fill, f, + ret =nft_pipapo_avx2_lookup_slow (m, res, fill, f, ret, rp, first, last); }
Signature · 1 line
2.30.2
Pablo Neira Ayuso
maintainerPATCH 3/4 selftests: netfilter: add test case for recent mismatch bug
In reply to Pablo Neira AyusoFrom: Florian Westphal <[email protected]>
Without 'netfilter: nf_set_pipapo: fix initial map fill' this fails:
TEST: reported issues
Add two elements, flush, re-add 1s [ OK ]
net,mac with reload 1s [ OK ]
net,port,proto 1s [FAIL]
post-add: should have returned 10.5.8.0/24 . 51-60 . 6-17 but got table inet filter {
set test {
type ipv4_addr . inet_service . inet_proto
flags interval,timeout
elements = { 10.5.7.0/24 . 51-60 . 6-17 }
}
}The other sets defined in the selftest do not trigger this bug, it only occurs if the first field group bitsize is smaller than the largest group bitsize.
For each added element, check 'get' works and actually returns the requested range.
After map has been filled, check all added ranges can still be retrieved.
For each deleted element, check that 'get' fails.
Based on a reproducer script from Yi Chen.
--- .../net/netfilter/nft_concat_range.sh | 76 ++++++++++++++++++- 1 file changed, 75 insertions(+), 1 deletion(-)
tools/testing/selftests/net/netfilter/nft_concat_range.sh +75 -1
@@ -27,7 +27,7 @@ TYPES="net_port port_net net6_port port_proto net6_port_mac net6_port_mac_proto net6_port_net6_port net_port_mac_proto_net" # Reported bugs, also described by TYPE_ variables below -BUGS="flush_remove_add reload" +BUGS="flush_remove_add reload net_port_proto_match" # List of possible paths to pktgen script from kernel tree for performance tests PKTGEN_SCRIPT_PATHS="
@@ -371,6 +371,22 @@ race_repeat 0 perf_duration 0 " +TYPE_net_port_proto_match=" +display net,port,proto +type_spec ipv4_addr . inet_service . inet_proto +chain_spec ip daddr . udp dport . meta l4proto +dst addr4 port proto +src +start 1 +count 9 +src_delta 9 +tools sendip bash +proto udp + +race_repeat 0 + +perf_duration 0 +" # Set template for all tests, types and rules are filled in depending on test set_template=' flush ruleset
@@ -1555,6 +1571,64 @@ test_bug_reload() { nft flush ruleset } +# - add ranged element, check that packets match it +# - delete element again, check it is gone +test_bug_net_port_proto_match() { + setup veth send_"${proto}" set || return ${ksft_skip} + rstart=${start} + + range_size=1 + for i in $(seq 1 10); do + for j in $(seq 1 20) ; do + elem=$(printf "10.%d.%d.0/24 . %d1-%d0 . 6-17 " ${i} ${j} ${i} "$((i+1))") + + nft "add element inet filter test { $elem }" || return 1 + nft "get element inet filter test { $elem }" | grep -q "$elem" + if [ $? -ne 0 ];then + local got=$(nft "get element inet filter test { $elem }") + err "post-add: should have returned $elem but got $got" + return 1 + fi + done + done + + # recheck after set was filled + for i in $(seq 1 10); do + for j in $(seq 1 20) ; do + elem=$(printf "10.%d.%d.0/24 . %d1-%d0 . 6-17 " ${i} ${j} ${i} "$((i+1))") + + nft "get element inet filter test { $elem }" | grep -q "$elem" + if [ $? -ne 0 ];then + local got=$(nft "get element inet filter test { $elem }") + err "post-fill: should have returned $elem but got $got" + return 1 + fi + done + done + + # random del and re-fetch + for i in $(seq 1 10); do + for j in $(seq 1 20) ; do + local rnd=$((RANDOM%10)) + local got="" + + elem=$(printf "10.%d.%d.0/24 . %d1-%d0 . 6-17 " ${i} ${j} ${i} "$((i+1))") + if [ $rnd -gt 0 ];then + continue + fi + + nft "delete element inet filter test { $elem }" + got=$(nft "get element inet filter test { $elem }" 2>/dev/null) + if [ $? -eq 0 ];then + err "post-delete: query for $elem returned $got instead of error." + return 1 + fi + done + done + + nft flush ruleset +} + test_reported_issues() { eval test_bug_"${subtest}" }
Signature · 1 line
2.30.2
Pablo Neira Ayuso
maintainerPATCH 4/4 ipvs: properly dereference pe in ip_vs_add_service
In reply to Pablo Neira AyusoFrom: Chen Hanxiao <[email protected]>
Use pe directly to resolve sparse warning:
net/netfilter/ipvs/ip_vs_ctl.c:1471:27: warning: dereference of noderef expression
--- net/netfilter/ipvs/ip_vs_ctl.c | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-)
net/netfilter/ipvs/ip_vs_ctl.c +5 -5
@@ -1459,18 +1459,18 @@ ip_vs_add_service(struct netns_ipvs *ipvs, struct ip_vs_service_user_kern *u,if (ret <0 ) goto out_err; -/* Bind the ct retriever */ -RCU_INIT_POINTER (svc->pe, pe); - pe =NULL ; -/* Update the virtual service counters */ if (svc->port ==FTPPORT )atomic_inc (&ipvs->ftpsvc_counter);else if (svc->port ==0 )atomic_inc (&ipvs->nullsvc_counter); -if (svc->pe && svc->pe->conn_out) +if (pe && pe->conn_out)atomic_inc (&ipvs->conn_out_counter); +/* Bind the ct retriever */ +RCU_INIT_POINTER (svc->pe, pe); + pe =NULL ; +/* Count only IPv4 services for old get/setsockopt interface */ if (svc->af ==AF_INET ) ipvs->num_services++;
Signature · 1 line
2.30.2