Skip to contentSkip to conversation

statement: make secmark statements idempotent

RFC Applied Christian Göttsche 2 participants 9 messages Nov 20, 2019 – Nov 21, 2019 netfilter

lore
Share & tools
lore
#0 lore raw

RFC 1/4 statement: make secmark statements idempotent

Currently lines like

ct state new meta secmark set tcp dport map @secmapping_in

become

ct state new secmark name tcp dport map @secmapping_in

Fixes 3bc84e5c1fdd1ff011af9788fe174e0514c2c9ea
---
 src/statement.c | 3 +++
 1 file changed, 3 insertions(+)
src/statement.c +3 -0
index af84e06c..be35bcef 100644
@@ -233,6 +233,9 @@ static void objref_stmt_print(const struct stmt *stmt, struct output_ctx *octx)
 	case NFT_OBJECT_CT_EXPECT:
 		nft_print(octx, "ct expectation set ");
 		break;
+	case NFT_OBJECT_SECMARK:
+		nft_print(octx, "meta secmark set ");
+		break;
 	default:
 		nft_print(octx, "%s name ",
 			  objref_type_name(stmt->objref.type));
Signature · 1 line
2.24.0
#1 lore raw

RFC 2/4 src: add ability to set/get secmarks to/from connection

Labeling established and related packets requires the secmark to be stored in the connection. Add the ability to store and retrieve secmarks like:

...
chain input {
...

# label new incoming packets
ct state new meta secmark set tcp dport map @secmapping_in

# add label to connection
ct state new ct secmark set meta secmark

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

...
}
...
chain output {
...

# label new outgoing packets
ct state new meta secmark set tcp dport map @secmapping_out

# add label to connection
ct state new ct secmark set meta secmark

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

...
}
...

improves: 3bc84e5c1fdd1ff011af9788fe174e0514c2c9ea

---
 src/ct.c           |  2 ++
 src/evaluate.c     | 10 ++++++++++
 src/meta.c         |  2 ++
 src/parser_bison.y | 14 +++++++++++---
 4 files changed, 25 insertions(+), 3 deletions(-)
src/ct.c +2 -0
index ed458e6b..9e6a8351 100644
@@ -299,6 +299,8 @@ const struct ct_template ct_templates[__NFT_CT_MAX] = {
 					      BYTEORDER_BIG_ENDIAN, 128),
 	[NFT_CT_DST_IP6]	= CT_TEMPLATE("ip6 daddr", &ip6addr_type,
 					      BYTEORDER_BIG_ENDIAN, 128),
+	[NFT_CT_SECMARK]	= CT_TEMPLATE("secmark", &integer_type,
+					      BYTEORDER_HOST_ENDIAN, 32),
 };
 
 static void ct_print(enum nft_ct_keys key, int8_t dir, uint8_t nfproto,
src/evaluate.c +10 -0
index e54eaf1a..740d3c30 100644
@@ -1794,6 +1794,16 @@ static int expr_evaluate_relational(struct eval_ctx *ctx, struct expr **expr)
 		if (expr_is_singleton(right))
 			relational_expr_pctx_update(&ctx->pctx, rel);
 
+		/*
+		 * Statements like 'ct secmark 12 counter' are parsed as
+		 * relational expression with implicit operator.
+		 * Make them invalid.
+		 */
+		if ((left->etype == EXPR_META && left->meta.key == NFT_META_SECMARK)
+			|| (left->etype == EXPR_CT && left->ct.key == NFT_CT_SECMARK))
+			return expr_error(ctx->msgs, *expr,
+                                          "secmark is invalid with hardcoded ids");
+
 		/* fall through */
 	case OP_NEQ:
 		switch (right->etype) {
src/meta.c +2 -0
index 69a897a9..796d8e94 100644
@@ -698,6 +698,8 @@ const struct meta_template meta_templates[] = {
 	[NFT_META_TIME_HOUR]	= META_TEMPLATE("hour", &hour_type,
 						4 * BITS_PER_BYTE,
 						BYTEORDER_HOST_ENDIAN),
+	[NFT_META_SECMARK]	= META_TEMPLATE("secmark", &integer_type,
+						32, BYTEORDER_HOST_ENDIAN),
 };
 
 static bool meta_key_is_unqualified(enum nft_meta_keys key)
src/parser_bison.y +11 -3
index 631b7d68..707f4671 100644
@@ -4190,9 +4190,16 @@ meta_stmt		:	META	meta_key	SET	stmt_expr
 			{
 				switch ($2) {
 				case NFT_META_SECMARK:
-					$$ = objref_stmt_alloc(&@$);
-					$$->objref.type = NFT_OBJECT_SECMARK;
-					$$->objref.expr = $4;
+					switch ($4->etype) {
+					case EXPR_CT:
+						$$ = meta_stmt_alloc(&@$, $2, $4);
+						break;
+					default:
+						$$ = objref_stmt_alloc(&@$);
+						$$->objref.type = NFT_OBJECT_SECMARK;
+						$$->objref.expr = $4;
+						break;
+					}
 					break;
 				default:
 					$$ = meta_stmt_alloc(&@$, $2, $4);
@@ -4388,6 +4395,7 @@ ct_key			:	L3PROTOCOL	{ $$ = NFT_CT_L3PROTOCOL; }
 			|	PROTO_DST	{ $$ = NFT_CT_PROTO_DST; }
 			|	LABEL		{ $$ = NFT_CT_LABELS; }
 			|	EVENT		{ $$ = NFT_CT_EVENTMASK; }
+			|	SECMARK		{ $$ = NFT_CT_SECMARK; }
 			|	ct_key_dir_optional
 			;
 
Signature · 1 line
2.24.0
#2 lore raw

Re: [RFC 2/4] src: add ability to set/get secmarks to/from connection

Quoted 28 lines · Christian Göttsche

Labeling established and related packets requires the secmark to be stored in the connection. Add the ability to store and retrieve secmarks like:

...
chain input {
...

# label new incoming packets
ct state new meta secmark set tcp dport map @secmapping_in

# add label to connection
ct state new ct secmark set meta secmark

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

...
}
...
chain output {
...

# label new outgoing packets
ct state new meta secmark set tcp dport map @secmapping_out

# add label to connection
ct state new ct secmark set meta secmark

Quoted 6 lines

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

...
}
...

I have applied this with minor changes on the evaluation side. Just follow up with another patch in case you find any issue.

Thanks.

#3 lore raw

Re: [RFC 2/4] src: add ability to set/get secmarks to/from connection

Quoted 32 lines · Pablo Neira Ayuso
Quoted 31 lines · Christian Göttsche

Labeling established and related packets requires the secmark to be stored in the connection. Add the ability to store and retrieve secmarks like:

...
chain input {
...

# label new incoming packets
ct state new meta secmark set tcp dport map @secmapping_in

# add label to connection
ct state new ct secmark set meta secmark

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

...
}
...
chain output {
...

# label new outgoing packets
ct state new meta secmark set tcp dport map @secmapping_out

# add label to connection
ct state new ct secmark set meta secmark

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

Quoted 6 lines
Quoted 3 lines
        ...
        }
    ...

I have applied this with minor changes on the evaluation side. Just follow up with another patch in case you find any issue.

Actually, I'm keeping back 2/4. I'm attaching the update I made.

I think it's good to disallow this:

ct secmark 12
meta secmark 12

but you also have to check from the evaluation phase that ct and meta statements do not allow setting a constant value, ie.

ct secmark set 12
meta secmark set 12

From the objref statement evaluation step, you can check if this expression is a constant through flags.

Thanks.

commit 785049e16782f7afb658927e5fee3b1da761f97d

Author: Christian Göttsche <[email protected]>
Date:   Wed Nov 20 18:43:55 2019 +0100

src: add ability to set/get secmarks to/from connection

Labeling established and related packets requires the secmark to be stored in the connection. Add the ability to store and retrieve secmarks like:

...
chain input {
...

# label new incoming packets
ct state new meta secmark set tcp dport map @secmapping_in

# add label to connection
ct state new ct secmark set meta secmark

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

...
}
...
chain output {
...

# label new outgoing packets
ct state new meta secmark set tcp dport map @secmapping_out

# add label to connection
ct state new ct secmark set meta secmark

# set label for est/rel packets from connection ct state established,related meta secmark set ct secmark

...
}
...

This patch also disallow constant value on the right hand side.

# nft add rule x y meta secmark 12
Error: Cannot be used with right hand side constant value add rule x y meta secmark 12
~~~~~~~~~~~~ ^^
# nft add rule x y ct secmark 12
Error: Cannot be used with right hand side constant value add rule x y ct secmark 12
~~~~~~~~~~ ^^

This patch improves 3bc84e5c1fdd ("src: add support for setting secmark").

src/ct.c +2 -0
index ed458e6b679b..9e6a8351ffb2 100644
@@ -299,6 +299,8 @@ const struct ct_template ct_templates[__NFT_CT_MAX] = {
 					      BYTEORDER_BIG_ENDIAN, 128),
 	[NFT_CT_DST_IP6]	= CT_TEMPLATE("ip6 daddr", &ip6addr_type,
 					      BYTEORDER_BIG_ENDIAN, 128),
+	[NFT_CT_SECMARK]	= CT_TEMPLATE("secmark", &integer_type,
+					      BYTEORDER_HOST_ENDIAN, 32),
 };
 
 static void ct_print(enum nft_ct_keys key, int8_t dir, uint8_t nfproto,
src/evaluate.c +12 -0
index e54eaf1a7110..00f6c6a4cc3e 100644
@@ -1784,6 +1784,18 @@ static int expr_evaluate_relational(struct eval_ctx *ctx, struct expr **expr)
 					 left->dtype->desc,
 					 right->dtype->desc);
 
+	/*
+	 * Statements like 'ct secmark 12' are parsed as relational,
+	 * disallow constant value on the right hand side.
+	 */
+	if (((left->etype == EXPR_META &&
+	      left->meta.key == NFT_META_SECMARK) ||
+	     (left->etype == EXPR_CT &&
+	      left->ct.key == NFT_CT_SECMARK)) &&
+	    right->flags & EXPR_F_CONSTANT)
+		return expr_binary_error(ctx->msgs, right, left,
+                                         "Cannot be used with right hand side constant value");
+
 	switch (rel->op) {
 	case OP_EQ:
 	case OP_IMPLICIT:
src/meta.c +2 -0
index 69a897a92686..796d8e941486 100644
@@ -698,6 +698,8 @@ const struct meta_template meta_templates[] = {
 	[NFT_META_TIME_HOUR]	= META_TEMPLATE("hour", &hour_type,
 						4 * BITS_PER_BYTE,
 						BYTEORDER_HOST_ENDIAN),
+	[NFT_META_SECMARK]	= META_TEMPLATE("secmark", &integer_type,
+						32, BYTEORDER_HOST_ENDIAN),
 };
 
 static bool meta_key_is_unqualified(enum nft_meta_keys key)
src/parser_bison.y +11 -3
index 631b7d684555..707f46716ed3 100644
@@ -4190,9 +4190,16 @@ meta_stmt		:	META	meta_key	SET	stmt_expr
 			{
 				switch ($2) {
 				case NFT_META_SECMARK:
-					$$ = objref_stmt_alloc(&@$);
-					$$->objref.type = NFT_OBJECT_SECMARK;
-					$$->objref.expr = $4;
+					switch ($4->etype) {
+					case EXPR_CT:
+						$$ = meta_stmt_alloc(&@$, $2, $4);
+						break;
+					default:
+						$$ = objref_stmt_alloc(&@$);
+						$$->objref.type = NFT_OBJECT_SECMARK;
+						$$->objref.expr = $4;
+						break;
+					}
 					break;
 				default:
 					$$ = meta_stmt_alloc(&@$, $2, $4);
@@ -4388,6 +4395,7 @@ ct_key			:	L3PROTOCOL	{ $$ = NFT_CT_L3PROTOCOL; }
 			|	PROTO_DST	{ $$ = NFT_CT_PROTO_DST; }
 			|	LABEL		{ $$ = NFT_CT_LABELS; }
 			|	EVENT		{ $$ = NFT_CT_EVENTMASK; }
+			|	SECMARK		{ $$ = NFT_CT_SECMARK; }
 			|	ct_key_dir_optional
 			;
 
#4 lore raw

RFC 3/4 files: add example secmark config

In reply to Christian Göttsche
---
 files/examples/Makefile.am |  1 +
 files/examples/secmark.nft | 85 ++++++++++++++++++++++++++++++++++++++
 2 files changed, 86 insertions(+)
 create mode 100755 files/examples/secmark.nft
files/examples/Makefile.am +1 -0
index c40e041e..b29e9f61 100644
@@ -1,4 +1,5 @@
 pkgdocdir = ${docdir}/examples
 dist_pkgdoc_SCRIPTS = ct_helpers.nft \
 		load_balancing.nft \
+		secmark.nft \
 		sets_and_maps.nft
files/examples/secmark.nft new file +85 -0

85 lines not on this page · raw message

Signature · 1 line
2.24.0
#5 lore raw

Re: [RFC 3/4] files: add example secmark config

This patch does not apply here to current git HEAD for some reason.

Quoted 111 lines · Christian Göttsche
---
 files/examples/Makefile.am |  1 +
 files/examples/secmark.nft | 85 ++++++++++++++++++++++++++++++++++++++
 2 files changed, 86 insertions(+)
 create mode 100755 files/examples/secmark.nft
files/examples/Makefile.am +1 -0
index c40e041e..b29e9f61 100644
@@ -1,4 +1,5 @@
 pkgdocdir = ${docdir}/examples
 dist_pkgdoc_SCRIPTS = ct_helpers.nft \
 		load_balancing.nft \
+		secmark.nft \
 		sets_and_maps.nft
files/examples/secmark.nft new file +85 -0
new file mode 100755
index 00000000..0e010056
@@ -0,0 +1,85 @@
+#!/usr/sbin/nft -f
+
+# This example file shows how to use secmark labels with the nftables framework.
+# This script is meant to be loaded with `nft -f <file>`
+# You require linux kernel >= 4.20 and nft >= 0.9.3
+# For up-to-date information please visit https://wiki.nftables.org
+
+
+flush ruleset
+
+table inet filter {
+	secmark ssh_server {
+		"system_u:object_r:ssh_server_packet_t:s0"
+	}
+
+	secmark dns_client {
+		"system_u:object_r:dns_client_packet_t:s0"
+	}
+
+	secmark http_client {
+		"system_u:object_r:http_client_packet_t:s0"
+	}
+
+	secmark https_client {
+		"system_u:object_r:http_client_packet_t:s0"
+	}
+
+	secmark ntp_client {
+		"system_u:object_r:ntp_client_packet_t:s0"
+	}
+
+	secmark icmp_client {
+		"system_u:object_r:icmp_client_packet_t:s0"
+	}
+
+	secmark icmp_server {
+		"system_u:object_r:icmp_server_packet_t:s0"
+	}
+
+	secmark ssh_client {
+		"system_u:object_r:ssh_client_packet_t:s0"
+	}
+
+	secmark git_client {
+		"system_u:object_r:git_client_packet_t:s0"
+	}
+
+	map secmapping_in {
+		type inet_service : secmark
+		elements = { 22 : "ssh_server" }
+	}
+
+	map secmapping_out {
+		type inet_service : secmark
+		elements = { 22 : "ssh_client", 53 : "dns_client", 80 : "http_client", 123 : "ntp_client", 443 : "http_client", 9418 : "git_client" }
+	}
+
+	chain input {
+		type filter hook input priority 0;
+
+		# label new incoming packets and add to connection
+		ct state new meta secmark set tcp dport map @secmapping_in
+		ct state new meta secmark set udp dport map @secmapping_in
+		ct state new ip protocol icmp meta secmark set "icmp_server"
+		ct state new ip6 nexthdr icmpv6 meta secmark set "icmp_server"
+		ct state new ct secmark set meta secmark
+
+		# set label for est/rel packets from connection
+		ct state established,related meta secmark set ct secmark
+	}
+
+	chain output {
+		type filter hook output priority 0;
+
+		# label new outgoing packets and add to connection
+		ct state new meta secmark set tcp dport map @secmapping_out
+		ct state new meta secmark set udp dport map @secmapping_out
+		ct state new ip protocol icmp meta secmark set "icmp_client"
+		ct state new ip6 nexthdr icmpv6 meta secmark set "icmp_client"
+		ct state new ct secmark set meta secmark
+
+		# set label for est/rel packets from connection
+		ct state established,related meta secmark set ct secmark
+	}
+}
Signature · 1 line
2.24.0
#6 lore raw

RFC 4/4 src: add ability to reset secmarks

In reply to Christian Göttsche

Add the ability to reset secmark associations between the user-end string representation and the kernel intern secid. This allows a lightweight reset, without reloading the whole configuration and resetting all counters etc. .

*TODO*:
Pablo suggested to drop this change.
Are the actual objects in the kernel not destroyed and recreated? Or is this functionality useless?

---
 src/evaluate.c     |  2 ++
 src/parser_bison.y | 12 ++++++++++++
 src/rule.c         |  6 ++++++
 3 files changed, 20 insertions(+)
src/evaluate.c +2 -0
index 740d3c30..cebc33d3 100644
@@ -3982,8 +3982,10 @@ static int cmd_evaluate_reset(struct eval_ctx *ctx, struct cmd *cmd)
 	switch (cmd->obj) {
 	case CMD_OBJ_COUNTER:
 	case CMD_OBJ_QUOTA:
+	case CMD_OBJ_SECMARK:
 	case CMD_OBJ_COUNTERS:
 	case CMD_OBJ_QUOTAS:
+	case CMD_OBJ_SECMARKS:
 		if (cmd->handle.table.name == NULL)
 			return 0;
 		if (table_lookup(&cmd->handle, &ctx->nft->cache) == NULL)
src/parser_bison.y +12 -0
index 707f4671..eb767547 100644
@@ -1375,6 +1375,18 @@ reset_cmd		:	COUNTERS	ruleset_spec
 			{
 				$$ = cmd_alloc(CMD_RESET, CMD_OBJ_QUOTA, &$2, &@$, NULL);
 			}
+			|	SECMARKS	ruleset_spec
+			{
+				$$ = cmd_alloc(CMD_RESET, CMD_OBJ_SECMARKS, &$2, &@$, NULL);
+			}
+			|	SECMARKS	TABLE	table_spec
+			{
+				$$ = cmd_alloc(CMD_RESET, CMD_OBJ_SECMARKS, &$3, &@$, NULL);
+			}
+			|	SECMARK		obj_spec
+			{
+				$$ = cmd_alloc(CMD_RESET, CMD_OBJ_SECMARK, &$2, &@$, NULL);
+			}
 			;
 
 flush_cmd		:	TABLE		table_spec
src/rule.c +6 -0
index 4abc13c9..08b04827 100644
@@ -2539,6 +2539,12 @@ static int do_command_reset(struct netlink_ctx *ctx, struct cmd *cmd)
 	case CMD_OBJ_QUOTA:
 		type = NFT_OBJECT_QUOTA;
 		break;
+	case CMD_OBJ_SECMARKS:
+		dump = true;
+		/* fall through */
+	case CMD_OBJ_SECMARK:
+		type = NFT_OBJECT_SECMARK;
+		break;
 	default:
 		BUG("invalid command object type %u\n", cmd->obj);
 	}
Signature · 1 line
2.24.0
#7 lore raw

Re: [RFC 4/4] src: add ability to reset secmarks

Quoted 7 lines · Christian Göttsche

Add the ability to reset secmark associations between the user-end string representation and the kernel intern secid. This allows a lightweight reset, without reloading the whole configuration and resetting all counters etc. .

*TODO*:
Pablo suggested to drop this change.
Are the actual objects in the kernel not destroyed and recreated? Or is this functionality useless?

The reset command is useful for stateful objects that collect some internal state.

Basically, reset allows you to list the existing object state and reset it, eg. counters.

In this case, secmark is not a stateful object, unless I'm missing anything, I think we can skip this.

maintainer Applied
#8 lore raw
In reply to Christian Göttsche
Quoted 7 lines · Christian Göttsche

Currently lines like

ct state new meta secmark set tcp dport map @secmapping_in

become

ct state new secmark name tcp dport map @secmapping_in

Applied, thanks.