Enable automerge feature for anonymous sets
Phil Sutter
reviewerPATCH 1/1 Enable automerge feature for anonymous sets
Automatic merging of adjacent/overlapping ranges upon insertion has clear benefits performance- and readability-wise. The drawbacks which led to disabling it by default don't apply to anonymous sets since they are read-only anyway, so enable this feature for them again.
--- src/evaluate.c | 1 + 1 file changed, 1 insertion(+)
src/evaluate.c +1 -0
@@ -87,6 +87,7 @@ static struct expr *implicit_set_declaration(struct eval_ctx *ctx, set->handle.set =xstrdup (name); set->key = key; set->init = expr; + set->automerge = set->flags &NFT_SET_INTERVAL ;if (ctx->table !=NULL )list_add_tail (&set->list, &ctx->table->sets);
Signature · 1 line
2.15.1
Pablo Neira Ayuso
maintainerHi Phil,
Quoted 4 lines · Phil Sutter
Automatic merging of adjacent/overlapping ranges upon insertion has clear benefits performance- and readability-wise. The drawbacks which led to disabling it by default don't apply to anonymous sets since they are read-only anyway, so enable this feature for them again.
Question is, why someone would be adding elements with overlapping ranges in an anonymous set? Then, when listing the ruleset you will get something different to what you've added. This would also be inconsistent with regards to the existing behaviour in named sets, where this is turned off by default.
For named sets, that are useful to maintain white/blacklists, I understand this simplifies complexity for people dealing with them. But not sure for anonymous sets.
@Jeff: Is this also useful to you in the anonymous set use-case? IIRC we agreed that this was good for named sets, but not for anonymous sets.
Thanks.
Quoted 12 lines · Pablo Neira Ayuso
Quoted 4 lines · Phil Sutter
Automatic merging of adjacent/overlapping ranges upon insertion has clear benefits performance- and readability-wise. The drawbacks which led to disabling it by default don't apply to anonymous sets since they are read-only anyway, so enable this feature for them again.
Question is, why someone would be adding elements with overlapping ranges in an anonymous set? Then, when listing the ruleset you will get something different to what you've added. This would also be inconsistent with regards to the existing behaviour in named sets, where this is turned off by default.
Quoted 6 lines
For named sets, that are useful to maintain white/blacklists, I understand this simplifies complexity for people dealing with them. But not sure for anonymous sets.
@Jeff: Is this also useful to you in the anonymous set use-case? IIRC we agreed that this was good for named sets, but not for anonymous sets.
In my opinion the consistent behaviour is the most desired one. Such subleties that by default there's no automerge in named sets but it's on for anonymous sets are easily overlooked by users. Better have a flag, option to turn it on explicitly for a given anonymous set.
Best regards,
Jozsef
-
E-mail : [email protected], [email protected] PGP key : http://www.kfki.hu/~kadlec/pgp_public_key.txt
Address : Wigner Research Centre for Physics, Hungarian Academy of Sciences
H-1525 Budapest 114, POB. 49, Hungary
Phil Sutter
reviewerHi Pablo,
Quoted 11 lines · Pablo Neira Ayuso
Quoted 4 lines · Phil Sutter
Automatic merging of adjacent/overlapping ranges upon insertion has clear benefits performance- and readability-wise. The drawbacks which led to disabling it by default don't apply to anonymous sets since they are read-only anyway, so enable this feature for them again.
Question is, why someone would be adding elements with overlapping ranges in an anonymous set? Then, when listing the ruleset you will get something different to what you've added. This would also be inconsistent with regards to the existing behaviour in named sets, where this is turned off by default.
Recapping the pros and cons of automatic merging the discussion brought up (I probably miss some):
+ Overlaps may be hard to spot (and avoid) if they sit in different defines used to fill a single set.
- Items added to a set can't be removed again if they were merged with others added at the same time.
Quoted 1 line
From those, I assume that if one uses defines to manage e.g. white/black
lists, a named set is probably not used either. The con above applies only to named sets since anonymous ones can't be changed. Therefore I considered automatic merging happening in anonymous sets to be desirable.
Quoted 3 lines
For named sets, that are useful to maintain white/blacklists, I understand this simplifies complexity for people dealing with them. But not sure for anonymous sets.
I'm not entirely sure about that since there are multiple ways to see things. AFAIR, Jeff's point was when he combines set elements from different sources he doesn't want to check them manually for potential overlaps (or even can't). So there automatic merging is a good thing. If my fail2ban script can't delete a range previously added after it timeouts, it fails and recovery is not trivial (find the merged element and divide it again). Here, merging is a bad thing. Overall though, I wonder whether using interval sets for white/black lists isn't a bad idea at all. :)
Quoted 3 lines
@Jeff: Is this also useful to you in the anonymous set use-case? IIRC we agreed that this was good for named sets, but not for anonymous sets.
I'm curious to hearing his thoughts as well.
Cheers, Phil
Quoted 4 lines · Phil Sutter
Automatic merging of adjacent/overlapping ranges upon insertion has clear benefits performance- and readability-wise. The drawbacks which led to disabling it by default don't apply to anonymous sets since they are read-only anyway, so enable this feature for them again.
Applied, thanks Phil.