Skip to content

tests: Automated regression testing

Ana Rey netfilter-devel 3 versions – In review

Get series with b4
b4 am [email protected]

Versions newest first · linked by author and title

  1. v3 Latest7 patches 1 replyIn review
  2. v26 patches 2 repliesSuperseded
  3. v16 patches 0 repliesSuperseded

Patches in v3 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/7tests: Add automated regression testingtests/regression/nft-test.py+859 -00 replies
2/7tests: Add ip folder with test filestests/regression/ip/chains.t tests/regression/ip/icmp.t tests/regression/ip/ip.t +3 more+276 -00 replies
3/7tests: Add ip6 folder with test files.tests/regression/ip6/chains.t tests/regression/ip6/dst.t tests/regression/ip6/hbh.t +8 more+487 -00 replies
4/7tests: Add inet folder with test files.tests/regression/inet/ah.t tests/regression/inet/comp.t tests/regression/inet/dccp.t +5 more+380 -00 replies
5/7tests: Add arp folder with test files.tests/regression/arp/arp.t tests/regression/arp/chains.t+58 -00 replies
6/7tests: Add bridge folder with test files.tests/regression/bridge/chains.t+7 -00 replies
7/7tests: Add any folder with test files.tests/regression/any/ct.t tests/regression/any/frag.t tests/regression/any/limit.t +3 more+383 -00 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v3 yet.

Read the v3 thread

Cover letter [v3 nft 0/7] tests: Automated regression testing

This is a new version of the automated regression testing of nftables.

There is no infrastructure to allow us to check all options/features in nft. So, if anyone sends a patch, we cannot check if it breaks something.

I send in this patchset the nftables automated regression tests. It contains a python script (nft-add.py) and a set of test files.

This allow us to check the input of rules of nft-tool from the command-line and the output from nft-tool of this rule. Then, it compares if the rule input matches the rule output automatically.

We also have plans to add automated regression testing in the packet path in the future, which should come in a follow up step.

Comments welcome, thanks

[Changes in v3]
* I fix signal handlers when press ctrl + c repeatedly.
* I add the output_clean function. This function improves the parser of rules is shown by nft.

Ana Rey (7):
tests: Add automated regression testing
tests: Add ip folder with test files
tests: Add ip6 folder with test files.
tests: Add inet folder with test files.
tests: Add arp folder with test files.
tests: Add bridge folder with test files.
tests: Add any folder with test files.

 tests/regression/any/ct.t        |  105 +++++
 tests/regression/any/frag.t      |   64 +++
 tests/regression/any/limit.t     |   12 +
 tests/regression/any/log.t       |   27 ++
 tests/regression/any/meta.t      |  160 +++++++
 tests/regression/any/queue.t     |   15 +
 tests/regression/arp/arp.t       |   53 +++
 tests/regression/arp/chains.t    |    5 +
 tests/regression/bridge/chains.t |    7 +
 tests/regression/inet/ah.t       |   58 +++
 tests/regression/inet/comp.t     |   31 ++
 tests/regression/inet/dccp.t     |   32 ++
 tests/regression/inet/esp.t      |   23 +
 tests/regression/inet/sctp.t     |   42 ++
 tests/regression/inet/tcp.t      |  103 +++++
 tests/regression/inet/udp.t      |   49 +++
 tests/regression/inet/udplite.t  |   42 ++
 tests/regression/ip/chains.t     |   22 +
 tests/regression/ip/icmp.t       |   93 +++++
 tests/regression/ip/ip.t         |  107 +++++
 tests/regression/ip/nat.t        |   18 +
 tests/regression/ip/reject.t     |    5 +
 tests/regression/ip/sets.t       |   31 ++
 tests/regression/ip6/chains.t    |   18 +
 tests/regression/ip6/dst.t       |   25 ++
 tests/regression/ip6/hbh.t       |   25 ++
 tests/regression/ip6/icmpv6.t    |   96 +++++
 tests/regression/ip6/ip6.t       |  142 +++++++
 tests/regression/ip6/mh.t        |   49 +++
 tests/regression/ip6/nat.t       |    6 +
 tests/regression/ip6/reject.t    |    5 +
 tests/regression/ip6/rt.t        |   45 ++
 tests/regression/ip6/sets.t      |   22 +
 tests/regression/ip6/vmap.t      |   54 +++
 tests/regression/nft-test.py     |  859 ++++++++++++++++++++++++++++++++++++++
 35 files changed, 2450 insertions(+)
 create mode 100644 tests/regression/any/ct.t
 create mode 100644 tests/regression/any/frag.t
 create mode 100644 tests/regression/any/limit.t
 create mode 100644 tests/regression/any/log.t
 create mode 100644 tests/regression/any/meta.t
 create mode 100644 tests/regression/any/queue.t
 create mode 100644 tests/regression/arp/arp.t
 create mode 100644 tests/regression/arp/chains.t
 create mode 100644 tests/regression/bridge/chains.t
 create mode 100644 tests/regression/inet/ah.t
 create mode 100644 tests/regression/inet/comp.t
 create mode 100644 tests/regression/inet/dccp.t
 create mode 100644 tests/regression/inet/esp.t
 create mode 100644 tests/regression/inet/sctp.t
 create mode 100644 tests/regression/inet/tcp.t
 create mode 100644 tests/regression/inet/udp.t
 create mode 100644 tests/regression/inet/udplite.t
 create mode 100644 tests/regression/ip/chains.t
 create mode 100644 tests/regression/ip/icmp.t
 create mode 100644 tests/regression/ip/ip.t
 create mode 100644 tests/regression/ip/nat.t
 create mode 100644 tests/regression/ip/reject.t
 create mode 100644 tests/regression/ip/sets.t
 create mode 100644 tests/regression/ip6/chains.t
 create mode 100644 tests/regression/ip6/dst.t
 create mode 100644 tests/regression/ip6/hbh.t
 create mode 100644 tests/regression/ip6/icmpv6.t
 create mode 100644 tests/regression/ip6/ip6.t
 create mode 100644 tests/regression/ip6/mh.t
 create mode 100644 tests/regression/ip6/nat.t
 create mode 100644 tests/regression/ip6/reject.t
 create mode 100644 tests/regression/ip6/rt.t
 create mode 100644 tests/regression/ip6/sets.t
 create mode 100644 tests/regression/ip6/vmap.t
 create mode 100755 tests/regression/nft-test.py
Signature · 1 line
1.7.10.4