filter_tests filtering out testcases, but leaving empty testsuites in result list

http://bugs.dpdk.org/show_bug.cgi?id=1907

Bug ID: 1907
Summary: filter_tests filtering out testcases, but leaving
empty testsuites in result list
Product: DPDK
Version: 25.11
Hardware: All
OS: All
Status: UNCONFIRMED
Severity: minor
Priority: Normal
Component: DTS
Assignee: [email protected]
Reporter: [email protected]
CC: [email protected], [email protected]
Target Milestone: ---

When one comments out the test_suites field entirely in test_run.yaml (to default to running the complete set of testsuites in DTS) filter_tests() only does part of its job. It will filter out the testcases which are disallowed per the test_run.yaml config (i.e. remove crypto tests if crypto == False in the config). However, using the crypto example, it will remove all crypto testcases from the execution, but leave the testsuite in the list of testsuites to run. The result is an "empty" testsuite run.

Example (see cryptodev throughput):

blocklist: PASS
all_but_one_port_blocklisted: SKIP
reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
no_blocklisted: PASS
one_port_blocklisted: SKIP
reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
checksum_offload: PASS
insert_checksums: PASS
l3_rx_checksum: PASS
l4_rx_checksum: PASS
no_insert_checksums: PASS
validate_rx_checksum: PASS
validate_sctp_checksum: SKIP
reason: Required capability '{PORT_RX_OFFLOAD_SCTP_CKSUM}' not found.
vlan_checksum: SKIP
reason: Required capability '{PORT_RX_OFFLOAD_VLAN}' not found.
cryptodev_throughput: PASS
dual_vlan: PASS
all_vlan_functions: PASS
insert_second_vlan: SKIP
reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
maintains_priority: PASS

You are receiving this mail because:
You are the assignee for the bug.

http://bugs.dpdk.org/show_bug.cgi?id=1907

Patrick Robb ([email protected]) changed:

What |Removed |Added
----------------------------------------------------------------------------

         Resolution|---                         |FIXED
             Status|IN_PROGRESS                 |RESOLVED

--- Comment #2 from Patrick Robb ([email protected]) --- Merged to next-dts

You are receiving this mail because:
You are the assignee for the bug.