Convert remaining Avocado tests to functional
Get series with b4
b4 am [email protected]Versions newest first · linked by author and title
- v2 Latest15 patches 1 replyIn review
- v115 patches 18 repliesSuperseded
Changes in v2 from the cover letter
- Use separate gitlab issue tickets for the flaky reverse-debugging tests
- Mark the aarch64 reverse debugging test as flaky, too
- Rename QEMU_CI_FUNCTIONAL_TESTING to QEMU_CI_FUNCTIONAL
Patches in v2 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/15 | gitlab-ci: Remove the avocado tests from the CI pipelines.gitlab-ci.d/ .gitlab-ci.d/ | +12 | 0 replies | |
| 2/15 | tests/functional: Move the check for the parameters from avocado to functionaltests/ tests/ | +5 | 0 replies | |
| 3/15 | tests/functional: Convert reverse_debugging tests to the functional frameworkMAINTAINERS tests/ tests/ +3 more | +139 | 1 reply | |
| 4/15 | tests/functional: Convert the i386 replay avocado testMAINTAINERS tests/ tests/ +1 more | +29 | 0 replies | |
| 5/15 | tests/avocado: Remove the LinuxKernelTest classtests/ | +0 | 0 replies | |
| 6/15 | tests/functional: Convert the 32-bit big endian Wheezy mips testtests/ tests/ tests/ | +107 | 0 replies | |
| 7/15 | tests/functional: Convert the 32-bit little endian Wheezy mips testtests/ tests/ tests/ | +23 | 0 replies | |
| 8/15 | tests/functional: Convert the 64-bit little endian Wheezy mips testtests/ tests/ tests/ | +23 | 0 replies | |
| 9/15 | tests/functional: Convert the 64-bit big endian Wheezy mips testMAINTAINERS tests/ tests/ +1 more | +37 | 0 replies | |
| 10/15 | tests/avocado: Remove the boot_linux.py teststests/ | +0 | 0 replies | |
| 11/15 | tests/functional: Use the tuxrun kernel for the x86 replay testtests/ tests/ | +33 | 0 replies | |
| 12/15 | tests/functional: Use the tuxrun kernel for the aarch64 replay testMAINTAINERS tests/ tests/ | +29 | 0 replies | |
| 13/15 | tests/functional: Convert the SMMU test to the functional frameworkMAINTAINERS tests/ tests/ +1 more | +208 | 0 replies | |
| 14/15 | gitlab-ci: Update QEMU_JOB_AVOCADO and QEMU_CI_AVOCADO_TESTING.gitlab-ci.d/ .gitlab-ci.d/ docs/ | +12 | 0 replies | |
| 15/15 | Remove the remainders of the Avocado testsMAINTAINERS configure docs/ +11 more | +16 | 0 replies |
Reviews trailers per patch
All 15 patches have a Reviewed-by or Acked-by.
| Patch | Daniel P. Berrangé | Eric Auger | Philippe Mathieu-Daudé |
|---|---|---|---|
| 1/15 | R-b | ||
| 2/15 | R-b | ||
| 3/15 | R-b | ||
| 4/15 | R-b | ||
| 5/15 | R-b | ||
| 6/15 | R-b | ||
| 7/15 | R-b | ||
| 8/15 | R-b | ||
| 9/15 | R-b | ||
| 10/15 | R-b | ||
| 11/15 | R-b | ||
| 12/15 | R-b | ||
| 13/15 | R-b T-b | ||
| 14/15 | R-b | ||
| 15/15 | R-b | R-b |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 3 reviewers.
Cover letter [PATCH v2 00/15] Convert remaining Avocado tests to functional
These patches convert the remaining Avocado tests bit by bit to the functional framework, or replace them with a test that has similar test coverage. This way we are finally able to get rid of the test/avocado folder in the end, everything is then integrated with the meson test runner. It should be possible now to run almost all tests in parallel by doing something like:
make -j$(nproc) check SPEED=thorough
v2:
- Use separate gitlab issue tickets for the flaky reverse-debugging tests
- Mark the aarch64 reverse debugging test as flaky, too
- Rename QEMU_CI_FUNCTIONAL_TESTING to QEMU_CI_FUNCTIONAL
Thomas Huth (15):
gitlab-ci: Remove the avocado tests from the CI pipelines tests/functional: Move the check for the parameters from avocado to
functional
tests/functional: Convert reverse_debugging tests to the functional
framework
tests/functional: Convert the i386 replay avocado test tests/avocado: Remove the LinuxKernelTest class tests/functional: Convert the 32-bit big endian Wheezy mips test tests/functional: Convert the 32-bit little endian Wheezy mips test tests/functional: Convert the 64-bit little endian Wheezy mips test tests/functional: Convert the 64-bit big endian Wheezy mips test tests/avocado: Remove the boot_linux.py tests tests/functional: Use the tuxrun kernel for the x86 replay test tests/functional: Use the tuxrun kernel for the aarch64 replay test tests/functional: Convert the SMMU test to the functional framework
gitlab-ci: Update QEMU_JOB_AVOCADO and QEMU_CI_AVOCADO_TESTING Remove the remainders of the Avocado tests
MAINTAINERS | 15 +-
docs/about/build-platforms.rst | 10 +-
docs/devel/build-system.rst | 11 +-
docs/devel/codebase.rst | 5 -
docs/devel/testing/avocado.rst | 581 ------------------
docs/devel/testing/ci-jobs.rst.inc | 19 +-
docs/devel/testing/functional.rst | 3 -
docs/devel/testing/index.rst | 1 -
docs/devel/testing/main.rst | 15 -
tests/avocado/README.rst | 10 -
configure | 2 +-
.gitlab-ci.d/base.yml | 8 +-
.gitlab-ci.d/buildtest-template.yml | 13 +-
.gitlab-ci.d/buildtest.yml | 33 +-
pythondeps.toml | 8 +-
tests/Makefile.include | 60 +-
tests/avocado/avocado_qemu/__init__.py | 424 -------------
tests/avocado/avocado_qemu/linuxtest.py | 253 --------
tests/avocado/boot_linux.py | 132 ----
tests/avocado/boot_linux_console.py | 96 ---
tests/avocado/linux_ssh_mips_malta.py | 205 ------
tests/avocado/replay_kernel.py | 110 ----
tests/avocado/replay_linux.py | 206 -------
tests/avocado/smmu.py | 139 -----
tests/functional/meson.build | 13 +-
tests/functional/qemu_test/tuxruntest.py | 9 +-
.../reverse_debugging.py | 114 +---
tests/functional/test_aarch64_replay.py | 37 +-
.../functional/test_aarch64_reverse_debug.py | 38 ++
tests/functional/test_aarch64_smmu.py | 205 ++++++
tests/functional/test_i386_replay.py | 28 +
tests/functional/test_mips64_malta.py | 35 ++
tests/functional/test_mips64el_malta.py | 22 +
tests/functional/test_mips_malta.py | 108 +++-
tests/functional/test_mipsel_malta.py | 22 +
tests/functional/test_ppc64_reverse_debug.py | 41 ++
tests/functional/test_x86_64_replay.py | 43 +-
tests/functional/test_x86_64_reverse_debug.py | 36 ++
38 files changed, 673 insertions(+), 2437 deletions(-)
delete mode 100644 docs/devel/testing/avocado.rst
delete mode 100644 tests/avocado/README.rst
delete mode 100644 tests/avocado/avocado_qemu/__init__.py
delete mode 100644 tests/avocado/avocado_qemu/linuxtest.py
delete mode 100644 tests/avocado/boot_linux.py
delete mode 100644 tests/avocado/boot_linux_console.py
delete mode 100644 tests/avocado/linux_ssh_mips_malta.py
delete mode 100644 tests/avocado/replay_kernel.py
delete mode 100644 tests/avocado/replay_linux.py
delete mode 100644 tests/avocado/smmu.py
rename tests/{avocado => functional}/reverse_debugging.py (66%)
create mode 100755 tests/functional/test_aarch64_reverse_debug.py
create mode 100755 tests/functional/test_aarch64_smmu.py
create mode 100755 tests/functional/test_i386_replay.py
create mode 100755 tests/functional/test_mips64_malta.py
create mode 100755 tests/functional/test_ppc64_reverse_debug.py
create mode 100755 tests/functional/test_x86_64_reverse_debug.pySignature · 1 line
2.49.0