Skip to content

GSoC 2020 - TCG Continuous Benchmarking scripts and tools

Ahmed Karaman qemu-devel 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest9 patches 15 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/9scripts/performance: Refactor topN_perf.pyscripts/performance/topN_perf.py+87 -878 replies
2/9scripts/performance: Refactor topN_callgrind.pyscripts/performance/topN_callgrind.py+87 -821 reply
3/9scripts/performance: Refactor dissect.pyscripts/performance/dissect.py+68 -551 reply
4/9scripts/performance: Add list_fn_callees.py scriptscripts/performance/list_fn_callees.py+245 -00 replies
5/9scripts/performance: Add list_helpers.py scriptscripts/performance/list_helpers.py+221 -00 replies
6/9scripts/performance: Add bisect.py scriptscripts/performance/bisect.py+425 -00 replies
7/9tests/performance: Add nightly teststests/performance/nightly-tests/README.md tests/performance/nightly-tests/benchmarks/source/dijkstra_double/dijkstra_double.c tests/performance/nightly-tests/benchmarks/source/dijkstra_int32/dijkstra_int32.c +9 more+2423 -05 replies
8/9MAINTAINERS: Add 'tests/performance' to 'Performance Tools and Tests' subsectionMAINTAINERS+1 -01 reply
9/9scripts/performance: Add topN_system.py scriptscripts/performance/topN_system.py+158 -00 replies

Reviews trailers per patch

5 of 9 patches have a Reviewed-by or Acked-by.

PatchAleksandar Markovic
1/9R-b
2/9R-b
3/9R-b
4/9
5/9
6/9
7/9R-b
8/9R-b
9/9

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.

Read the v1 thread

Cover letter [PATCH 0/9] GSoC 2020 - TCG Continuous Benchmarking scripts and tools

Greetings,

This series includes all of the scripts, tools, and benchmarks developed in the TCG Continuous Benchmarking GSoC project for 2020.

The series includes one patch for updating the MAINTAINERS file and eight patches each with a separate script or tool.

All scripts and tools were thoroughly introduced, explained, and utilized in the project weekly reports which were posted here on the list each Monday at 12:30PM for the last three months.

Reports:
Report 1 - Measuring Basic Performance Metrics of QEMU:
https://www.mail-archive.com/[email protected]/msg714853.html
Introduced tools:
topN_perf.py and topN_callgrind.py

Report 2 - Dissecting QEMU Into Three Main Parts:
https://www.mail-archive.com/[email protected]/msg717592.html
Introduced tools:
dissect.py

Report 3 - QEMU 5.0 and 5.1-pre-soft-freeze Dissect Comparison:
https://www.mail-archive.com/[email protected]/msg720321.html

Report 4 - Listing QEMU Helpers and Function Callees:
https://www.mail-archive.com/[email protected]/msg722559.html
Introduced tools:
list_fn_callees.py and list_helpers.py

Report 5 - Finding Commits Affecting QEMU Performance:
https://www.mail-archive.com/[email protected]/msg724080.html
Introduced tools:
bisect.py

Report 6 - Performance Comparison of Two QEMU Builds:
https://www.mail-archive.com/[email protected]/msg725700.html

Report 7 - Measuring QEMU Emulation Efficiency:
https://www.mail-archive.com/[email protected]/msg727147.html

Report 8 - QEMU Nightly Performance Tests:
https://www.mail-archive.com/[email protected]/msg730444.html
Introduced tools:
nightly-tests/

Report 9 - Measuring QEMU Performance in System Mode:
https://www.mail-archive.com/[email protected]/msg732729.html
Introduced tools:
topN_system.py

Report 10 - Measuring QEMU Performance in System Mode - Part Two:
https://www.mail-archive.com/[email protected]/msg734485.html

Best regards,
Ahmed Karaman

Ahmed Karaman (9):
scripts/performance: Refactor topN_perf.py scripts/performance: Refactor topN_callgrind.py scripts/performance: Refactor dissect.py scripts/performance: Add list_fn_callees.py script scripts/performance: Add list_helpers.py script scripts/performance: Add bisect.py script tests/performance: Add nightly tests
MAINTAINERS: Add 'tests/performance' to 'Performance Tools and Tests'
subsection
scripts/performance: Add topN_system.py script

 MAINTAINERS                                   |  32 +-
 scripts/performance/bisect.py                 | 425 ++++++++
 scripts/performance/dissect.py                | 123 +--
 scripts/performance/list_fn_callees.py        | 245 +++++
 scripts/performance/list_helpers.py           | 221 +++++
 scripts/performance/topN_callgrind.py         | 169 ++--
 scripts/performance/topN_perf.py              | 174 ++--
 scripts/performance/topN_system.py            | 158 +++
 tests/performance/nightly-tests/README.md     | 243 +++++
 .../source/dijkstra_double/dijkstra_double.c  | 194 ++++
 .../source/dijkstra_int32/dijkstra_int32.c    | 192 ++++
 .../source/matmult_double/matmult_double.c    | 123 +++
 .../source/matmult_int32/matmult_int32.c      | 121 +++
 .../source/qsort_double/qsort_double.c        | 104 ++
 .../source/qsort_int32/qsort_int32.c          | 103 ++
 .../source/qsort_string/qsort_string.c        | 122 +++
 .../source/search_string/search_string.c      | 110 +++
 .../scripts/nightly_tests_core.py             | 920 ++++++++++++++++++
 .../scripts/run_nightly_tests.py              | 135 +++
 .../nightly-tests/scripts/send_email.py       |  56 ++
 20 files changed, 3744 insertions(+), 226 deletions(-)
 create mode 100755 scripts/performance/bisect.py
 create mode 100755 scripts/performance/list_fn_callees.py
 create mode 100755 scripts/performance/list_helpers.py
 create mode 100755 scripts/performance/topN_system.py
 create mode 100644 tests/performance/nightly-tests/README.md
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/dijkstra_double/dijkstra_double.c
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/dijkstra_int32/dijkstra_int32.c
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/matmult_double/matmult_double.c
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/matmult_int32/matmult_int32.c
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/qsort_double/qsort_double.c
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/qsort_int32/qsort_int32.c
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/qsort_string/qsort_string.c
 create mode 100644 tests/performance/nightly-tests/benchmarks/source/search_string/search_string.c
 create mode 100755 tests/performance/nightly-tests/scripts/nightly_tests_core.py
 create mode 100755 tests/performance/nightly-tests/scripts/run_nightly_tests.py
 create mode 100644 tests/performance/nightly-tests/scripts/send_email.py
Signature · 1 line
2.17.1