Skip to content

rteval: Add MCP server for result analysis

John Kacur linux-rt-users 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest23 patches 3 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/23rteval: Add prototype MCP server for result analysismcp-server/DEPENDENCIES.md mcp-server/README.md mcp-server/server.py+321 -00 replies
2/23rteval: Implement compare_results functionality in MCP servermcp-server/server.py+194 -60 replies
3/23rteval: Add log file access tools to MCP servermcp-server/server.py+157 -00 replies
4/23rteval: mcp-server: Add Claude Code plugin configurationmcp-server/.claude-plugin/plugin.json mcp-server/README.md mcp-server/manifest.json+75 -20 replies
5/23rteval: Add .mcp.json for project-level MCP server configuration.mcp.json+11 -00 replies
6/23rteval: mcp-server: Add rtla command line parser.mcp.json mcp-server/server.py+139 -33 replies
7/23rteval: mcp-server: Add batch analysis toolmcp-server/server.py+174 -00 replies
8/23rteval: mcp-server: Add query and filter capabilitiesmcp-server/README.md mcp-server/server.py+530 -10 replies
9/23rteval MCP: Add histogram extraction and percentile analysismcp-server/README.md mcp-server/server.py mcp-server/test_histogram.py+372 -00 replies
10/23rteval MCP: Reorganize tests into tests/ subdirectorymcp-server/tests/test_histogram.py mcp-server/tests/test_new_tools.py+145 -30 replies
11/23rteval MCP: Fix test_new_tools.py to find rteval result filesmcp-server/tests/test_new_tools.py+2 -20 replies
12/23rteval MCP: Fix glob patterns to find rteval result filesmcp-server/server.py+8 -80 replies
13/23rteval MCP: Add integration tests and remove hardcoded examplesmcp-server/tests/test_mcp_integration.py+195 -00 replies
14/23rteval MCP: Add per-CPU latency statistics breakdownmcp-server/README.md mcp-server/server.py mcp-server/tests/test_mcp_integration.py +1 more+348 -20 replies
15/23mcp-server: Add overflow bucket support and cyclictest compatibilitymcp-server/server.py+42 -130 replies
16/23mcp-server: Make tests generic and add Makefile integrationMakefile mcp-server/tests/test_histogram.py mcp-server/tests/test_per_cpu_stats.py+29 -70 replies
17/23mcp-server: Add load information extraction and filteringmcp-server/README.md mcp-server/server.py+416 -30 replies
18/23mcp-server: Rename server from rteval to rteval-mcp.mcp.json mcp-server/.claude-plugin/plugin.json mcp-server/README.md +1 more+6 -70 replies
19/23mcp-server: Add GPL-2.0-or-later license headers to all filesmcp-server/DEPENDENCIES.md mcp-server/README.md mcp-server/server.py +4 more+54 -00 replies
20/23mcp-server: Add Makefile for running testsmcp-server/Makefile mcp-server/README.md+70 -20 replies
21/23mcp-server: Add demo guide with example queriesmcp-server/DEMO.md+462 -00 replies
22/23mcp-server: Restructure as Python package with dynamic pathsrteval_mcp/.claude-plugin/plugin.json rteval_mcp/DEMO.md rteval_mcp/DEPENDENCIES.md +11 more+82 -190 replies
23/23mcp-server: Use relative path in .mcp.json and add example for installation.mcp.json mcp.json.example+12 -40 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCH 00/23] rteval: Add MCP server for result analysis

This patch series adds an MCP (Model Context Protocol) server for querying and analyzing rteval test results. The server enables AI assistants and other MCP clients to programmatically access rteval data for multi-run analysis, regression detection, and performance trend analysis.

The MCP server provides tools to:
- List and parse rteval XML result files
- Compare multiple test runs side-by-side
- Filter results by kernel version, date range, and latency thresholds
- Extract histogram data and calculate latency percentiles
- Analyze per-CPU latency statistics to identify problematic cores
- Access log files with grep/head/tail filtering
- Compare results against baselines and detect regressions

Target users:
- System administrators running rteval for real-time kernel validation
- QE engineers performing performance regression testing
- CI/CD pipelines requiring automated rteval result analysis
- Developers analyzing system behavior under load

Key features:
- Standards-based MCP protocol implementation
- Comprehensive test suite with integration tests
- Support for both cyclictest and timerlat histogram formats
- Handles overflow buckets and varying histogram sizes
- GPL-2.0-or-later licensed

Dependencies:
- python3-mcp (Fedora package available)
- python3-lxml (standard XML parsing)

Testing:
All tests pass via 'make test' in rteval_mcp/ directory. The server has been tested with Claude Code as an MCP client.

Installation:
The server can be run from git checkout (./rteval_mcp/rteval-mcp-server) or installed system-wide. An example MCP configuration file is provided in mcp.json.example for packagers.

John Kacur (23):
rteval: Add prototype MCP server for result analysis
rteval: Implement compare_results functionality in MCP server
rteval: Add log file access tools to MCP server
rteval: mcp-server: Add Claude Code plugin configuration
rteval: Add .mcp.json for project-level MCP server configuration
rteval: mcp-server: Add rtla command line parser
rteval: mcp-server: Add batch analysis tool
rteval: mcp-server: Add query and filter capabilities rteval MCP: Add histogram extraction and percentile analysis rteval MCP: Reorganize tests into tests/ subdirectory rteval MCP: Fix test_new_tools.py to find rteval result files rteval MCP: Fix glob patterns to find rteval result files rteval MCP: Add integration tests and remove hardcoded examples rteval MCP: Add per-CPU latency statistics breakdown
mcp-server: Add overflow bucket support and cyclictest compatibility
mcp-server: Make tests generic and add Makefile integration
mcp-server: Add load information extraction and filtering
mcp-server: Rename server from rteval to rteval-mcp
mcp-server: Add GPL-2.0-or-later license headers to all files
mcp-server: Add Makefile for running tests
mcp-server: Add demo guide with example queries
mcp-server: Restructure as Python package with dynamic paths
mcp-server: Use relative path in .mcp.json and add example for
installation

 .mcp.json                                |    7 +
 Makefile                                 |   10 +-
 mcp.json.example                         |   11 +
 rteval_mcp/.claude-plugin/plugin.json    |   18 +
 rteval_mcp/DEMO.md                       |  462 +++++
 rteval_mcp/DEPENDENCIES.md               |   33 +
 rteval_mcp/Makefile                      |   51 +
 rteval_mcp/README.md                     |  490 ++++++
 rteval_mcp/__init__.py                   |   13 +
 rteval_mcp/__main__.py                   |   33 +
 rteval_mcp/manifest.json                 |   18 +
 rteval_mcp/rteval-mcp-server             |   21 +
 rteval_mcp/rteval_server.py              | 2019 ++++++++++++++++++++++
 rteval_mcp/tests/test_histogram.py       |   82 +
 rteval_mcp/tests/test_mcp_integration.py |  220 +++
 rteval_mcp/tests/test_new_tools.py       |  142 ++
 rteval_mcp/tests/test_per_cpu_stats.py   |  134 ++
 17 files changed, 3763 insertions(+), 1 deletion(-)
 create mode 100644 .mcp.json
 create mode 100644 mcp.json.example
 create mode 100644 rteval_mcp/.claude-plugin/plugin.json
 create mode 100644 rteval_mcp/DEMO.md
 create mode 100644 rteval_mcp/DEPENDENCIES.md
 create mode 100644 rteval_mcp/Makefile
 create mode 100644 rteval_mcp/README.md
 create mode 100644 rteval_mcp/__init__.py
 create mode 100644 rteval_mcp/__main__.py
 create mode 100644 rteval_mcp/manifest.json
 create mode 100755 rteval_mcp/rteval-mcp-server
 create mode 100755 rteval_mcp/rteval_server.py
 create mode 100644 rteval_mcp/tests/test_histogram.py
 create mode 100644 rteval_mcp/tests/test_mcp_integration.py
 create mode 100644 rteval_mcp/tests/test_new_tools.py
 create mode 100644 rteval_mcp/tests/test_per_cpu_stats.py
Signature · 1 line
2.55.0