Skip to contentSkip to conversation

BPF CI update: veristat-scx job

DISCUSSION Ihor Solodrai 2 participants 3 messages Jun 9, 2025 BPF

lore
Share & tools
lore

Ihor Solodrai

author reviewer
#0 lore raw

Hi everyone.

In effort to improve testing of both BPF subsystem and sched-ext project [1], a new testing workflow has been added to BPF CI:
veristat-scx.

veristat-kernel and veristat-meta jobs have been running for a while now, and veristat-scx is basically adding more test cases using sched-ext BPF programs as input.

For those who aren't aware, veristat [2] is a command line tool that can be used to load BPF object files into the kernel and check verification results, among other things. It's source code is at ./tools/testing/selftests/bpf/veristat.c

On BPF CI, veristat-${target} job takes BPF object files (determined by ${target}) as input, and runs veristat on them against the kernel under testing. In addition to checking whether BPF program is accepted by the verifier, the CI job also collects verifier performance stats, and compares them to the baseline *failing* if a significant regression is detected.

See an example of successful job run here:
https://github.com/kernel-patches/bpf/actions/runs/15543439297/job/43761685117

[1] https://github.com/sched-ext/scx
[2] https://github.com/libbpf/veristat

#1 lore raw
Quoted 23 lines · Ihor Solodrai

Hi everyone.

In effort to improve testing of both BPF subsystem and sched-ext project [1], a new testing workflow has been added to BPF CI:
veristat-scx.

veristat-kernel and veristat-meta jobs have been running for a while now, and veristat-scx is basically adding more test cases using sched-ext BPF programs as input.

For those who aren't aware, veristat [2] is a command line tool that can be used to load BPF object files into the kernel and check verification results, among other things. It's source code is at ./tools/testing/selftests/bpf/veristat.c

On BPF CI, veristat-${target} job takes BPF object files (determined by ${target}) as input, and runs veristat on them against the kernel under testing. In addition to checking whether BPF program is accepted by the verifier, the CI job also collects verifier performance stats, and compares them to the baseline *failing* if a significant regression is detected.

Quoted 2 lines

See an example of successful job run here:
https://github.com/kernel-patches/bpf/actions/runs/15543439297/job/43761685117

Unsuccessful veristat runs are actually more interesting :) Do you have a link to some examples with veristat failures?

Quoted 4 lines

[1] https://github.com/sched-ext/scx
[2] https://github.com/libbpf/veristat

author reviewer
#2 lore raw
Quoted 9 lines · Andrii Nakryiko
Quoted 5 lines · Ihor Solodrai

[...]

See an example of successful job run here:
https://github.com/kernel-patches/bpf/actions/runs/15543439297/job/43761685117

Unsuccessful veristat runs are actually more interesting :) Do you have a link to some examples with veristat failures?

Here is a recent one (although it's not that interesting either):
https://github.com/kernel-patches/bpf/actions/runs/15496531493/job/43634843627

Quoted 5 lines
Quoted 5 lines

[1] https://github.com/sched-ext/scx
[2] https://github.com/libbpf/veristat