New benchmark for hashmap lookups
Subsystems (3)
v2 cover New benchmark for hashmap lookups
Add a new benchmark for hashmap lookups and fix several typos.
In commit 3 I've patched the bench utility so that now command line options can be reused by different benchmarks.
The benchmark itself is added in the last commit 7. I was using this benchmark to test map lookup productivity when using a different hash function [1]. When run with --quiet, the results can be easily plotted [2]. The results provided by the benchmark look reasonable and match the results of my different benchmarks (requiring to patch kernel to get actual statistics on map lookups).
Links:
[1] https://fosdem.org/2023/schedule/event/bpf_hashing/
[2] https://github.com/aspsk/bpf-bench/tree/master/hashmap-bench
Changes,v1->v2:
- percpu_times_index[] is of wrong size (Martin)
- use base 0 for strtol (Andrii)
- just use -q without argument (Andrii)
- use less hacks when parsing arguments (Andrii)
Anton Protopopov (7):
selftest/bpf/benchs: fix a typo in bpf_hashmap_full_update selftest/bpf/benchs: make a function static in bpf_hashmap_full_update selftest/bpf/benchs: enhance argp parsing selftest/bpf/benchs: remove an unused header selftest/bpf/benchs: make quiet option common selftest/bpf/benchs: print less if the quiet option is set selftest/bpf/benchs: Add benchmark for hashmap lookups
tools/testing/selftests/bpf/Makefile | 5 +- tools/testing/selftests/bpf/bench.c | 59 +++- tools/testing/selftests/bpf/bench.h | 2 + .../bpf/benchs/bench_bloom_filter_map.c | 5 + .../benchs/bench_bpf_hashmap_full_update.c | 5 +- .../bpf/benchs/bench_bpf_hashmap_lookup.c | 283 ++++++++++++++++++ .../selftests/bpf/benchs/bench_bpf_loop.c | 1 + .../bpf/benchs/bench_local_storage.c | 3 + .../bench_local_storage_rcu_tasks_trace.c | 16 +- .../selftests/bpf/benchs/bench_ringbufs.c | 4 + .../selftests/bpf/benchs/bench_strncmp.c | 2 + .../run_bench_bpf_hashmap_full_update.sh | 2 +- ...run_bench_local_storage_rcu_tasks_trace.sh | 2 +- .../selftests/bpf/progs/bpf_hashmap_lookup.c | 63 ++++ 14 files changed, 420 insertions(+), 32 deletions(-) create mode 100644 tools/testing/selftests/bpf/benchs/bench_bpf_hashmap_lookup.c create mode 100644 tools/testing/selftests/bpf/progs/bpf_hashmap_lookup.c
Signature · 1 line
2.34.1
PATCH v2 1/7 selftest/bpf/benchs: fix a typo in bpf_hashmap_full_update
To call the bpf_hashmap_full_update benchmark, one should say:
bench bpf-hashmap-ful-update
The patch adds a missing 'l' to the benchmark name.
--- .../selftests/bpf/benchs/bench_bpf_hashmap_full_update.c | 2 +- .../selftests/bpf/benchs/run_bench_bpf_hashmap_full_update.sh | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
tools/testing/selftests/bpf/benchs/bench_bpf_hashmap_full_update.c +1 -1
@@ -85,7 +85,7 @@ void hashmap_report_final(struct bench_res res[], int res_cnt) }const struct bench bench_bpf_hashmap_full_update = { - .name ="bpf-hashmap-ful-update" , + .name ="bpf-hashmap-full-update" , .validate = validate, .setup = setup, .producer_thread = producer,
tools/testing/selftests/bpf/benchs/run_bench_bpf_hashmap_full_update.sh +1 -1
@@ -6,6 +6,6 @@ source ./benchs/run_common.sh set -eufo pipefail nr_threads=`expr $(cat /proc/cpuinfo | grep "processor"| wc -l) - 1` -summary=$($RUN_BENCH -p $nr_threads bpf-hashmap-ful-update) +summary=$($RUN_BENCH -p $nr_threads bpf-hashmap-full-update) printf "$summary" printf "\n"
Signature · 1 line
2.34.1
PATCH v2 2/7 selftest/bpf/benchs: make a function static in bpf_hashmap_full_update
In reply to Anton ProtopopovThe hashmap_report_final callback function defined in the benchs/bench_bpf_hashmap_full_update.c file should be static.
--- .../selftests/bpf/benchs/bench_bpf_hashmap_full_update.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
tools/testing/selftests/bpf/benchs/bench_bpf_hashmap_full_update.c +1 -1
@@ -68,7 +68,7 @@ static void setup(void)bpf_map_update_elem (map_fd, &i, &i,BPF_ANY ); } -void hashmap_report_final (struct bench_res res[],int res_cnt) +static void hashmap_report_final (struct bench_res res[],int res_cnt) {unsigned int nr_cpus =bpf_num_possible_cpus ();int i;
Signature · 1 line
2.34.1
PATCH v2 3/7 selftest/bpf/benchs: enhance argp parsing
In reply to Anton ProtopopovTo parse command line the bench utility uses the argp_parse() function. This function takes as an argument a parent 'struct argp' structure which defines common command line options and an array of children 'struct argp' structures which defines additional command line options for particular benchmarks. This implementation doesn't allow benchmarks to share option names, e.g., if two benchmarks want to use, say, the --option option, then only one of them will succeed (the first one encountered in the array). This will be convenient if same option names could be used in different benchmarks (with the same semantics, e.g., --nr_loops=N).
Fix this by calling the argp_parse() function twice. The first call is the same as it was before, with all children argps, and helps to find the benchmark name and to print a combined help message if anything is wrong. Given the name, we can call the argp_parse the second time, but now the children array points only to a correct benchmark thus always calling the correct parsers. (If there's no a specific list of arguments, then only one call to argp_parse will be done.)
--- tools/testing/selftests/bpf/bench.c | 44 ++++++++++++++----- tools/testing/selftests/bpf/bench.h | 1 + .../bpf/benchs/bench_bloom_filter_map.c | 5 +++ .../selftests/bpf/benchs/bench_bpf_loop.c | 1 + .../bpf/benchs/bench_local_storage.c | 3 ++ .../bench_local_storage_rcu_tasks_trace.c | 1 + .../selftests/bpf/benchs/bench_ringbufs.c | 4 ++ .../selftests/bpf/benchs/bench_strncmp.c | 2 + 8 files changed, 51 insertions(+), 10 deletions(-)
tools/testing/selftests/bpf/bench.c +34 -10
@@ -287,10 +287,11 @@ static const struct argp_child bench_parsers[] = { {}, }; +/* Make pos_args global, so that we can run argp_parse twice, if necessary */ +static int pos_args; +static error_t parse_arg (int key,char *arg,struct argp_state *state) { -static int pos_args; -switch (key) {case 'v' : env.verbose = true;
@@ -359,7 +360,7 @@ static error_t parse_arg(int key, char *arg, struct argp_state *state)return 0 ; } -static void parse_cmdline_args (int argc,char **argv) +static void parse_cmdline_args_init (int argc,char **argv) {static const struct argp argp = { .options = opts,
@@ -369,9 +370,25 @@ static void parse_cmdline_args(int argc, char **argv) };if (argp_parse (&argp, argc, argv,0 ,NULL ,NULL ))exit (1 ); -if (!env.list && !env.bench_name) { -argp_help (&argp, stderr,ARGP_HELP_DOC ,"bench" ); -exit (1 ); +} + +static void parse_cmdline_args_final (int argc,char **argv) +{ +struct argp_child bench_parsers[2 ] = {}; +const struct argp argp = { + .options = opts, + .parser = parse_arg, + .doc = argp_program_doc, + .children = bench_parsers, + }; + +/* Parse arguments the second time with the correct set of parsers */ +if (bench->argp) { + bench_parsers[0 ].argp = bench->argp; + bench_parsers[0 ].header = bench->name; + pos_args =0 ; +if (argp_parse (&argp, argc, argv,0 ,NULL ,NULL )) +exit (1 ); } }
@@ -531,15 +548,14 @@ static const struct bench *benchs[] = { &bench_local_storage_tasks_trace, }; -static void setup_benchmark () +static void find_benchmark (void ) { -int i, err; +int i;if (!env.bench_name) {fprintf (stderr,"benchmark name is not specified\n" );exit (1 ); } -for (i =0 ; i <ARRAY_SIZE (benchs); i++) {if (strcmp (benchs[i]->name, env.bench_name) ==0 ) { bench = benchs[i];
@@ -550,6 +566,11 @@ static void setup_benchmark()fprintf (stderr,"benchmark '%s' not found\n" , env.bench_name);exit (1 ); } +} + +static void setup_benchmark (void ) +{ +int i, err;printf ("Setting up benchmark '%s'...\n" , bench->name);
@@ -621,7 +642,7 @@ static void collect_measurements(long delta_ns) {int main (int argc,char **argv) { -parse_cmdline_args (argc, argv); +parse_cmdline_args_init (argc, argv);if (env.list) {int i;
@@ -633,6 +654,9 @@ int main(int argc, char **argv)return 0 ; } +find_benchmark (); +parse_cmdline_args_final (argc, argv); +setup_benchmark ();setup_timer ();
tools/testing/selftests/bpf/bench.h +1 -0
@@ -47,6 +47,7 @@ struct bench_res {struct bench {const char *name; +const struct argp *argp;void (*validate)(void );void (*setup)(void );void *(*producer_thread)(void *ctx);
tools/testing/selftests/bpf/benchs/bench_bloom_filter_map.c +5 -0
@@ -428,6 +428,7 @@ static void *consumer(void *input)const struct bench bench_bloom_lookup = { .name ="bloom-lookup" , + .argp = &bench_bloom_map_argp, .validate = validate, .setup = bloom_lookup_setup, .producer_thread = producer,
@@ -439,6 +440,7 @@ const struct bench bench_bloom_lookup = {const struct bench bench_bloom_update = { .name ="bloom-update" , + .argp = &bench_bloom_map_argp, .validate = validate, .setup = bloom_update_setup, .producer_thread = producer,
@@ -450,6 +452,7 @@ const struct bench bench_bloom_update = {const struct bench bench_bloom_false_positive = { .name ="bloom-false-positive" , + .argp = &bench_bloom_map_argp, .validate = validate, .setup = false_positive_setup, .producer_thread = producer,
@@ -461,6 +464,7 @@ const struct bench bench_bloom_false_positive = {const struct bench bench_hashmap_without_bloom = { .name ="hashmap-without-bloom" , + .argp = &bench_bloom_map_argp, .validate = validate, .setup = hashmap_no_bloom_setup, .producer_thread = producer,
@@ -472,6 +476,7 @@ const struct bench bench_hashmap_without_bloom = {const struct bench bench_hashmap_with_bloom = { .name ="hashmap-with-bloom" , + .argp = &bench_bloom_map_argp, .validate = validate, .setup = hashmap_with_bloom_setup, .producer_thread = producer,
tools/testing/selftests/bpf/benchs/bench_bpf_loop.c +1 -0
@@ -95,6 +95,7 @@ static void setup(void)const struct bench bench_bpf_loop = { .name ="bpf-loop" , + .argp = &bench_bpf_loop_argp, .validate = validate, .setup = setup, .producer_thread = producer,
tools/testing/selftests/bpf/benchs/bench_local_storage.c +3 -0
@@ -255,6 +255,7 @@ static void *producer(void *input)*/ const struct bench bench_local_storage_cache_seq_get = { .name ="local-storage-cache-seq-get" , + .argp = &bench_local_storage_argp, .validate = validate, .setup = local_storage_cache_get_setup, .producer_thread = producer,
@@ -266,6 +267,7 @@ const struct bench bench_local_storage_cache_seq_get = {const struct bench bench_local_storage_cache_interleaved_get = { .name ="local-storage-cache-int-get" , + .argp = &bench_local_storage_argp, .validate = validate, .setup = local_storage_cache_get_interleaved_setup, .producer_thread = producer,
@@ -277,6 +279,7 @@ const struct bench bench_local_storage_cache_interleaved_get = {const struct bench bench_local_storage_cache_hashmap_control = { .name ="local-storage-cache-hashmap-control" , + .argp = &bench_local_storage_argp, .validate = validate, .setup = hashmap_setup, .producer_thread = producer,
tools/testing/selftests/bpf/benchs/bench_local_storage_rcu_tasks_trace.c +1 -0
@@ -271,6 +271,7 @@ static void report_final(struct bench_res res[], int res_cnt)*/ const struct bench bench_local_storage_tasks_trace = { .name ="local-storage-tasks-trace" , + .argp = &bench_local_storage_rcu_tasks_trace_argp, .validate = validate, .setup = local_storage_tasks_trace_setup, .producer_thread = producer,
tools/testing/selftests/bpf/benchs/bench_ringbufs.c +4 -0
@@ -518,6 +518,7 @@ static void *perfbuf_custom_consumer(void *input)const struct bench bench_rb_libbpf = { .name ="rb-libbpf" , + .argp = &bench_ringbufs_argp, .validate = bufs_validate, .setup = ringbuf_libbpf_setup, .producer_thread = bufs_sample_producer,
@@ -529,6 +530,7 @@ const struct bench bench_rb_libbpf = {const struct bench bench_rb_custom = { .name ="rb-custom" , + .argp = &bench_ringbufs_argp, .validate = bufs_validate, .setup = ringbuf_custom_setup, .producer_thread = bufs_sample_producer,
@@ -540,6 +542,7 @@ const struct bench bench_rb_custom = {const struct bench bench_pb_libbpf = { .name ="pb-libbpf" , + .argp = &bench_ringbufs_argp, .validate = bufs_validate, .setup = perfbuf_libbpf_setup, .producer_thread = bufs_sample_producer,
@@ -551,6 +554,7 @@ const struct bench bench_pb_libbpf = {const struct bench bench_pb_custom = { .name ="pb-custom" , + .argp = &bench_ringbufs_argp, .validate = bufs_validate, .setup = perfbuf_libbpf_setup, .producer_thread = bufs_sample_producer,
tools/testing/selftests/bpf/benchs/bench_strncmp.c +2 -0
@@ -140,6 +140,7 @@ static void strncmp_measure(struct bench_res *res)const struct bench bench_strncmp_no_helper = { .name ="strncmp-no-helper" , + .argp = &bench_strncmp_argp, .validate = strncmp_validate, .setup = strncmp_no_helper_setup, .producer_thread = strncmp_producer,
@@ -151,6 +152,7 @@ const struct bench bench_strncmp_no_helper = {const struct bench bench_strncmp_helper = { .name ="strncmp-helper" , + .argp = &bench_strncmp_argp, .validate = strncmp_validate, .setup = strncmp_helper_setup, .producer_thread = strncmp_producer,
Signature · 1 line
2.34.1
PATCH v2 4/7 selftest/bpf/benchs: remove an unused header
In reply to Anton ProtopopovThe benchs/bench_bpf_hashmap_full_update.c doesn't set a custom argp, so it shouldn't include the <argp.h> header.
--- .../testing/selftests/bpf/benchs/bench_bpf_hashmap_full_update.c | 1 - 1 file changed, 1 deletion(-)
tools/testing/selftests/bpf/benchs/bench_bpf_hashmap_full_update.c +0 -1
@@ -1,7 +1,6 @@// SPDX-License-Identifier: GPL-2.0 /* Copyright (c) 2022 Bytedance */ -#include <argp.h> #include "bench.h" #include "bpf_hashmap_full_update_bench.skel.h" #include "bpf_util.h"
Signature · 1 line
2.34.1
PATCH v2 5/7 selftest/bpf/benchs: make quiet option common
In reply to Anton ProtopopovThe "local-storage-tasks-trace" benchmark has a --quiet option. Move it to the list of common options, so that the main code and other benchmarks can use (new) env.quiet variable. Patch the run_bench_local_storage_rcu_tasks_trace.sh helper script accordingly.
--- tools/testing/selftests/bpf/bench.c | 5 +++++ tools/testing/selftests/bpf/bench.h | 1 + .../benchs/bench_local_storage_rcu_tasks_trace.c | 15 +-------------- .../run_bench_local_storage_rcu_tasks_trace.sh | 2 +- 4 files changed, 8 insertions(+), 15 deletions(-)
tools/testing/selftests/bpf/bench.c +5 -0
@@ -16,6 +16,7 @@ struct env env = { .warmup_sec = 1, .duration_sec = 5, .affinity = false, + .quiet = false, .consumer_cnt = 1, .producer_cnt = 1, };
@@ -262,6 +263,7 @@ static const struct argp_option opts[] = { { "consumers", 'c', "NUM", 0, "Number of consumer threads"}, { "verbose", 'v', NULL, 0, "Verbose debug output"}, { "affinity", 'a', NULL, 0, "Set consumer/producer thread affinity"}, + { "quiet", 'q', NULL, 0, "Be more quiet"}, { "prod-affinity", ARG_PROD_AFFINITY_SET, "CPUSET", 0, "Set of CPUs for producer threads; implies --affinity"}, { "cons-affinity", ARG_CONS_AFFINITY_SET, "CPUSET", 0,
@@ -330,6 +332,9 @@ static error_t parse_arg(int key, char *arg, struct argp_state *state)case 'a' : env.affinity = true;break ; +case 'q' : + env.quiet = true; +break ;case ARG_PROD_AFFINITY_SET : env.affinity = true; if (parse_num_list(arg, &env.prod_cpus.cpus,
tools/testing/selftests/bpf/bench.h +1 -0
@@ -24,6 +24,7 @@ struct env {bool verbose;bool list;bool affinity; +bool quiet;int consumer_cnt;int producer_cnt;struct cpu_set prod_cpus;
tools/testing/selftests/bpf/benchs/bench_local_storage_rcu_tasks_trace.c +1 -14
@@ -12,17 +12,14 @@static struct {__u32 nr_procs;__u32 kthread_pid; -bool quiet; } args = { .nr_procs =1000 , .kthread_pid =0 , - .quiet = false, };enum {ARG_NR_PROCS =7000 ,ARG_KTHREAD_PID =7001 , -ARG_QUIET =7002 , };static const struct argp_option opts[] = {
@@ -30,8 +27,6 @@ static const struct argp_option opts[] = { "Set number of user processes to spin up"}, {"kthread_pid" ,ARG_KTHREAD_PID ,"PID" ,0 , "Pid of rcu_tasks_trace kthread for ticks tracking"}, - { "quiet", ARG_QUIET, "{0,1}", 0, - "If true, don't report progress"}, {}, };
@@ -56,14 +51,6 @@ static error_t parse_arg(int key, char *arg, struct argp_state *state) } args.kthread_pid = ret;break ; -case ARG_QUIET : - ret =strtol (arg,NULL ,10 ); -if (ret <0 || ret >1 ) { -fprintf (stderr,"invalid quiet %ld\n" , ret); -argp_usage (state); - } - args.quiet = ret; -break ;break ;default :return ARGP_ERR_UNKNOWN ;
@@ -230,7 +217,7 @@ static void report_progress(int iter, struct bench_res *res, long delta_ns)exit (1 ); } -if (args.quiet) +if (env.quiet)return ; printf("Iter %d\t avg tasks_trace grace period latency\t%lf ns\n",
tools/testing/selftests/bpf/benchs/run_bench_local_storage_rcu_tasks_trace.sh +1 -1
@@ -8,4 +8,4 @@ if [ -z $kthread_pid ]; then exit 1 fi -./bench --nr_procs 15000 --kthread_pid $kthread_pid -d 600 --quiet 1 local-storage-tasks-trace +./bench --nr_procs 15000 --kthread_pid $kthread_pid -d 600 --quiet local-storage-tasks-trace
Signature · 1 line
2.34.1
PATCH v2 6/7 selftest/bpf/benchs: print less if the quiet option is set
In reply to Anton ProtopopovThe bench utility will print
Setting up benchmark '<bench-name>'...
Benchmark '<bench-name>' started.
on startup to stdout. Suppress this output if --quiet option if given. This makes it simpler to parse benchmark output by a script.
--- tools/testing/selftests/bpf/bench.c | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-)
tools/testing/selftests/bpf/bench.c +4 -2
@@ -577,7 +577,8 @@ static void setup_benchmark(void) {int i, err; -printf ("Setting up benchmark '%s'...\n" , bench->name); +if (!env.quiet) +printf ("Setting up benchmark '%s'...\n" , bench->name); state.producers =calloc (env.producer_cnt,sizeof (*state.producers)); state.consumers =calloc (env.consumer_cnt,sizeof (*state.consumers));
@@ -623,7 +624,8 @@ static void setup_benchmark(void) next_cpu(&env.prod_cpus)); } -printf ("Benchmark '%s' started.\n" , bench->name); +if (!env.quiet) +printf ("Benchmark '%s' started.\n" , bench->name); }static pthread_mutex_t bench_done_mtx =PTHREAD_MUTEX_INITIALIZER ;
Signature · 1 line
2.34.1
PATCH v2 7/7 selftest/bpf/benchs: Add benchmark for hashmap lookups
In reply to Anton ProtopopovAdd a new benchmark which measures hashmap lookup operations speed. A user can control the following parameters of the benchmark:
* key_size (max 1024): the key size to use
* max_entries: the hashmap max entries
* nr_entries: the number of entries to insert/lookup
* nr_loops: the number of loops for the benchmark
* map_flags The hashmap flags passed to BPF_MAP_CREATE
The BPF program performing the benchmarks calls two nested bpf_loop:
bpf_loop(nr_loops/nr_entries)
bpf_loop(nr_entries)
bpf_map_lookup()
So the nr_loops determines the number of actual map lookups. All lookups are successful.
Example (the output is generated on a AMD Ryzen 9 3950X machine):
for nr_entries in `seq 4096 4096 65536`; do echo -n "$((nr_entries*100/65536))% full: "; sudo ./bench -d2 -a bpf-hashmap-lookup --key_size=4 --nr_entries=$nr_entries --max_entries=65536 --nr_loops=1000000 --map_flags=0x40 | grep cpu; done
6% full: cpu01: lookup 50.739M ± 0.018M events/sec (approximated from 32 samples of ~19ms)
12% full: cpu01: lookup 47.751M ± 0.015M events/sec (approximated from 32 samples of ~20ms)
18% full: cpu01: lookup 45.153M ± 0.013M events/sec (approximated from 32 samples of ~22ms)
25% full: cpu01: lookup 43.826M ± 0.014M events/sec (approximated from 32 samples of ~22ms)
31% full: cpu01: lookup 41.971M ± 0.012M events/sec (approximated from 32 samples of ~23ms)
37% full: cpu01: lookup 41.034M ± 0.015M events/sec (approximated from 32 samples of ~24ms)
43% full: cpu01: lookup 39.946M ± 0.012M events/sec (approximated from 32 samples of ~25ms)
50% full: cpu01: lookup 38.256M ± 0.014M events/sec (approximated from 32 samples of ~26ms)
56% full: cpu01: lookup 36.580M ± 0.018M events/sec (approximated from 32 samples of ~27ms)
62% full: cpu01: lookup 36.252M ± 0.012M events/sec (approximated from 32 samples of ~27ms)
68% full: cpu01: lookup 35.200M ± 0.012M events/sec (approximated from 32 samples of ~28ms)
75% full: cpu01: lookup 34.061M ± 0.009M events/sec (approximated from 32 samples of ~29ms)
81% full: cpu01: lookup 34.374M ± 0.010M events/sec (approximated from 32 samples of ~29ms)
87% full: cpu01: lookup 33.244M ± 0.011M events/sec (approximated from 32 samples of ~30ms)
93% full: cpu01: lookup 32.182M ± 0.013M events/sec (approximated from 32 samples of ~31ms)
100% full: cpu01: lookup 31.497M ± 0.016M events/sec (approximated from 32 samples of ~31ms)--- tools/testing/selftests/bpf/Makefile | 5 +- tools/testing/selftests/bpf/bench.c | 4 + .../bpf/benchs/bench_bpf_hashmap_lookup.c | 283 ++++++++++++++++++ .../selftests/bpf/progs/bpf_hashmap_lookup.c | 63 ++++ 4 files changed, 354 insertions(+), 1 deletion(-) create mode 100644 tools/testing/selftests/bpf/benchs/bench_bpf_hashmap_lookup.c create mode 100644 tools/testing/selftests/bpf/progs/bpf_hashmap_lookup.c
tools/testing/selftests/bpf/Makefile +4 -1
@@ -618,6 +618,7 @@ $(OUTPUT)/bench_strncmp.o: $(OUTPUT)/strncmp_bench.skel.h $(OUTPUT)/bench_bpf_hashmap_full_update.o: $(OUTPUT)/bpf_hashmap_full_update_bench.skel.h $(OUTPUT)/bench_local_storage.o: $(OUTPUT)/local_storage_bench.skel.h $(OUTPUT)/bench_local_storage_rcu_tasks_trace.o: $(OUTPUT)/local_storage_rcu_tasks_trace_bench.skel.h +$(OUTPUT)/bench_bpf_hashmap_lookup.o: $(OUTPUT)/bpf_hashmap_lookup.skel.h $(OUTPUT)/bench.o: bench.h testing_helpers.h $(BPFOBJ) $(OUTPUT)/bench: LDLIBS += -lm $(OUTPUT)/bench: $(OUTPUT)/bench.o \
@@ -632,7 +633,9 @@ $(OUTPUT)/bench: $(OUTPUT)/bench.o \ $(OUTPUT)/bench_strncmp.o \ $(OUTPUT)/bench_bpf_hashmap_full_update.o \ $(OUTPUT)/bench_local_storage.o \ - $(OUTPUT)/bench_local_storage_rcu_tasks_trace.o + $(OUTPUT)/bench_local_storage_rcu_tasks_trace.o \ + $(OUTPUT)/bench_bpf_hashmap_lookup.o \ + # $(call msg,BINARY,,$@) $(Q)$(CC) $(CFLAGS) $(LDFLAGS) $(filter %.a %.o,$^) $(LDLIBS) -o $@
tools/testing/selftests/bpf/bench.c +4 -0
@@ -277,6 +277,7 @@ extern struct argp bench_bpf_loop_argp;extern struct argp bench_local_storage_argp;extern struct argp bench_local_storage_rcu_tasks_trace_argp;extern struct argp bench_strncmp_argp; +extern struct argp bench_hashmap_lookup_argp;static const struct argp_child bench_parsers[] = { { &bench_ringbufs_argp,0 ,"Ring buffers benchmark" ,0 },
@@ -286,6 +287,7 @@ static const struct argp_child bench_parsers[] = { { &bench_strncmp_argp, 0, "bpf_strncmp helper benchmark", 0 }, { &bench_local_storage_rcu_tasks_trace_argp, 0, "local_storage RCU Tasks Trace slowdown benchmark", 0 }, + { &bench_hashmap_lookup_argp, 0, "Hashmap lookup benchmark", 0 }, {}, };
@@ -512,6 +514,7 @@ extern const struct bench bench_local_storage_cache_seq_get;extern const struct bench bench_local_storage_cache_interleaved_get;extern const struct bench bench_local_storage_cache_hashmap_control;extern const struct bench bench_local_storage_tasks_trace; +extern const struct bench bench_bpf_hashmap_lookup;static const struct bench *benchs[] = { &bench_count_global,
@@ -551,6 +554,7 @@ static const struct bench *benchs[] = { &bench_local_storage_cache_interleaved_get, &bench_local_storage_cache_hashmap_control, &bench_local_storage_tasks_trace, + &bench_bpf_hashmap_lookup, };static void find_benchmark (void )
tools/testing/selftests/bpf/benchs/bench_bpf_hashmap_lookup.c new file +283 -0
283 lines not on this page · raw message
tools/testing/selftests/bpf/progs/bpf_hashmap_lookup.c new file +63 -0
63 lines not on this page · raw message
Signature · 1 line
2.34.1
This series was applied to bpf/bpf-next.git (master) by Andrii Nakryiko <[email protected]>:
Hello:
This series was applied to bpf/bpf-next.git (master) by Andrii Nakryiko <[email protected]>:
Quoted 5 lines · On Mon, 13 Feb 2023 09:15:12 +0000 you wrote:
Add a new benchmark for hashmap lookups and fix several typos.
In commit 3 I've patched the bench utility so that now command line options can be reused by different benchmarks.
Quoted 7 lines
The benchmark itself is added in the last commit 7. I was using this benchmark to test map lookup productivity when using a different hash function [1]. When run with --quiet, the results can be easily plotted [2]. The results provided by the benchmark look reasonable and match the results of my different benchmarks (requiring to patch kernel to get actual statistics on map lookups).
[...]
Here is the summary with links:
- [bpf-next,v2,1/7] selftest/bpf/benchs: fix a typo in bpf_hashmap_full_update
https://git.kernel.org/bpf/bpf-next/c/4db98ab445c5 - [bpf-next,v2,2/7] selftest/bpf/benchs: make a function static in bpf_hashmap_full_update https://git.kernel.org/bpf/bpf-next/c/2f1c59637fb1 - [bpf-next,v2,3/7] selftest/bpf/benchs: enhance argp parsing https://git.kernel.org/bpf/bpf-next/c/22ff7aeaa9e3 - [bpf-next,v2,4/7] selftest/bpf/benchs: remove an unused header https://git.kernel.org/bpf/bpf-next/c/9644546260ea - [bpf-next,v2,5/7] selftest/bpf/benchs: make quiet option common https://git.kernel.org/bpf/bpf-next/c/90c22503cd89 - [bpf-next,v2,6/7] selftest/bpf/benchs: print less if the quiet option is set https://git.kernel.org/bpf/bpf-next/c/a237dda05e91 - [bpf-next,v2,7/7] selftest/bpf/benchs: Add benchmark for hashmap lookups https://git.kernel.org/bpf/bpf-next/c/f371f2dc53d1
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html