perf test pmu-events case
cover perf test pmu-events case
This series introduces a basic perf test pmu-events test case.
The test works by verifying correctly created aliases for the HW PMUs in the host system.
The aliases come from a set of invented test events, which are (mostly) arch agnostic (even though I copied these aliases from pre-existing x86 and arm64 JSONs).
In the test, core and uncore events are treated slightly differently. For core test events, all events are matched. However, for uncore test events, these have "Unit" property, so can only be matched when the corresponding HW PMU exists in the host sytem.
A test run looks like this on my x86 dev box:
kernel-dev$ tools/perf/perf test -vv 10
Couldn't bump rlimit(MEMLOCK), failures may take place when creating BPF maps, etc
10: PMU event aliases :
--- start ---
test child forked, pid 30869
Using CPUID GenuineIntel-6-9E-9intel_pt default config: tsc,mtc,mtc_period=3,psb_period=3,pt,branch skipping testing PMU software
testing PMU power: skip
testing PMU cpu: matched event segment_reg_loads.any
testing PMU cpu: matched event dispatch_blocked.any
testing PMU cpu: matched event eist_trans
testing PMU cpu: matched event bp_l1_btb_correct
testing PMU cpu: matched event bp_l2_btb_correct
testing PMU cpu: pass
testing PMU cstate_core: skip
testing PMU uncore_cbox_2: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_2: pass
skipping testing PMU breakpoint
testing PMU uncore_cbox_0: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_0: pass
skipping testing PMU tracepoint
testing PMU cstate_pkg: skip
testing PMU uncore_arb: skip
testing PMU msr: skip
testing PMU uncore_cbox_3: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_3: pass
testing PMU intel_pt: skip
testing PMU uncore_cbox_1: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_1: pass
test child finished with 0
---- end ----
PMU event aliases: Ok
Comments welcome.
John Garry (6):
perf jevents: Fix leak of mapfile memory
perf jevents: Support test events folder
perf jevents: Add some test events
perf pmu: Refactor pmu_add_cpu_aliases()
perf pmu: Add is_pmu_core()
perf test: Add pmu-events test
.../pmu-events/arch/test/test_cpu/branch.json | 12 ++ .../pmu-events/arch/test/test_cpu/other.json | 26 +++ .../pmu-events/arch/test/test_cpu/uncore.json | 21 ++ tools/perf/pmu-events/jevents.c | 59 +++++- tools/perf/pmu-events/pmu-events.h | 4 + tools/perf/tests/Build | 1 + tools/perf/tests/builtin-test.c | 4 + tools/perf/tests/pmu-events.c | 192 ++++++++++++++++++ tools/perf/tests/tests.h | 1 + tools/perf/util/pmu.c | 26 ++- tools/perf/util/pmu.h | 4 + 11 files changed, 336 insertions(+), 14 deletions(-) create mode 100644 tools/perf/pmu-events/arch/test/test_cpu/branch.json create mode 100644 tools/perf/pmu-events/arch/test/test_cpu/other.json create mode 100644 tools/perf/pmu-events/arch/test/test_cpu/uncore.json create mode 100644 tools/perf/tests/pmu-events.c
Signature · 1 line
2.17.1
PATCH 1/6 perf jevents: Fix leak of mapfile memory
The memory for global pointer is never freed during normal program execution, so let's do that in the main function exit as a good programming practice.
A stray blank line is also removed.
--- tools/perf/pmu-events/jevents.c | 15 +++++++++------ 1 file changed, 9 insertions(+), 6 deletions(-)
tools/perf/pmu-events/jevents.c +9 -6
@@ -1082,10 +1082,9 @@ static int process_one_file(const char *fpath, const struct stat *sb,*/ int main (int argc,char *argv[]) { -int rc; +int rc, ret =0 ;int maxfds;char ldirname[PATH_MAX ]; -const char *arch;const char *output_file;const char *start_dirname;
@@ -1156,7 +1155,8 @@ int main(int argc, char *argv[])/* Make build fail */ fclose (eventsfp);free_arch_std_events (); -return 1 ; + ret =1 ; + goto out_free_mapfile; }else if (rc) { goto empty_map; }
@@ -1174,14 +1174,17 @@ int main(int argc, char *argv[])/* Make build fail */ fclose (eventsfp);free_arch_std_events (); -return 1 ; + ret =1 ; } -return 0 ; + + goto out_free_mapfile; empty_map:fclose (eventsfp);create_empty_mapping (output_file);free_arch_std_events (); -return 0 ; +out_free_mapfile: +free (mapfile); +return ret; }
Signature · 1 line
2.17.1
Arnaldo Carvalho de Melo
AppliedRe: [PATCH 1/6] perf jevents: Fix leak of mapfile memory
Em Thu, Mar 05, 2020 at 07:08:01PM +0800, John Garry escreveu:
Quoted 5 lines
The memory for global pointer is never freed during normal program execution, so let's do that in the main function exit as a good programming practice.
A stray blank line is also removed.
Thanks, applied to perf/urgent.
- Arnaldo
Quoted 56 lines
Reported-by Jiri Olsa <[email protected]>Signed-off-by John Garry <[email protected]>--- tools/perf/pmu-events/jevents.c | 15 +++++++++------ 1 file changed, 9 insertions(+), 6 deletions(-)tools/perf/pmu-events/jevents.c +9
-6@@ -1082,10 +1082,9 @@ static int process_one_file(const char *fpath, const struct stat *sb,*/ int main (int argc,char *argv[]) { -int rc; +int rc, ret =0 ;int maxfds;char ldirname[PATH_MAX ]; -const char *arch;const char *output_file;const char *start_dirname;@@ -1156,7 +1155,8 @@ int main(int argc, char *argv[])/* Make build fail */ fclose (eventsfp);free_arch_std_events (); -return 1 ; + ret =1 ; + goto out_free_mapfile; }else if (rc) { goto empty_map; }@@ -1174,14 +1174,17 @@ int main(int argc, char *argv[])/* Make build fail */ fclose (eventsfp);free_arch_std_events (); -return 1 ; + ret =1 ; } -return 0 ; + + goto out_free_mapfile; empty_map:fclose (eventsfp);create_empty_mapping (output_file);free_arch_std_events (); -return 0 ; +out_free_mapfile: +free (mapfile); +return ret; }Signature · 1 line
2.17.1
Signature · 1 line
- Arnaldo
[tip: perf/urgent] perf jevents: Fix leak of mapfile memory
In reply to John GarryThe following commit has been merged into the perf/urgent branch of tip:
The following commit has been merged into the perf/urgent branch of tip:
Commit-ID: 3f5777fbaf04c58d940526a22a2e0c813c837936 Gitweb: https://git.kernel.org/tip/3f5777fbaf04c58d940526a22a2e0c813c837936 Author: John Garry <[email protected]> AuthorDate: Thu, 05 Mar 2020 19:08:01 +08:00 Committer: Arnaldo Carvalho de Melo <[email protected]> CommitterDate: Fri, 06 Mar 2020 08:30:47 -03:00
perf jevents: Fix leak of mapfile memory
The memory for global pointer is never freed during normal program execution, so let's do that in the main function exit as a good programming practice.
A stray blank line is also removed.
--- tools/perf/pmu-events/jevents.c | 15 +++++++++------ 1 file changed, 9 insertions(+), 6 deletions(-)
tools/perf/pmu-events/jevents.c +9 -6
@@ -1082,10 +1082,9 @@ static int process_one_file(const char *fpath, const struct stat *sb,*/ int main (int argc,char *argv[]) { -int rc; +int rc, ret =0 ;int maxfds;char ldirname[PATH_MAX ]; -const char *arch;const char *output_file;const char *start_dirname;
@@ -1156,7 +1155,8 @@ int main(int argc, char *argv[])/* Make build fail */ fclose (eventsfp);free_arch_std_events (); -return 1 ; + ret =1 ; + goto out_free_mapfile; }else if (rc) { goto empty_map; }
@@ -1174,14 +1174,17 @@ int main(int argc, char *argv[])/* Make build fail */ fclose (eventsfp);free_arch_std_events (); -return 1 ; + ret =1 ; } -return 0 ; + + goto out_free_mapfile; empty_map:fclose (eventsfp);create_empty_mapping (output_file);free_arch_std_events (); -return 0 ; +out_free_mapfile: +free (mapfile); +return ret; }
PATCH 2/6 perf jevents: Support test events folder
In reply to John GarryWith the goal of supporting pmu-events test case, introduce support for a test events folder.
These test events can be used for testing alias creation for any arch.
When running the pmu-events test case, these test events will be used as the platform-agnostic events, so aliases can be created per-PMU and validated against known expected values.
To support the test events, create a new table of events in generated pmu-events.c, outside the existing pmu_events_map[] table. The table of test events will not have any matching against a CPUID.
The resultant generated pmu-events.c will now look like the following:
struct pmu_event pme_ampere_emag[] = {
{
.name = "ldrex_spec",
.event = "event=0x6c",
.desc = "Exclusive operation spe...",
.topic = "intrinsic",
.long_desc = "Exclusive operation ...",
},
...
};
struct pmu_events_map pmu_events_map[] = {
...
{
.cpuid = "0x00000000500f0000",
.version = "v1",
.type = "core",
.table = pme_ampere_emag
},
...
{
.cpuid = 0,
.version = 0,
.type = 0,
.table = 0,
},};
struct pmu_event pme_test_cpu[] = {
{
.name = "uncore_hisi_ddrc.flux_wcmd",
.event = "event=0x2",
.desc = "DDRC write commands. Unit: hisi_sccl,ddrc ",
.topic = "uncore",
.long_desc = "DDRC write commands",
.pmu = "hisi_sccl,ddrc",
},
{
.name = "unc_cbo_xsnp_response.miss_eviction",
.event = "umask=0x81,event=0x22",
.desc = "Unit: uncore_cbox A cross-core snoop resulted ...",
.topic = "uncore",
.long_desc = "A cross-core snoop resulted from L3 ...",
.pmu = "uncore_cbox",
},
{
.name = "eist_trans",
.event = "umask=0x0,period=200000,event=0x3a",
.desc = "Number of Enhanced Intel SpeedStep(R) ...",
.topic = "other",
},
{
.name = 0,
},};
struct pmu_events_map pmu_events_map_test = {
.table = pme_test_cpu,
};
Structure pmu_events_map_test will be used in pmu-events test as the events to create and validate aliases for.
--- tools/perf/pmu-events/jevents.c | 46 +++++++++++++++++++++++++++++- tools/perf/pmu-events/pmu-events.h | 4 +++ 2 files changed, 49 insertions(+), 1 deletion(-)
tools/perf/pmu-events/jevents.c +45 -1
@@ -53,6 +53,8 @@int verbose;char *prog; +const char *start_dirname; +int eprintf (int level,int var,const char *fmt, ...) {
@@ -764,6 +766,25 @@ static void print_mapping_table_suffix(FILE *outfp)fprintf (outfp,"};\n" ); } +static void print_test_event_tables_prefix (FILE *outfp) +{ +fprintf (outfp,"\nstruct pmu_events_map pmu_events_map_test = {\n" ); +} + +static void print_test_event_tables_suffix (FILE *outfp) +{ +fprintf (outfp,"};\n" ); +} + +static void process_test_event_tables (FILE *outfp) +{ +struct test_event_table *test_event_table; + +print_test_event_tables_prefix (outfp); +fprintf (outfp,"\t.table = pme_test_cpu,\n" ); +print_test_event_tables_suffix (outfp); +} +static int process_mapfile (FILE *outfp,char *fpath) {int n =16384 ;
@@ -868,6 +889,8 @@ static void create_empty_mapping(const char *output_file)fprintf (outfp,"#include \"pmu-events/pmu-events.h\"\n" );print_mapping_table_prefix (outfp);print_mapping_table_suffix (outfp); +print_test_event_tables_prefix (outfp); +print_test_event_tables_suffix (outfp);fclose (outfp); }
@@ -1085,9 +1108,9 @@ int main(int argc, char *argv[])int rc, ret =0 ;int maxfds;char ldirname[PATH_MAX ]; +const char *arch;const char *output_file; -const char *start_dirname;struct stat stbuf; prog =basename (argv[0 ]);
@@ -1177,6 +1200,27 @@ int main(int argc, char *argv[]) ret =1 ; } +/* walk "test" folder, regardless of the arch */ +sprintf (ldirname,"%s/test" , start_dirname); + + rc =nftw (ldirname, process_one_file, maxfds,0 ); +if (rc && verbose) { +pr_info ("%s: Error walking file tree %s rc=%d for test\n" , + prog, ldirname, rc); + goto empty_map; + }else if (rc <0 ) { +/* Make build fail */ +free_arch_std_events (); + ret =1 ; + goto out_free_mapfile; + }else if (rc) { + goto empty_map; + } + +if (close_table) +print_events_table_suffix (eventsfp); + +process_test_event_tables (eventsfp); goto out_free_mapfile;
tools/perf/pmu-events/pmu-events.h +4 -0
@@ -36,10 +36,14 @@ struct pmu_events_map { struct pmu_event *table; }; +struct pmu_test_events { +struct pmu_event *table; +};/* * Global table mapping each known CPU for the architecture to its * table of PMU events. */ extern struct pmu_events_map pmu_events_map[]; +extern struct pmu_events_map pmu_events_map_test;#endif
Signature · 1 line
2.17.1
PATCH 3/6 perf jevents: Add some test events
In reply to John GarryAdd some test PMU events. The events are randomly chosen from x86 and arm64 JSONs. The events include CPU and uncore events.
--- .../pmu-events/arch/test/test_cpu/branch.json | 12 +++++++++ .../pmu-events/arch/test/test_cpu/other.json | 26 +++++++++++++++++++ .../pmu-events/arch/test/test_cpu/uncore.json | 21 +++++++++++++++ 3 files changed, 59 insertions(+) create mode 100644 tools/perf/pmu-events/arch/test/test_cpu/branch.json create mode 100644 tools/perf/pmu-events/arch/test/test_cpu/other.json create mode 100644 tools/perf/pmu-events/arch/test/test_cpu/uncore.json
tools/perf/pmu-events/arch/test/test_cpu/branch.json new file +12 -0
@@ -0,0 +1,12 @@ +[ + { + "EventName": "bp_l1_btb_correct", + "EventCode": "0x8a", + "BriefDescription": "L1 BTB Correction." + }, + { + "EventName": "bp_l2_btb_correct", + "EventCode": "0x8b", + "BriefDescription": "L2 BTB Correction." + } +]
tools/perf/pmu-events/arch/test/test_cpu/other.json new file +26 -0
@@ -0,0 +1,26 @@ +[ + { + "EventCode": "0x6", + "Counter": "0,1", + "UMask": "0x80", + "EventName": "SEGMENT_REG_LOADS.ANY", + "SampleAfterValue": "200000", + "BriefDescription": "Number of segment register loads." + }, + { + "EventCode": "0x9", + "Counter": "0,1", + "UMask": "0x20", + "EventName": "DISPATCH_BLOCKED.ANY", + "SampleAfterValue": "200000", + "BriefDescription": "Memory cluster signals to block micro-op dispatch for any reason" + }, + { + "EventCode": "0x3A", + "Counter": "0,1", + "UMask": "0x0", + "EventName": "EIST_TRANS", + "SampleAfterValue": "200000", + "BriefDescription": "Number of Enhanced Intel SpeedStep(R) Technology (EIST) transitions" + } +]
tools/perf/pmu-events/arch/test/test_cpu/uncore.json new file +21 -0
@@ -0,0 +1,21 @@ +[ + { + "EventCode": "0x02", + "EventName": "uncore_hisi_ddrc.flux_wcmd", + "BriefDescription": "DDRC write commands", + "PublicDescription": "DDRC write commands", + "Unit": "hisi_sccl,ddrc" + }, + { + "Unit": "CBO", + "EventCode": "0x22", + "UMask": "0x81", + "EventName": "UNC_CBO_XSNP_RESPONSE.MISS_EVICTION", + "BriefDescription": "A cross-core snoop resulted from L3 Eviction which misses in some processor core.", + "PublicDescription": "A cross-core snoop resulted from L3 Eviction which misses in some processor core.", + "Counter": "0,1", + "CounterMask": "0", + "Invert": "0", + "EdgeDetect": "0" + } +]
Signature · 1 line
2.17.1
PATCH 4/6 perf pmu: Refactor pmu_add_cpu_aliases()
In reply to John GarryCreate pmu_add_cpu_aliases_map() from pmu_add_cpu_aliases(), so the caller can pass the map; the pmu-events test would use this since there would be no CPUID matching to a mapfile there.
--- tools/perf/util/pmu.c | 21 +++++++++++++-------- tools/perf/util/pmu.h | 3 +++ 2 files changed, 16 insertions(+), 8 deletions(-)
tools/perf/util/pmu.c +13 -8
@@ -21,7 +21,6 @@#include "pmu.h" #include "parse-events.h" #include "header.h" -#include "pmu-events/pmu-events.h" #include "string2.h" #include "strbuf.h" #include "fncache.h"
@@ -744,16 +743,11 @@ static bool pmu_uncore_alias_match(const char *pmu_name, const char *name)* to the current running CPU. Then, add all PMU events from that table * as aliases. */ -static void pmu_add_cpu_aliases (struct list_head *head,struct perf_pmu *pmu) +void pmu_add_cpu_aliases_map (struct list_head *head,struct perf_pmu *pmu, +struct pmu_events_map *map) {int i; -struct pmu_events_map *map;const char *name = pmu->name; - - map =perf_pmu__find_map (pmu); -if (!map) -return ; -/* * Found a matching PMU events table. Create aliases */
@@ -788,6 +782,17 @@ static void pmu_add_cpu_aliases(struct list_head *head, struct perf_pmu *pmu) } } +static void pmu_add_cpu_aliases (struct list_head *head,struct perf_pmu *pmu) +{ +struct pmu_events_map *map; + + map =perf_pmu__find_map (pmu); +if (!map) +return ; + +pmu_add_cpu_aliases_map (head, pmu, map); +} +struct perf_event_attr *__weak perf_pmu__get_default_config (struct perf_pmu *pmu__maybe_unused ) {
tools/perf/util/pmu.h +3 -0
@@ -7,6 +7,7 @@#include <linux/perf_event.h> #include <stdbool.h> #include "parse-events.h" +#include "pmu-events/pmu-events.h" struct perf_evsel_config_term ;
@@ -97,6 +98,8 @@ int perf_pmu__scan_file(struct perf_pmu *pmu, const char *name, const char *fmt,int perf_pmu__test (void );struct perf_event_attr *perf_pmu__get_default_config (struct perf_pmu *pmu); +void pmu_add_cpu_aliases_map (struct list_head *head,struct perf_pmu *pmu, +struct pmu_events_map *map);struct pmu_events_map *perf_pmu__find_map (struct perf_pmu *pmu);
Signature · 1 line
2.17.1
PATCH 5/6 perf pmu: Add is_pmu_core()
In reply to John GarryAdd a function to decide whether a PMU is a core PMU.
--- tools/perf/util/pmu.c | 5 +++++ tools/perf/util/pmu.h | 1 + 2 files changed, 6 insertions(+)
tools/perf/util/pmu.c +5 -0
@@ -1400,6 +1400,11 @@ static void wordwrap(char *s, int start, int max, int corr) } } +bool is_pmu_core (const char *name) +{ +return !strcmp (name,"cpu" ) ||is_arm_pmu_core (name); +} +void print_pmu_events (const char *event_glob,bool name_only,bool quiet_flag,bool long_desc,bool details_flag,bool deprecated) {
tools/perf/util/pmu.h +1 -0
@@ -88,6 +88,7 @@ int perf_pmu__format_parse(char *dir, struct list_head *head);struct perf_pmu *perf_pmu__scan (struct perf_pmu *pmu); +bool is_pmu_core (const char *name);void print_pmu_events (const char *event_glob,bool name_only,bool quiet,bool long_desc,bool details_flag,bool deprecated);
Signature · 1 line
2.17.1
PATCH 6/6 perf test: Add pmu-events test
In reply to John GarryAdd a pmu-events test.
This test will scan all PMUs in the system, and run a PMU event aliasing test for each CPU or uncore PMU.
For known aliases added in pmu-events/arch/test, we need to add an entry in test_cpu_aliases[] or test_uncore_aliases[].
A sample run is as follows for x86:
Couldn't bump rlimit(MEMLOCK), failures may take place when creating BPF maps, etc
10: PMU event aliases :
--- start ---
test child forked, pid 30869
Using CPUID GenuineIntel-6-9E-9intel_pt default config: tsc,mtc,mtc_period=3,psb_period=3,pt,branch skipping testing PMU software
testing PMU power: skip
testing PMU cpu: matched event segment_reg_loads.any
testing PMU cpu: matched event dispatch_blocked.any
testing PMU cpu: matched event eist_trans
testing PMU cpu: matched event bp_l1_btb_correct
testing PMU cpu: matched event bp_l2_btb_correct
testing PMU cpu: pass
testing PMU cstate_core: skip
testing PMU uncore_cbox_2: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_2: pass
skipping testing PMU breakpoint
testing PMU uncore_cbox_0: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_0: pass
skipping testing PMU tracepoint
testing PMU cstate_pkg: skip
testing PMU uncore_arb: skip
testing PMU msr: skip
testing PMU uncore_cbox_3: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_3: pass
testing PMU intel_pt: skip
testing PMU uncore_cbox_1: matched event unc_cbo_xsnp_response.miss_eviction testing PMU uncore_cbox_1: pass
test child finished with 0
---- end ----
PMU event aliases: Ok
--- tools/perf/tests/Build | 1 + tools/perf/tests/builtin-test.c | 4 + tools/perf/tests/pmu-events.c | 192 ++++++++++++++++++++++++++++++++ tools/perf/tests/tests.h | 1 + 4 files changed, 198 insertions(+) create mode 100644 tools/perf/tests/pmu-events.c
tools/perf/tests/Build +1 -0
@@ -14,6 +14,7 @@ perf-y += evsel-roundtrip-name.o perf-y += evsel-tp-sched.o perf-y += fdarray.o perf-y += pmu.o +perf-y += pmu-events.o perf-y += hists_common.o perf-y += hists_link.o perf-y += hists_filter.o
tools/perf/tests/builtin-test.c +4 -0
@@ -72,6 +72,10 @@ static struct test generic_tests[] = { .desc = "Parse perf pmu format", .func = test__pmu, }, + { + .desc = "PMU event aliases", + .func = test__pmu_event_aliases, + }, { .desc = "DSO data read", .func = test__dso_data,
tools/perf/tests/pmu-events.c new file +192 -0
192 lines not on this page · raw message
tools/perf/tests/tests.h +1 -0
@@ -49,6 +49,7 @@ int test__perf_evsel__roundtrip_name_test(struct test *test, int subtest);int test__perf_evsel__tp_sched_test (struct test *test,int subtest);int test__syscall_openat_tp_fields (struct test *test,int subtest);int test__pmu (struct test *test,int subtest); +int test__pmu_event_aliases (struct test *test,int subtest);int test__attr (struct test *test,int subtest);int test__dso_data (struct test *test,int subtest);int test__dso_data_cache (struct test *test,int subtest);
Signature · 1 line
2.17.1
Re: [PATCH 6/6] perf test: Add pmu-events test
Quoted 7 lines · John Garry
Add a pmu-events test.
This test will scan all PMUs in the system, and run a PMU event aliasing test for each CPU or uncore PMU.
For known aliases added in pmu-events/arch/test, we need to add an entry in test_cpu_aliases[] or test_uncore_aliases[].
heya, awesome! ;-)
Quoted 35 lines
A sample run is as follows for x86:
Couldn't bump rlimit(MEMLOCK), failures may take place when creating BPF maps, etc
10: PMU event aliases :
--- start ---
test child forked, pid 30869
Using CPUID GenuineIntel-6-9E-9intel_ptdefault config: tsc,mtc,mtc_period=3,psb_period=3,pt,branch skipping testing PMU software
testing PMU power: skip
testing PMU cpu: matched event segment_reg_loads.any
testing PMU cpu: matched event dispatch_blocked.any
testing PMU cpu: matched eventeist_trans
testing PMU cpu: matched eventbp_l1_btb_correct
testing PMU cpu: matched eventbp_l2_btb_correct
testing PMU cpu: pass
testing PMUcstate_core: skip
testing PMUuncore_cbox_2: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_2: pass
skipping testing PMU breakpoint
testing PMUuncore_cbox_0: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_0: pass
skipping testing PMU tracepoint
testing PMUcstate_pkg: skip
testing PMUuncore_arb: skip
testing PMU msr: skip
testing PMUuncore_cbox_3: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_3: pass
testing PMUintel_pt: skip
testing PMUuncore_cbox_1: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_1: pass
test child finished with 0
---- end ----
PMU event aliases: Ok
SNIP
tools/perf/tests/pmu-events.c line 173
Quoted 7 lines
tools/perf/tests/pmu-events.c new file +7
-0+int test__pmu_event_aliases (struct test *test__maybe_unused , +int subtest__maybe_unused ) +{ +struct perf_pmu *pmu =NULL ; + +while ((pmu =perf_pmu__scan (pmu)) !=NULL ) { +int count =0 ;
I don't follow the pmu iteration in here.. I'd expect we create 'test' pmu and check that all the aliasses are in place as we expect them.. why do we match them to existing events?
or as I'm thinking about that now, would it be enough to check pme_test_cpu array to have string that we expect?
thanks for doing this,
jirka
Re: [PATCH 6/6] perf test: Add pmu-events test
Quoted 38 lines
Quoted 35 lines
A sample run is as follows for x86:
Couldn't bump rlimit(MEMLOCK), failures may take place when creating BPF maps, etc
10: PMU event aliases :
--- start ---
test child forked, pid 30869
Using CPUID GenuineIntel-6-9E-9intel_ptdefault config: tsc,mtc,mtc_period=3,psb_period=3,pt,branch skipping testing PMU software
testing PMU power: skip
testing PMU cpu: matched event segment_reg_loads.any
testing PMU cpu: matched event dispatch_blocked.any
testing PMU cpu: matched eventeist_trans
testing PMU cpu: matched eventbp_l1_btb_correct
testing PMU cpu: matched eventbp_l2_btb_correct
testing PMU cpu: pass
testing PMUcstate_core: skip
testing PMUuncore_cbox_2: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_2: pass
skipping testing PMU breakpoint
testing PMUuncore_cbox_0: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_0: pass
skipping testing PMU tracepoint
testing PMUcstate_pkg: skip
testing PMUuncore_arb: skip
testing PMU msr: skip
testing PMUuncore_cbox_3: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_3: pass
testing PMUintel_pt: skip
testing PMUuncore_cbox_1: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_1: pass
test child finished with 0
---- end ----
PMU event aliases: OkSNIP
Quoted 8 lines
tools/perf/tests/pmu-events.c line 173
Quoted 7 lines
tools/perf/tests/pmu-events.c new file +7
-0+int test__pmu_event_aliases (struct test *test__maybe_unused , +int subtest__maybe_unused ) +{ +struct perf_pmu *pmu =NULL ; + +while ((pmu =perf_pmu__scan (pmu)) !=NULL ) { +int count =0 ;
Hi jirka,
Quoted 2 lines
I don't follow the pmu iteration in here.. I'd expect we create 'test' pmu
well, that's what we do next in the call to __test__pmu_event_aliases():
static int __test__pmu_event_aliases(char *pmu_name, int *count)
{
struct perf_pmu_alias *alias;
struct perf_pmu *pmu;
LIST_HEAD(aliases);
int res = 0;
pmu = zalloc(sizeof(*pmu));
if (!pmu)
return -1;
pmu->name = pmu_name;
pmu_add_cpu_aliases_map(&aliases, pmu, &pmu_events_map_test);Here we clone the HW PMU, create the aliases, and verify them against a known, expected list.
and check that all the aliasses
Quoted 2 lines
are in place as we expect them.. why do we match them to existing events?
The events in test_cpu_aliases[] or test_uncore_aliases[] are checked against the events from pmu-events/arch/test/test_cpu/*.json
Quoted 4 lines
or as I'm thinking about that now, would it be enough to check
pme_test_cpuarray to have string that we expect?
Right, I might change this.
So currently we iterate the PMU aliases to ensure that we have a matching event in pme_test_cpu[]. It may be better to iterate the events in pme_test_cpu[] to ensure that we have an alias.
The problem here is uncore PMUs. They have the "Unit" field, which is used for matching the PMU. So we cannot ensure test events from uncore.json will always have an event alias created per PMU. But maybe I could use pmu_uncore_alias_match() to check if the test event matches in this case.
Thanks,
John
Re: [PATCH 6/6] perf test: Add pmu-events test
Quoted 73 lines · John Garry
Quoted 38 lines
Quoted 35 lines
A sample run is as follows for x86:
Couldn't bump rlimit(MEMLOCK), failures may take place when creating BPF maps, etc
10: PMU event aliases :
--- start ---
test child forked, pid 30869
Using CPUID GenuineIntel-6-9E-9intel_ptdefault config: tsc,mtc,mtc_period=3,psb_period=3,pt,branch skipping testing PMU software
testing PMU power: skip
testing PMU cpu: matched event segment_reg_loads.any
testing PMU cpu: matched event dispatch_blocked.any
testing PMU cpu: matched eventeist_trans
testing PMU cpu: matched eventbp_l1_btb_correct
testing PMU cpu: matched eventbp_l2_btb_correct
testing PMU cpu: pass
testing PMUcstate_core: skip
testing PMUuncore_cbox_2: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_2: pass
skipping testing PMU breakpoint
testing PMUuncore_cbox_0: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_0: pass
skipping testing PMU tracepoint
testing PMUcstate_pkg: skip
testing PMUuncore_arb: skip
testing PMU msr: skip
testing PMUuncore_cbox_3: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_3: pass
testing PMUintel_pt: skip
testing PMUuncore_cbox_1: matched event unc_cbo_xsnp_response.miss_eviction testing PMUuncore_cbox_1: pass
test child finished with 0
---- end ----
PMU event aliases: OkSNIP
Quoted 8 lines
tools/perf/tests/pmu-events.c line 173
Quoted 7 lines
tools/perf/tests/pmu-events.c new file +7
-0+int test__pmu_event_aliases (struct test *test__maybe_unused , +int subtest__maybe_unused ) +{ +struct perf_pmu *pmu =NULL ; + +while ((pmu =perf_pmu__scan (pmu)) !=NULL ) { +int count =0 ;Hi jirka,
Quoted 2 lines
I don't follow the pmu iteration in here.. I'd expect we create 'test' pmu
well, that's what we do next in the call to
__test__pmu_event_aliases():static int
__test__pmu_event_aliases(char *pmu_name, int *count){ struct perf_pmu_alias *alias; struct perf_pmu *pmu; LIST_HEAD(aliases); int res = 0; pmu = zalloc(sizeof(*pmu)); if (!pmu) return -1; pmu->name = pmu_name; pmu_add_cpu_aliases_map(&aliases, pmu, &pmu_events_map_test);Here we clone the HW PMU, create the aliases, and verify them against a known, expected list.
Quoted 6 lines
and check that all the aliasses
Quoted 2 lines
are in place as we expect them.. why do we match them to existing events?
The events in test_cpu_aliases[] or test_uncore_aliases[] are checked against the events from pmu-events/arch/test/test_cpu/*.json
I don't understand the benefit of this.. so IIUC:
- jevents will go through arch/test and populate pmu-events/pmu-events.c with:
struct pmu_event pme_test_cpu[] ...
struct pmu_events_map pmu_events_map_test ...
- so we actualy have the parsed json events in C structs and we can go through them and check it contains fields with strings that we expect
- you go through all detected pmus and check if the tests events we generated are matching some of the events from these pmus, and that's where I'm lost ;-) why?
Quoted 11 lines
Quoted 5 lines
or as I'm thinking about that now, would it be enough to check
pme_test_cpuarray to have string that we expect?Right, I might change this.
So currently we iterate the PMU aliases to ensure that we have a matching event in pme_test_cpu[]. It may be better to iterate the events in pme_test_cpu[] to ensure that we have an alias.
that's what I described above.. I dont understand the connection/value of this tests
Quoted 5 lines
The problem here is uncore PMUs. They have the "Unit" field, which is used for matching the PMU. So we cannot ensure test events from uncore.json will always have an event alias created per PMU. But maybe I could use
pmu_uncore_alias_match()to check if the test event matches in this case.
hum I guess I don't follow all the details.. but some more explanation of the test would be great
jirka
Re: [PATCH 6/6] perf test: Add pmu-events test
Quoted 4 lines
Quoted 3 lines
The events in test_cpu_aliases[] or test_uncore_aliases[] are checked against the events from pmu-events/arch/test/test_cpu/*.json
Hi Jirka,
Quoted 6 lines
I don't understand the benefit of this.. so IIUC:
- jevents will go through
arch/testand populatepmu-events/pmu-events.cwith:
structpmu_eventpme_test_cpu[] ...
structpmu_events_mappmu_events_map_test...
Right. And the idea is that pme_test_cpu[] can be used as generic set of events for testing on any arch/cpuid. (note: I'll just ignore uncore events for the moment)
Quoted 3 lines
- so we actualy have the parsed json events in C structs and we can go through them and check it contains fields with strings that we expect
No, we use pme_test_cpu[] to generate the event aliases for a PMU, and verify that the aliases are as expected.
Quoted 3 lines
- you go through all detected pmus and check if the tests events we generated are matching some of the events from these pmus,
Not exactly.
Quoted 1 line
and that's where I'm lost ;-) why?
So consider the "cpu" HW PMU. During normal operation, we create the event aliases for this PMU in pmu_lookup()->pmu_add_cpu_aliases(). This step looks up a map of cpu events for that CPUID, and then creates the event aliases for that PMU from that map.
I want the test to recreate this and verify that the events from the test JSONs will have event aliases created properly.
So in the test when we scan the PMUs and find "cpu" HW PMU, we create a test PMU with the same name, create the event aliases from pme_test_cpu[] for that test PMU, and then verify that the event aliases created are as expected. Then the test PMU is deleted.
So overall the test covers:
a. jevents code to generate the struct pmu_event [] b. util/pmu.c code to create the event aliases for a given PMU
Note: the test does not (yet) cover matching of events declared in the HW PMU sysfs folder. I'm talking about these, for example:
$ ls /sys/bus/event_source/devices/cpu/events/ branch-instructions cache-references el-abort el-start ref-cycles ...
Quoted 17 lines
Quoted 7 lines
Quoted 6 lines
or as I'm thinking about that now, would it be enough to check
pme_test_cpuarray to have string that we expect?Quoted 5 lines
Right, I might change this.
So currently we iterate the PMU aliases to ensure that we have a matching event in pme_test_cpu[]. It may be better to iterate the events in pme_test_cpu[] to ensure that we have an alias.
that's what I described above.. I dont understand the connection/value of this tests
Quoted 1 line
Quoted 7 lines
Quoted 4 lines
The problem here is uncore PMUs. They have the "Unit" field, which is used for matching the PMU. So we cannot ensure test events from uncore.json will always have an event alias created per PMU. But maybe I could use
pmu_uncore_alias_match()to check if the test event matches in this case.hum I guess I don't follow all the details.. but some more explanation of the test would be great
Let's just concentrate on core PMU ATM :)
Thanks,
John
Re: [PATCH 6/6] perf test: Add pmu-events test
Quoted 33 lines · John Garry
Quoted 4 lines
Quoted 3 lines
The events in test_cpu_aliases[] or test_uncore_aliases[] are checked against the events from pmu-events/arch/test/test_cpu/*.json
Hi Jirka,
Quoted 6 lines
I don't understand the benefit of this.. so IIUC:
- jevents will go through
arch/testand populatepmu-events/pmu-events.cwith:
structpmu_eventpme_test_cpu[] ...
structpmu_events_mappmu_events_map_test...Right. And the idea is that pme_test_cpu[] can be used as generic set of events for testing on any
arch/cpuid. (note: I'll just ignore uncore events for the moment)Quoted 3 lines
- so we actualy have the parsed json events in C structs and we can go through them and check it contains fields with strings that we expect
No, we use pme_test_cpu[] to generate the event aliases for a PMU, and verify that the aliases are as expected.
Quoted 3 lines
- you go through all detected pmus and check if the tests events we generated are matching some of the events from these pmus,
Not exactly.
Quoted 1 line
and that's where I'm lost ;-) why?
Quoted 7 lines
So consider the "cpu" HW PMU. During normal operation, we create the event aliases for this PMU in pmu_lookup()->pmu_add_cpu_aliases(). This step looks up a map of cpu events for that CPUID, and then creates the event aliases for that PMU from that map.
I want the test to recreate this and verify that the events from the test JSONs will have event aliases created properly.
aah ok, my first objective was to have some way to test pmu-events changes we plan to do and their affect to generated pmu-event.c
you want to test the code paths after that.. perfect
Quoted 6 lines
So in the test when we scan the PMUs and find "cpu" HW PMU, we create a test PMU with the same name, create the event aliases from pme_test_cpu[] for that test PMU, and then verify that the event aliases created are as expected. Then the test PMU is deleted.
Quoted 6 lines
So overall the test covers:
a. jevents code to generate the structpmu_event[] b.util/pmu.ccode to create the event aliases for a given PMUNote: the test does not (yet) cover matching of events declared in the HW PMU sysfs folder. I'm talking about these, for example:
ok
Quoted 27 lines
$ ls /sys/bus/event_source/devices/cpu/events/ branch-instructions cache-references el-abort el-start ref-cycles ...Quoted 22 lines
Quoted 7 lines
Quoted 6 lines
or as I'm thinking about that now, would it be enough to check
pme_test_cpuarray to have string that we expect?Quoted 5 lines
Right, I might change this.
So currently we iterate the PMU aliases to ensure that we have a matching event in pme_test_cpu[]. It may be better to iterate the events in pme_test_cpu[] to ensure that we have an alias.
that's what I described above.. I dont understand the connection/value of this tests
Quoted 5 lines
The problem here is uncore PMUs. They have the "Unit" field, which is used for matching the PMU. So we cannot ensure test events from uncore.json will always have an event alias created per PMU. But maybe I could use
pmu_uncore_alias_match()to check if the test event matches in this case.
Quoted 4 lines
Quoted 2 lines
hum I guess I don't follow all the details.. but some more explanation of the test would be great
Let's just concentrate on core PMU ATM :)
ok, thanks,
jirka
Re: [PATCH 6/6] perf test: Add pmu-events test
Hi jirka,
Quoted 20 lines
Quoted 20 lines
Quoted 3 lines
- so we actualy have the parsed json events in C structs and we can go through them and check it contains fields with strings that we expect
No, we use pme_test_cpu[] to generate the event aliases for a PMU, and verify that the aliases are as expected.
Quoted 3 lines
- you go through all detected pmus and check if the tests events we generated are matching some of the events from these pmus,
Not exactly.
Quoted 1 line
and that's where I'm lost ;-) why?
So consider the "cpu" HW PMU. During normal operation, we create the event aliases for this PMU in pmu_lookup()->pmu_add_cpu_aliases(). This step looks up a map of cpu events for that CPUID, and then creates the event aliases for that PMU from that map.
Quoted 5 lines
Quoted 2 lines
I want the test to recreate this and verify that the events from the test JSONs will have event aliases created properly.
aah ok, my first objective was to have some way to test pmu-events changes we plan to do and their affect to generated
pmu-event.c
Since the format of the test events table is slightly different to regular event tables, I wasn't sure on the value there. But I could add it.
For that, I could modify how we generate pmu-events.c as to not have a separate special test table, but add the test events as a special entry in pmu_events_map[], with some fake test cpuid. That could be better if we want to verify the generated test event table.
Quoted 9 lines
you want to test the code paths after that.. perfect
Quoted 6 lines
So in the test when we scan the PMUs and find "cpu" HW PMU, we create a test PMU with the same name, create the event aliases from pme_test_cpu[] for that test PMU, and then verify that the event aliases created are as expected. Then the test PMU is deleted.
Quoted 9 lines
Quoted 6 lines
So overall the test covers:
a. jevents code to generate the structpmu_event[] b.util/pmu.ccode to create the event aliases for a given PMUNote: the test does not (yet) cover matching of events declared in the HW PMU sysfs folder. I'm talking about these, for example:
ok
I'm going to look at what I can do here. I just worry it will make things more arch specific and make the test brittle.
Quoted 27 lines
Quoted 27 lines
$ ls /sys/bus/event_source/devices/cpu/events/ branch-instructions cache-references el-abort el-start ref-cycles ...Quoted 22 lines
Quoted 7 lines
Quoted 6 lines
or as I'm thinking about that now, would it be enough to check
pme_test_cpuarray to have string that we expect?Quoted 5 lines
Right, I might change this.
So currently we iterate the PMU aliases to ensure that we have a matching event in pme_test_cpu[]. It may be better to iterate the events in pme_test_cpu[] to ensure that we have an alias.
that's what I described above.. I dont understand the connection/value of this tests
Quoted 5 lines
The problem here is uncore PMUs. They have the "Unit" field, which is used for matching the PMU. So we cannot ensure test events from uncore.json will always have an event alias created per PMU. But maybe I could use
pmu_uncore_alias_match()to check if the test event matches in this case.
Quoted 4 lines
Quoted 4 lines
Quoted 2 lines
hum I guess I don't follow all the details.. but some more explanation of the test would be great
Let's just concentrate on core PMU ATM :)
So just going back to the uncore events now, since they have the "Unit" property to match to specific uncore PMUs, we need to test them slightly differently to core PMUs. But I have improved the testing for that now.
Thanks,
John