Reference count checker and related fixes
Ian Rogers
reviewerv7 cover Reference count checker and related fixes
The perf tool has a class of memory problems where reference counts are used incorrectly. Memory/address sanitizers and valgrind don't provide useful ways to debug these problems, you see a memory leak where the only pertinent information is the original allocation site. What would be more useful is knowing where a get fails to have a corresponding put, where there are double puts, etc.
This work was motivated by the roll-back of:
https://lore.kernel.org/linux-perf-users/[email protected]/
where fixing a missed put resulted in a use-after-free in a different context. There was a sense in fixing the issue that a game of wac-a-mole had been embarked upon in adding missed gets and puts.
The basic approach of the change is to add a level of indirection at the get and put calls. Get allocates a level of indirection that, if no corresponding put is called, becomes a memory leak (and associated stack trace) that leak sanitizer can report. Similarly if two puts are called for the same get, then a double free can be detected by address sanitizer. This can also detect the use after put, which should also yield a segv without a sanitizer.
Adding reference count checking to cpu map was done as a proof of concept, it yielded little other than a location where the use of get could be cleaner by using its result. Reference count checking on nsinfo identified a double free of the indirection layer and the related threads, thereby identifying a data race as discussed here:
https://lore.kernel.org/linux-perf-users/CAP-5=fWZH20L4kv-BwVtGLwR=Em3AOOT+Q4QGivvQuYn5AsPRg@mail.gmail.com/
Accordingly the dso->lock was extended and use to cover the race.
The v3 version addresses problems in v2, in particular using macros to avoid #ifdefs. The v3 version applies the reference count checking approach to two more data structures, maps and map. While maps was straightforward, struct map showed a problem where reference counted thing can be on lists and rb-trees that are oblivious to the reference count. To sanitize this, struct map is changed so that it is referenced by either a list or rb-tree node and not part of it. This simplifies the reference count and the patches have caught and fixed a number of missed or mismatched reference counts relating to struct map.
A wider discussion of the approach is on the mailing list:
https://lore.kernel.org/linux-perf-users/[email protected]/T/#mf25ccd7a2e03de92cec29d36e2999a8ab5ec7f88
Comparing it to a past approach:
https://lore.kernel.org/all/[email protected]/
and to ref_tracker:
https://lwn.net/Articles/877603/
v7. rebase on top of merged and Arnaldo fixed changes. The remaining 5
patches no longer refactor APIs but just add the necessary reference count checking macros and usage.
v6. rebase removing 5 merged changes. Fix missed issues with libunwind. v5. rebase removing 5 merged changes. Add map_list_node__new to the
1st patch (perf map: Move map list node into symbol) as suggested by Arnaldo. Remove unnecessary map__puts from patch 12 (perf map:
Changes to reference counting) as suggested by Adrian.
v4. rebases on to acme's perf-tools-next, fixes more issues with
map/maps and breaks apart the accessor functions to reduce individual patch sizes. The accessor functions are mechanical changes where the single biggest one is refactoring use of map->dso to be map__dso(map).
Ian Rogers (5):
libperf: Add reference count checking macros.
perf cpumap: Add reference count checking
perf namespaces: Add reference count checking
perf maps: Add reference count checking.
perf map: Add reference count checking
tools/lib/perf/Makefile | 2 +- tools/lib/perf/cpumap.c | 94 ++++++++------- tools/lib/perf/include/internal/cpumap.h | 4 +- tools/lib/perf/include/internal/rc_check.h | 94 +++++++++++++++ tools/perf/builtin-inject.c | 2 +- tools/perf/builtin-top.c | 4 +- tools/perf/tests/cpumap.c | 4 +- tools/perf/tests/hists_link.c | 2 +- tools/perf/tests/maps.c | 20 ++-- tools/perf/tests/thread-maps-share.c | 29 ++--- tools/perf/tests/vmlinux-kallsyms.c | 4 +- tools/perf/util/annotate.c | 2 +- tools/perf/util/cpumap.c | 40 +++---- tools/perf/util/dso.c | 2 +- tools/perf/util/dsos.c | 2 +- tools/perf/util/machine.c | 27 +++-- tools/perf/util/map.c | 69 ++++++----- tools/perf/util/map.h | 32 ++--- tools/perf/util/maps.c | 64 +++++----- tools/perf/util/maps.h | 17 +-- tools/perf/util/namespaces.c | 132 ++++++++++++--------- tools/perf/util/namespaces.h | 3 +- tools/perf/util/pmu.c | 8 +- tools/perf/util/symbol-elf.c | 26 ++-- tools/perf/util/symbol.c | 55 +++++---- tools/perf/util/unwind-libdw.c | 2 +- tools/perf/util/unwind-libunwind-local.c | 2 +- tools/perf/util/unwind-libunwind.c | 2 +- 28 files changed, 448 insertions(+), 296 deletions(-) create mode 100644 tools/lib/perf/include/internal/rc_check.h
Signature · 1 line
2.40.0.577.gac1e443424-goog
Ian Rogers
reviewerPATCH v7 1/5 libperf: Add reference count checking macros.
The macros serve as a way to debug use of a reference counted struct. The macros add a memory allocated pointer that is interposed between the reference counted original struct at a get and freed by a put. The pointer replaces the original struct, so use of the struct name via APIs remains unchanged.
--- tools/lib/perf/include/internal/rc_check.h | 94 ++++++++++++++++++++++ 1 file changed, 94 insertions(+) create mode 100644 tools/lib/perf/include/internal/rc_check.h
tools/lib/perf/include/internal/rc_check.h new file +94 -0
@@ -0,0 +1,94 @@ +/* SPDX-License-Identifier: (LGPL-2.1 OR BSD-2-Clause) */ +#ifndef __LIBPERF_INTERNAL_RC_CHECK_H +#define __LIBPERF_INTERNAL_RC_CHECK_H + +#include <stdlib.h> +#include <linux/zalloc.h> + +/* +* Shared reference count checking macros. +* +* Reference count checking is an approach to sanitizing the use of reference +* counted structs. It leverages address and leak sanitizers to make sure gets +* are paired with a put. Reference count checking adds a malloc-ed layer of +* indirection on a get, and frees it on a put. A missed put will be reported as +* a memory leak. A double put will be reported as a double free. Accessing +* after a put will cause a use-after-free and/or a segfault. +*/ + +#ifndef REFCNT_CHECKING +/* Replaces "struct foo" so that the pointer may be interposed. */ +#define DECLARE_RC_STRUCT (struct_name) \ + struct struct_name + +/* Declare a reference counted struct variable. */ +#define RC_STRUCT (struct_name) struct struct_name + +/* +* Interpose the indirection. Result will hold the indirection and object is the +* reference counted struct. +*/ +#define ADD_RC_CHK (result, object) (result = object, object) + +/* Strip the indirection layer. */ +#define RC_CHK_ACCESS (object) object + +/* Frees the object and the indirection layer. */ +#define RC_CHK_FREE (object) free(object) + +/* A get operation adding the indirection layer. */ +#define RC_CHK_GET (result, object) ADD_RC_CHK(result, object) + +/* A put operation removing the indirection layer. */ +#define RC_CHK_PUT (object) {} + +#else + +/* Replaces "struct foo" so that the pointer may be interposed. */ +#define DECLARE_RC_STRUCT (struct_name) \ + struct original_##struct_name; \ + struct struct_name { \ + struct original_##struct_name *orig; \ + }; \ + struct original_##struct_name + +/* Declare a reference counted struct variable. */ +#define RC_STRUCT (struct_name) struct original_##struct_name + +/* +* Interpose the indirection. Result will hold the indirection and object is the +* reference counted struct. +*/ +#define ADD_RC_CHK (result, object) \ + ( \ + object ? (result = malloc(sizeof(*result)), \ + result ? (result->orig = object, result) \ + : (result = NULL, NULL)) \ + : (result = NULL, NULL) \ + ) + +/* Strip the indirection layer. */ +#define RC_CHK_ACCESS (object) object->orig + +/* Frees the object and the indirection layer. */ +#define RC_CHK_FREE (object) \ + do { \ + zfree(&object->orig); \ + free(object); \ + } while(0) + +/* A get operation adding the indirection layer. */ +#define RC_CHK_GET (result, object) ADD_RC_CHK(result, (object ? object->orig : NULL)) + +/* A put operation removing the indirection layer. */ +#define RC_CHK_PUT (object) \ + do { \ + if (object) { \ + object->orig = NULL; \ + free(object); \ + } \ + } while(0) + +#endif + +#endif /* __LIBPERF_INTERNAL_RC_CHECK_H */
Signature · 1 line
2.40.0.577.gac1e443424-goog
Ian Rogers
reviewerPATCH v7 2/5 perf cpumap: Add reference count checking
In reply to Ian RogersEnabled when REFCNT_CHECKING is defined. The change adds a memory allocated pointer that is interposed between the reference counted cpu map at a get and freed by a put. The pointer replaces the original perf_cpu_map struct, so use of the perf_cpu_map via APIs remains unchanged. Any use of the cpu map without the API requires two versions, handled via the RC_CHK_ACCESS macro.
This change is intended to catch:
- use after put: using a cpumap after you have put it will cause a segv.
- unbalanced puts: two puts for a get will result in a double free that can be captured and reported by tools like address sanitizer, including with the associated stack traces of allocation and frees.
- missing puts: if a put is missing then the get turns into a memory leak that can be reported by leak sanitizer, including the stack trace at the point the get occurs.
--- tools/lib/perf/Makefile | 2 +- tools/lib/perf/cpumap.c | 94 +++++++++++++----------- tools/lib/perf/include/internal/cpumap.h | 4 +- tools/perf/tests/cpumap.c | 4 +- tools/perf/util/cpumap.c | 40 +++++----- tools/perf/util/pmu.c | 8 +- 6 files changed, 81 insertions(+), 71 deletions(-)
tools/lib/perf/Makefile +1 -1
@@ -188,7 +188,7 @@ install_lib: libs cp -fpR $(LIBPERF_ALL) $(DESTDIR)$(libdir_SQ) HDRS := bpf_perf.h core.h cpumap.h threadmap.h evlist.h evsel.h event.h mmap.h -INTERNAL_HDRS := cpumap.h evlist.h evsel.h lib.h mmap.h threadmap.h xyarray.h +INTERNAL_HDRS := cpumap.h evlist.h evsel.h lib.h mmap.h rc_check.h threadmap.h xyarray.h INSTALL_HDRS_PFX := $(DESTDIR)$(prefix)/include/perf INSTALL_HDRS := $(addprefix $(INSTALL_HDRS_PFX)/, $(HDRS))
tools/lib/perf/cpumap.c +52 -42
199 lines not on this page · raw message
tools/lib/perf/include/internal/cpumap.h +3 -1
@@ -4,6 +4,7 @@#include <linux/refcount.h> #include <perf/cpumap.h> +#include <internal/rc_check.h> /** * A sized, reference counted, sorted array of integers representing CPU
@@ -12,7 +13,7 @@* gaps if CPU numbers were used. For events associated with a pid, rather than * a CPU, a single dummy map with an entry of -1 is used. */ -struct perf_cpu_map { +DECLARE_RC_STRUCT (perf_cpu_map) {refcount_t refcnt;/** Length of the map array. */ int nr;
@@ -24,6 +25,7 @@ struct perf_cpu_map {#define MAX_NR_CPUS 2048#endif +struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus);int perf_cpu_map__idx (const struct perf_cpu_map *cpus,struct perf_cpu cpu);bool perf_cpu_map__is_subset (const struct perf_cpu_map *a,const struct perf_cpu_map *b);
tools/perf/tests/cpumap.c +2 -2
@@ -68,7 +68,7 @@ static int process_event_cpus(struct perf_tool *tool __maybe_unused,TEST_ASSERT_VAL ("wrong nr" ,perf_cpu_map__nr (map) ==2 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,0 ).cpu ==1 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,1 ).cpu ==256 ); -TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&map->refcnt) ==1 ); +TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (map)->refcnt) ==1 );perf_cpu_map__put (map);return 0 ; }
@@ -94,7 +94,7 @@ static int process_event_range_cpus(struct perf_tool *tool __maybe_unused,TEST_ASSERT_VAL ("wrong nr" ,perf_cpu_map__nr (map) ==256 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,0 ).cpu ==1 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__max (map).cpu ==256 ); -TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&map->refcnt) ==1 ); +TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (map)->refcnt) ==1 );perf_cpu_map__put (map);return 0 ; }
tools/perf/util/cpumap.c +19 -21
@@ -77,9 +77,9 @@ static struct perf_cpu_map *cpu_map__from_entries(const struct perf_record_cpu_m* otherwise it would become 65535. */ if (data->cpus_data.cpu[i] == (u16) -1 ) - map->map[i].cpu =-1 ; +RC_CHK_ACCESS (map)->map[i].cpu =-1 ;else - map->map[i].cpu = (int ) data->cpus_data.cpu[i]; +RC_CHK_ACCESS (map)->map[i].cpu = (int ) data->cpus_data.cpu[i]; } }
@@ -107,7 +107,7 @@ static struct perf_cpu_map *cpu_map__from_mask(const struct perf_record_cpu_map_perf_record_cpu_map_data__read_one_mask (data, i, local_copy);for_each_set_bit (cpu, local_copy,64 ) - map->map[j++].cpu = cpu + cpus_per_i; +RC_CHK_ACCESS (map)->map[j++].cpu = cpu + cpus_per_i; }return map;
@@ -124,11 +124,11 @@ static struct perf_cpu_map *cpu_map__from_range(const struct perf_record_cpu_mapreturn NULL ;if (data->range_cpu_data.any_cpu) - map->map[i++].cpu =-1 ; +RC_CHK_ACCESS (map)->map[i++].cpu =-1 ;for (int cpu = data->range_cpu_data.start_cpu; cpu <= data->range_cpu_data.end_cpu; i++, cpu++) - map->map[i].cpu = cpu; +RC_CHK_ACCESS (map)->map[i].cpu = cpu;return map; }
@@ -160,16 +160,13 @@ size_t cpu_map__fprintf(struct perf_cpu_map *map, FILE *fp)struct perf_cpu_map *perf_cpu_map__empty_new (int nr) { -struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (int ) * nr); +struct perf_cpu_map *cpus =perf_cpu_map__alloc (nr);if (cpus !=NULL ) {int i; - cpus->nr = nr;for (i =0 ; i < nr; i++) - cpus->map[i].cpu =-1 ; - -refcount_set (&cpus->refcnt,1 ); +RC_CHK_ACCESS (cpus)->map[i].cpu =-1 ; }return cpus;
@@ -239,7 +236,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, {int idx;struct perf_cpu cpu; -struct cpu_aggr_map *c =cpu_aggr_map__empty_new (cpus->nr); +struct cpu_aggr_map *c =cpu_aggr_map__empty_new (perf_cpu_map__nr (cpus));if (!c)return NULL ;
@@ -263,7 +260,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, } }/* Trim. */ -if (c->nr != cpus->nr) { +if (c->nr !=perf_cpu_map__nr (cpus)) {struct cpu_aggr_map *trimmed_c =realloc (c,sizeof (struct cpu_aggr_map ) +sizeof (struct aggr_cpu_id ) * c->nr);
@@ -582,31 +579,32 @@ size_t cpu_map__snprint(struct perf_cpu_map *map, char *buf, size_t size)#define COMMA first ? "" : "," -for (i =0 ; i < map->nr +1 ; i++) { +for (i =0 ; i <perf_cpu_map__nr (map) +1 ; i++) {struct perf_cpu cpu = { .cpu =INT_MAX }; -bool last = i == map->nr; +bool last = i ==perf_cpu_map__nr (map);if (!last) - cpu = map->map[i]; + cpu =perf_cpu_map__cpu (map, i);if (start ==-1 ) { start = i;if (last) { ret +=snprintf (buf + ret, size - ret,"%s%d" ,COMMA , - map->map[i].cpu); +perf_cpu_map__cpu (map, i).cpu); } - }else if (((i - start) != (cpu.cpu - map->map[start].cpu)) || last) { + }else if (((i - start) != (cpu.cpu -perf_cpu_map__cpu (map, start).cpu)) || last) {int end = i -1 ;if (start == end) { ret +=snprintf (buf + ret, size - ret,"%s%d" ,COMMA , - map->map[start].cpu); +perf_cpu_map__cpu (map, start).cpu); }else { ret +=snprintf (buf + ret, size - ret,"%s%d-%d" ,COMMA , - map->map[start].cpu, map->map[end].cpu); +perf_cpu_map__cpu (map, start).cpu, +perf_cpu_map__cpu (map, end).cpu); } first = false; start = i;
@@ -633,7 +631,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)int i, cpu;char *ptr = buf;unsigned char *bitmap; -struct perf_cpu last_cpu =perf_cpu_map__cpu (map, map->nr -1 ); +struct perf_cpu last_cpu =perf_cpu_map__cpu (map,perf_cpu_map__nr (map) -1 );if (buf ==NULL )return 0 ;
@@ -644,7 +642,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)return 0 ; } -for (i =0 ; i < map->nr; i++) { +for (i =0 ; i <perf_cpu_map__nr (map); i++) { cpu =perf_cpu_map__cpu (map, i).cpu; bitmap[cpu /8 ] |=1 << (cpu %8 ); }
tools/perf/util/pmu.c +4 -4
@@ -2016,13 +2016,13 @@ int perf_pmu__cpus_match(struct perf_pmu *pmu, struct perf_cpu_map *cpus,perf_cpu_map__for_each_cpu (cpu, i, cpus) {if (!perf_cpu_map__has (pmu_cpus, cpu)) - unmatched_cpus->map[unmatched_nr++] = cpu; +RC_CHK_ACCESS (unmatched_cpus)->map[unmatched_nr++] = cpu;else - matched_cpus->map[matched_nr++] = cpu; +RC_CHK_ACCESS (matched_cpus)->map[matched_nr++] = cpu; } - unmatched_cpus->nr = unmatched_nr; - matched_cpus->nr = matched_nr; +RC_CHK_ACCESS (unmatched_cpus)->nr = unmatched_nr; +RC_CHK_ACCESS (matched_cpus)->nr = matched_nr; *mcpus_ptr = matched_cpus; *ucpus_ptr = unmatched_cpus;return 0 ;
Signature · 1 line
2.40.0.577.gac1e443424-goog
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
Em Fri, Apr 07, 2023 at 04:04:02PM -0700, Ian Rogers escreveu:
Quoted 7 lines
Enabled when
REFCNT_CHECKINGis defined. The change adds a memory allocated pointer that is interposed between the reference counted cpu map at a get and freed by a put. The pointer replaces the originalperf_cpu_mapstruct, so use of theperf_cpu_mapvia APIs remains unchanged. Any use of the cpu map without the API requires two versions, handled via theRC_CHK_ACCESSmacro.
Quoted 9 lines
This change is intended to catch:
- use after put: using a cpumap after you have put it will cause a segv.
- unbalanced puts: two puts for a get will result in a double free that can be captured and reported by tools like address sanitizer, including with the associated stack traces of allocation and frees.
- missing puts: if a put is missing then the get turns into a memory leak that can be reported by leak sanitizer, including the stack trace at the point the get occurs.
I think this should be further split into self contained patches as it does:
1. The use of the RC_ macros wrapping, that should be all on the same patch as to allow, after applying it, to test with REFCNT_CHECKING set.
2. Exports perf_cpu_map__alloc() from libperf for use in tools/perf
And its usage should be on a separate patch:
tools/perf/util/cpumap.c size_t cpu_map__fprintf(struct perf_cpu_map *map, FILE *fp) · line 163
Quoted 2 lines
tools/perf/util/cpumap.c +1
-1-struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (int ) * nr); +struct perf_cpu_map *cpus =perf_cpu_map__alloc (nr);
3. Shouldn't we have a map__refcnt(map) accessor to avoid using those verbose macros outside the object that is having its reference counts checked?
i.e. to avoid this:
Quoted 1 line
+
TEST_ASSERT_VAL("wrong refcnt", refcount_read(&RC_CHK_ACCESS(map)->refcnt) == 1);
Even in the class main file it would help:
tools/lib/perf/cpumap.c struct perf_cpu_map *perf_cpu_map__dummy_new(void) · line 42
Quoted 10 lines
static void
cpu_map__delete(struct perf_cpu_map *map){ if (map) {tools/lib/perf/cpumap.c +2
-2-WARN_ONCE (refcount_read (&map->refcnt) !=0 , +WARN_ONCE (refcount_read (&RC_CHK_ACCESS (map)->refcnt) !=0 ,"cpu_map refcnt unbalanced\n" ); -free (map); +RC_CHK_FREE (map); } }
These are missing convertions that should be in a separate patch, no?
Quoted 10 lines
tools/perf/util/cpumap.c +1
-1@@ -239,7 +236,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, {int idx;struct perf_cpu cpu; -struct cpu_aggr_map *c =cpu_aggr_map__empty_new (cpus->nr); +struct cpu_aggr_map *c =cpu_aggr_map__empty_new (perf_cpu_map__nr (cpus));if (!c)return NULL ;
tools/perf/util/cpumap.c struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, · line 266
Quoted 8 lines
tools/perf/util/cpumap.c +1
-1@@ -263,7 +260,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, } }/* Trim. */ -if (c->nr != cpus->nr) { +if (c->nr !=perf_cpu_map__nr (cpus)) {struct cpu_aggr_map *trimmed_c =realloc (c,sizeof (struct cpu_aggr_map ) +sizeof (struct aggr_cpu_id ) * c->nr);
These should be in a separate patchset using a new perf_cpu_map__set_nr() macro:
tools/perf/util/pmu.c int perf_pmu__cpus_match(struct perf_pmu *pmu, struct perf_cpu_map *cpus, · line 2025
Quoted 2 lines
tools/perf/util/pmu.c +2
-0+RC_CHK_ACCESS (unmatched_cpus)->nr = unmatched_nr; +RC_CHK_ACCESS (matched_cpus)->nr = matched_nr;
And I wonder how we could make this less of an eye sore, internationalization on userspace source code define:
#define _(msg) gettext(msg)
To avoid having all strings wrapped with the long "gettext(" prefix, I wonder if we can't have something like:
#define _(map) RC_CHK_ACCESS(map)
So that the patches become:
- matched_cpus->nr
+ _(matched_cpus)->nr
Since wrapping accesses takes place more than checking a free, get or put? If _ is considered too extreme even with the gettext precedent, and being something local, i.e. just inside cpumap.c, then maybe we can have a:
#define map_ptr(map) RC_CHK_ACCESS(map)
- matched_cpus->nr
+ map__ptr(matched_cpus)->nr
But overall trying to reduce the impact on source code readability with all these macros is something we should think a bit more :-\
The accessors that were already merged are nice and clean and provide a way to hook these checks in a single source file, that was good. With map__refcnt() we reduce it a bit more, so we're making progress.
Thanks for working on this!
- Arnaldo
Quoted 446 lines
Signed-off-by Ian Rogers <[email protected]>--- tools/lib/perf/Makefile | 2 +- tools/lib/perf/cpumap.c | 94 +++++++++++++----------- tools/lib/perf/include/internal/cpumap.h | 4 +- tools/perf/tests/cpumap.c | 4 +- tools/perf/util/cpumap.c | 40 +++++----- tools/perf/util/pmu.c | 8 +- 6 files changed, 81 insertions(+), 71 deletions(-)tools/lib/perf/Makefile +1
-1@@ -188,7 +188,7 @@ install_lib: libs cp -fpR $(LIBPERF_ALL) $(DESTDIR)$(libdir_SQ) HDRS := bpf_perf.h core.h cpumap.h threadmap.h evlist.h evsel.h event.h mmap.h -INTERNAL_HDRS := cpumap.h evlist.h evsel.h lib.h mmap.h threadmap.h xyarray.h +INTERNAL_HDRS := cpumap.h evlist.h evsel.h lib.h mmap.h rc_check.h threadmap.h xyarray.h INSTALL_HDRS_PFX := $(DESTDIR)$(prefix)/include/perf INSTALL_HDRS := $(addprefix $(INSTALL_HDRS_PFX)/, $(HDRS))tools/lib/perf/cpumap.c +52
-42@@ -10,16 +10,16 @@#include <ctype.h> #include <limits.h> -static struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus) +struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus) { -struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (struct perf_cpu ) * nr_cpus); - -if (cpus !=NULL ) { +struct perf_cpu_map *result; +RC_STRUCT (perf_cpu_map) *cpus = +malloc (sizeof (*cpus) +sizeof (struct perf_cpu ) * nr_cpus); +if (ADD_RC_CHK (result, cpus)) { cpus->nr = nr_cpus;refcount_set (&cpus->refcnt,1 ); - } -return cpus; +return result; }struct perf_cpu_map *perf_cpu_map__dummy_new (void )@@ -27,7 +27,7 @@ struct perf_cpu_map *perf_cpu_map__dummy_new(void)struct perf_cpu_map *cpus =perf_cpu_map__alloc (1 );if (cpus) - cpus->map[0 ].cpu =-1 ; +RC_CHK_ACCESS (cpus)->map[0 ].cpu =-1 ;return cpus; }@@ -35,23 +35,30 @@ struct perf_cpu_map *perf_cpu_map__dummy_new(void)static void cpu_map__delete (struct perf_cpu_map *map) {if (map) { -WARN_ONCE (refcount_read (&map->refcnt) !=0 , +WARN_ONCE (refcount_read (&RC_CHK_ACCESS (map)->refcnt) !=0 ,"cpu_map refcnt unbalanced\n" ); -free (map); +RC_CHK_FREE (map); } }struct perf_cpu_map *perf_cpu_map__get (struct perf_cpu_map *map) { -if (map) -refcount_inc (&map->refcnt); -return map; +struct perf_cpu_map *result; + +if (RC_CHK_GET (result, map)) +refcount_inc (&RC_CHK_ACCESS (map)->refcnt); + +return result; }void perf_cpu_map__put (struct perf_cpu_map *map) { -if (map &&refcount_dec_and_test (&map->refcnt)) -cpu_map__delete (map); +if (map) { +if (refcount_dec_and_test (&RC_CHK_ACCESS (map)->refcnt)) +cpu_map__delete (map); +else +RC_CHK_PUT (map); + } }static struct perf_cpu_map *cpu_map__default_new (void )@@ -68,7 +75,7 @@ static struct perf_cpu_map *cpu_map__default_new(void)int i;for (i =0 ; i < nr_cpus; ++i) - cpus->map[i].cpu = i; +RC_CHK_ACCESS (cpus)->map[i].cpu = i; }return cpus;@@ -94,15 +101,16 @@ static struct perf_cpu_map *cpu_map__trim_new(int nr_cpus, const struct perf_cpuint i, j;if (cpus !=NULL ) { -memcpy (cpus->map, tmp_cpus, payload_size); -qsort (cpus->map, nr_cpus,sizeof (struct perf_cpu ), cmp_cpu); +memcpy (RC_CHK_ACCESS (cpus)->map, tmp_cpus, payload_size); +qsort (RC_CHK_ACCESS (cpus)->map, nr_cpus,sizeof (struct perf_cpu ), cmp_cpu);/* Remove dups */ j =0 ;for (i =0 ; i < nr_cpus; i++) { -if (i ==0 || cpus->map[i].cpu != cpus->map[i -1 ].cpu) - cpus->map[j++].cpu = cpus->map[i].cpu; +if (i ==0 || +RC_CHK_ACCESS (cpus)->map[i].cpu !=RC_CHK_ACCESS (cpus)->map[i -1 ].cpu) +RC_CHK_ACCESS (cpus)->map[j++].cpu =RC_CHK_ACCESS (cpus)->map[i].cpu; } - cpus->nr = j; +RC_CHK_ACCESS (cpus)->nr = j;assert (j <= nr_cpus); }return cpus;@@ -263,20 +271,20 @@ struct perf_cpu perf_cpu_map__cpu(const struct perf_cpu_map *cpus, int idx) .cpu = -1 }; -if (cpus && idx < cpus->nr) -return cpus->map[idx]; +if (cpus && idx <RC_CHK_ACCESS (cpus)->nr) +return RC_CHK_ACCESS (cpus)->map[idx];return result; }int perf_cpu_map__nr (const struct perf_cpu_map *cpus) { -return cpus ? cpus->nr :1 ; +return cpus ?RC_CHK_ACCESS (cpus)->nr :1 ; }bool perf_cpu_map__empty (const struct perf_cpu_map *map) { -return map ? map->map[0 ].cpu ==-1 : true; +return map ?RC_CHK_ACCESS (map)->map[0 ].cpu ==-1 : true; }int perf_cpu_map__idx (const struct perf_cpu_map *cpus,struct perf_cpu cpu)@@ -287,10 +295,10 @@ int perf_cpu_map__idx(const struct perf_cpu_map *cpus, struct perf_cpu cpu)return -1 ; low =0 ; - high = cpus->nr; + high =RC_CHK_ACCESS (cpus)->nr;while (low < high) {int idx = (low + high) /2 ; -struct perf_cpu cpu_at_idx = cpus->map[idx]; +struct perf_cpu cpu_at_idx =RC_CHK_ACCESS (cpus)->map[idx];if (cpu_at_idx.cpu == cpu.cpu)return idx;@@ -316,7 +324,9 @@ struct perf_cpu perf_cpu_map__max(const struct perf_cpu_map *map) };// cpu_map__trim_new() qsort()s it, cpu_map__default_new() sorts it as well. -return map->nr >0 ? map->map[map->nr -1 ] : result; +return RC_CHK_ACCESS (map)->nr >0 + ?RC_CHK_ACCESS (map)->map[RC_CHK_ACCESS (map)->nr -1 ] + : result; }/** Is 'b' a subset of 'a'. */ @@ -324,15 +334,15 @@ bool perf_cpu_map__is_subset(const struct perf_cpu_map *a, const struct perf_cpu {if (a == b || !b)return true; -if (!a || b->nr > a->nr) +if (!a ||RC_CHK_ACCESS (b)->nr >RC_CHK_ACCESS (a)->nr)return false; -for (int i =0 , j =0 ; i < a->nr; i++) { -if (a->map[i].cpu > b->map[j].cpu) +for (int i =0 , j =0 ; i <RC_CHK_ACCESS (a)->nr; i++) { +if (RC_CHK_ACCESS (a)->map[i].cpu >RC_CHK_ACCESS (b)->map[j].cpu)return false; -if (a->map[i].cpu == b->map[j].cpu) { +if (RC_CHK_ACCESS (a)->map[i].cpu ==RC_CHK_ACCESS (b)->map[j].cpu) { j++; -if (j == b->nr) +if (j ==RC_CHK_ACCESS (b)->nr)return true; } }@@ -362,27 +372,27 @@ struct perf_cpu_map *perf_cpu_map__merge(struct perf_cpu_map *orig,return perf_cpu_map__get (other); } - tmp_len = orig->nr + other->nr; + tmp_len =RC_CHK_ACCESS (orig)->nr +RC_CHK_ACCESS (other)->nr; tmp_cpus =malloc (tmp_len *sizeof (struct perf_cpu ));if (!tmp_cpus)return NULL ;/* Standard merge algorithm from wikipedia */ i = j = k =0 ; -while (i < orig->nr && j < other->nr) { -if (orig->map[i].cpu <= other->map[j].cpu) { -if (orig->map[i].cpu == other->map[j].cpu) +while (i <RC_CHK_ACCESS (orig)->nr && j <RC_CHK_ACCESS (other)->nr) { +if (RC_CHK_ACCESS (orig)->map[i].cpu <=RC_CHK_ACCESS (other)->map[j].cpu) { +if (RC_CHK_ACCESS (orig)->map[i].cpu ==RC_CHK_ACCESS (other)->map[j].cpu) j++; - tmp_cpus[k++] = orig->map[i++]; + tmp_cpus[k++] =RC_CHK_ACCESS (orig)->map[i++]; }else - tmp_cpus[k++] = other->map[j++]; + tmp_cpus[k++] =RC_CHK_ACCESS (other)->map[j++]; } -while (i < orig->nr) - tmp_cpus[k++] = orig->map[i++]; +while (i <RC_CHK_ACCESS (orig)->nr) + tmp_cpus[k++] =RC_CHK_ACCESS (orig)->map[i++]; -while (j < other->nr) - tmp_cpus[k++] = other->map[j++]; +while (j <RC_CHK_ACCESS (other)->nr) + tmp_cpus[k++] =RC_CHK_ACCESS (other)->map[j++];assert (k <= tmp_len); merged =cpu_map__trim_new (k, tmp_cpus);tools/lib/perf/include/internal/cpumap.h +3
-1@@ -4,6 +4,7 @@#include <linux/refcount.h> #include <perf/cpumap.h> +#include <internal/rc_check.h> /** * A sized, reference counted, sorted array of integers representing CPU @@ -12,7 +13,7 @@* gaps if CPU numbers were used. For events associated with a pid, rather than * a CPU, a single dummy map with an entry of -1 is used. */ -struct perf_cpu_map { +DECLARE_RC_STRUCT (perf_cpu_map) {refcount_t refcnt;/** Length of the map array. */ int nr;@@ -24,6 +25,7 @@ struct perf_cpu_map {#define MAX_NR_CPUS 2048#endif +struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus);int perf_cpu_map__idx (const struct perf_cpu_map *cpus,struct perf_cpu cpu);bool perf_cpu_map__is_subset (const struct perf_cpu_map *a,const struct perf_cpu_map *b);tools/perf/tests/cpumap.c +2
-2@@ -68,7 +68,7 @@ static int process_event_cpus(struct perf_tool *tool __maybe_unused,TEST_ASSERT_VAL ("wrong nr" ,perf_cpu_map__nr (map) ==2 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,0 ).cpu ==1 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,1 ).cpu ==256 ); -TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&map->refcnt) ==1 ); +TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (map)->refcnt) ==1 );perf_cpu_map__put (map);return 0 ; }@@ -94,7 +94,7 @@ static int process_event_range_cpus(struct perf_tool *tool __maybe_unused,TEST_ASSERT_VAL ("wrong nr" ,perf_cpu_map__nr (map) ==256 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,0 ).cpu ==1 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__max (map).cpu ==256 ); -TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&map->refcnt) ==1 ); +TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (map)->refcnt) ==1 );perf_cpu_map__put (map);return 0 ; }tools/perf/util/cpumap.c +19
-21@@ -77,9 +77,9 @@ static struct perf_cpu_map *cpu_map__from_entries(const struct perf_record_cpu_m* otherwise it would become 65535. */ if (data->cpus_data.cpu[i] == (u16) -1 ) - map->map[i].cpu =-1 ; +RC_CHK_ACCESS (map)->map[i].cpu =-1 ;else - map->map[i].cpu = (int ) data->cpus_data.cpu[i]; +RC_CHK_ACCESS (map)->map[i].cpu = (int ) data->cpus_data.cpu[i]; } }@@ -107,7 +107,7 @@ static struct perf_cpu_map *cpu_map__from_mask(const struct perf_record_cpu_map_perf_record_cpu_map_data__read_one_mask (data, i, local_copy);for_each_set_bit (cpu, local_copy,64 ) - map->map[j++].cpu = cpu + cpus_per_i; +RC_CHK_ACCESS (map)->map[j++].cpu = cpu + cpus_per_i; }return map;@@ -124,11 +124,11 @@ static struct perf_cpu_map *cpu_map__from_range(const struct perf_record_cpu_mapreturn NULL ;if (data->range_cpu_data.any_cpu) - map->map[i++].cpu =-1 ; +RC_CHK_ACCESS (map)->map[i++].cpu =-1 ;for (int cpu = data->range_cpu_data.start_cpu; cpu <= data->range_cpu_data.end_cpu; i++, cpu++) - map->map[i].cpu = cpu; +RC_CHK_ACCESS (map)->map[i].cpu = cpu;return map; }@@ -160,16 +160,13 @@ size_t cpu_map__fprintf(struct perf_cpu_map *map, FILE *fp)struct perf_cpu_map *perf_cpu_map__empty_new (int nr) { -struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (int ) * nr); +struct perf_cpu_map *cpus =perf_cpu_map__alloc (nr);if (cpus !=NULL ) {int i; - cpus->nr = nr;for (i =0 ; i < nr; i++) - cpus->map[i].cpu =-1 ; - -refcount_set (&cpus->refcnt,1 ); +RC_CHK_ACCESS (cpus)->map[i].cpu =-1 ; }return cpus;@@ -239,7 +236,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, {int idx;struct perf_cpu cpu; -struct cpu_aggr_map *c =cpu_aggr_map__empty_new (cpus->nr); +struct cpu_aggr_map *c =cpu_aggr_map__empty_new (perf_cpu_map__nr (cpus));if (!c)return NULL ;@@ -263,7 +260,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, } }/* Trim. */ -if (c->nr != cpus->nr) { +if (c->nr !=perf_cpu_map__nr (cpus)) {struct cpu_aggr_map *trimmed_c =realloc (c,sizeof (struct cpu_aggr_map ) +sizeof (struct aggr_cpu_id ) * c->nr);@@ -582,31 +579,32 @@ size_t cpu_map__snprint(struct perf_cpu_map *map, char *buf, size_t size)#define COMMA first ? "" : "," -for (i =0 ; i < map->nr +1 ; i++) { +for (i =0 ; i <perf_cpu_map__nr (map) +1 ; i++) {struct perf_cpu cpu = { .cpu =INT_MAX }; -bool last = i == map->nr; +bool last = i ==perf_cpu_map__nr (map);if (!last) - cpu = map->map[i]; + cpu =perf_cpu_map__cpu (map, i);if (start ==-1 ) { start = i;if (last) { ret +=snprintf (buf + ret, size - ret,"%s%d" ,COMMA , - map->map[i].cpu); +perf_cpu_map__cpu (map, i).cpu); } - }else if (((i - start) != (cpu.cpu - map->map[start].cpu)) || last) { + }else if (((i - start) != (cpu.cpu -perf_cpu_map__cpu (map, start).cpu)) || last) {int end = i -1 ;if (start == end) { ret +=snprintf (buf + ret, size - ret,"%s%d" ,COMMA , - map->map[start].cpu); +perf_cpu_map__cpu (map, start).cpu); }else { ret +=snprintf (buf + ret, size - ret,"%s%d-%d" ,COMMA , - map->map[start].cpu, map->map[end].cpu); +perf_cpu_map__cpu (map, start).cpu, +perf_cpu_map__cpu (map, end).cpu); } first = false; start = i;@@ -633,7 +631,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)int i, cpu;char *ptr = buf;unsigned char *bitmap; -struct perf_cpu last_cpu =perf_cpu_map__cpu (map, map->nr -1 ); +struct perf_cpu last_cpu =perf_cpu_map__cpu (map,perf_cpu_map__nr (map) -1 );if (buf ==NULL )return 0 ;@@ -644,7 +642,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)return 0 ; } -for (i =0 ; i < map->nr; i++) { +for (i =0 ; i <perf_cpu_map__nr (map); i++) { cpu =perf_cpu_map__cpu (map, i).cpu; bitmap[cpu /8 ] |=1 << (cpu %8 ); }tools/perf/util/pmu.c +4
-4@@ -2016,13 +2016,13 @@ int perf_pmu__cpus_match(struct perf_pmu *pmu, struct perf_cpu_map *cpus,perf_cpu_map__for_each_cpu (cpu, i, cpus) {if (!perf_cpu_map__has (pmu_cpus, cpu)) - unmatched_cpus->map[unmatched_nr++] = cpu; +RC_CHK_ACCESS (unmatched_cpus)->map[unmatched_nr++] = cpu;else - matched_cpus->map[matched_nr++] = cpu; +RC_CHK_ACCESS (matched_cpus)->map[matched_nr++] = cpu; } - unmatched_cpus->nr = unmatched_nr; - matched_cpus->nr = matched_nr; +RC_CHK_ACCESS (unmatched_cpus)->nr = unmatched_nr; +RC_CHK_ACCESS (matched_cpus)->nr = matched_nr; *mcpus_ptr = matched_cpus; *ucpus_ptr = unmatched_cpus;return 0 ;Signature · 1 line
2.40.0.577.gac1e443424-goog
Signature · 1 line
- Arnaldo
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
Em Tue, Apr 11, 2023 at 03:19:06PM -0300, Arnaldo Carvalho de Melo escreveu:
Quoted 11 lines
Em Fri, Apr 07, 2023 at 04:04:02PM -0700, Ian Rogers escreveu:
Quoted 9 lines
This change is intended to catch:
- use after put: using a cpumap after you have put it will cause a segv.
- unbalanced puts: two puts for a get will result in a double free that can be captured and reported by tools like address sanitizer, including with the associated stack traces of allocation and frees.
- missing puts: if a put is missing then the get turns into a memory leak that can be reported by leak sanitizer, including the stack trace at the point the get occurs.
Quoted 6 lines
I think this should be further split into self contained patches as it does:
3. Shouldn't we have a
map__refcnt(map)accessor to avoid using those verbose macros outside the object that is having its reference counts checked?
So I added this one, in the end its just to avoid
From 997a7909789d5b5570dc3cfcd1b9f03877f544bd Mon Sep 17 00:00:00 2001
From: Arnaldo Carvalho de Melo <[email protected]>
Date: Wed, 12 Apr 2023 12:36:58 -0300
Subject: [PATCH 1/1] perf map: Add map__refcnt() accessor to use in the maps
test
To remove one more direct access to 'struct map' so that we can intecept accesses to its instantiations and refcount check it to catch use after free, etc.
--- tools/perf/tests/maps.c | 4 ++-- tools/perf/util/map.h | 5 +++++ 2 files changed, 7 insertions(+), 2 deletions(-)
tools/perf/tests/maps.c +2 -2
@@ -30,7 +30,7 @@ static int check_maps(struct map_def *merged, unsigned int size, struct maps *maif (map__start (map) != merged[i].start ||map__end (map) != merged[i].end ||strcmp (map__dso (map)->name, merged[i].name) || -refcount_read (&map->refcnt) !=1 ) { +refcount_read (map__refcnt (map)) !=1 ) { failed = true; } i++;
@@ -50,7 +50,7 @@ static int check_maps(struct map_def *merged, unsigned int size, struct maps *mamap__start (map),map__end (map),map__dso (map)->name, - refcount_read(&map->refcnt)); + refcount_read(map__refcnt(map))); } }return failed ?TEST_FAIL :TEST_OK ;
tools/perf/util/map.h +5 -0
@@ -97,6 +97,11 @@ static inline bool map__priv(const struct map *map)return map->priv; } +static inline refcount_t *map__refcnt (struct map *map) +{ +return &map->refcnt; +} +static inline size_t map__size (const struct map *map) {return map__end (map) -map__start (map);
Signature · 1 line
2.39.2
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
In reply to Arnaldo Carvalho de MeloEm Tue, Apr 11, 2023 at 03:19:06PM -0300, Arnaldo Carvalho de Melo escreveu:
Quoted 23 lines
Em Fri, Apr 07, 2023 at 04:04:02PM -0700, Ian Rogers escreveu:
Quoted 9 lines
This change is intended to catch:
- use after put: using a cpumap after you have put it will cause a segv.
- unbalanced puts: two puts for a get will result in a double free that can be captured and reported by tools like address sanitizer, including with the associated stack traces of allocation and frees.
- missing puts: if a put is missing then the get turns into a memory leak that can be reported by leak sanitizer, including the stack trace at the point the get occurs.I think this should be further split into self contained patches as it does:
These are missing convertions that should be in a separate patch, no?
Quoted 7 lines
(quoted diff) +1
-1@@ -239,7 +236,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, { int idx; struct perf_cpu cpu; - struct cpu_aggr_map *c = cpu_aggr_map__empty_new(cpus->nr); + struct cpu_aggr_map *c = cpu_aggr_map__empty_new(perf_cpu_map__nr(cpus));
Quoted 2 lines
Review struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, · line 242
Quoted 2 lines
(quoted diff) +0
-0if (!c) return NULL;
Extracted this from your larger patch:
From f8a23fce48400168be0cc078a0b0bd0e7d4a889f Mon Sep 17 00:00:00 2001
From: Ian Rogers <[email protected]>
Date: Wed, 12 Apr 2023 12:45:45 -0300
Subject: [PATCH 1/1] perf cpumap: Use perf_cpu_map__nr(cpus) to access
cpus->nr
So that we can have a single point where to refcount check 'struct perf_cpu_map' instances for use after free, etc.
--- tools/perf/util/cpumap.c | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-)
tools/perf/util/cpumap.c +6 -6
@@ -239,7 +239,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, {int idx;struct perf_cpu cpu; -struct cpu_aggr_map *c =cpu_aggr_map__empty_new (cpus->nr); +struct cpu_aggr_map *c =cpu_aggr_map__empty_new (perf_cpu_map__nr (cpus));if (!c)return NULL ;
@@ -263,7 +263,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, } }/* Trim. */ -if (c->nr != cpus->nr) { +if (c->nr !=perf_cpu_map__nr (cpus)) {struct cpu_aggr_map *trimmed_c =realloc (c,sizeof (struct cpu_aggr_map ) +sizeof (struct aggr_cpu_id ) * c->nr);
@@ -582,9 +582,9 @@ size_t cpu_map__snprint(struct perf_cpu_map *map, char *buf, size_t size)#define COMMA first ? "" : "," -for (i =0 ; i < map->nr +1 ; i++) { +for (i =0 ; i <perf_cpu_map__nr (map) +1 ; i++) {struct perf_cpu cpu = { .cpu =INT_MAX }; -bool last = i == map->nr; +bool last = i ==perf_cpu_map__nr (map);if (!last) cpu = map->map[i];
@@ -633,7 +633,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)int i, cpu;char *ptr = buf;unsigned char *bitmap; -struct perf_cpu last_cpu =perf_cpu_map__cpu (map, map->nr -1 ); +struct perf_cpu last_cpu =perf_cpu_map__cpu (map,perf_cpu_map__nr (map) -1 );if (buf ==NULL )return 0 ;
@@ -644,7 +644,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)return 0 ; } -for (i =0 ; i < map->nr; i++) { +for (i =0 ; i <perf_cpu_map__nr (map); i++) { cpu =perf_cpu_map__cpu (map, i).cpu; bitmap[cpu /8 ] |=1 << (cpu %8 ); }
Signature · 1 line
2.39.2
Ian Rogers
reviewerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
Quoted 30 lines · Arnaldo Carvalho de Melo
Em Tue, Apr 11, 2023 at 03:19:06PM -0300, Arnaldo Carvalho de Melo escreveu:
Quoted 23 lines
Em Fri, Apr 07, 2023 at 04:04:02PM -0700, Ian Rogers escreveu:
Quoted 9 lines
This change is intended to catch:
- use after put: using a cpumap after you have put it will cause a segv.
- unbalanced puts: two puts for a get will result in a double free that can be captured and reported by tools like address sanitizer, including with the associated stack traces of allocation and frees.
- missing puts: if a put is missing then the get turns into a memory leak that can be reported by leak sanitizer, including the stack trace at the point the get occurs.I think this should be further split into self contained patches as it does:
These are missing convertions that should be in a separate patch, no?
Quoted 7 lines
tools/perf/util/cpumap.c +1
-1@@ -239,7 +236,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, {int idx;struct perf_cpu cpu; -struct cpu_aggr_map *c =cpu_aggr_map__empty_new (cpus->nr); +struct cpu_aggr_map *c =cpu_aggr_map__empty_new (perf_cpu_map__nr (cpus));Quoted 2 lines
tools/perf/util/cpumap.c struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, · line 245
Quoted 2 lines
tools/perf/util/cpumap.c +0
-0if (!c)return NULL ;Extracted this from your larger patch:
Quoted 8 lines
From
f8a23fce48400168be0cc078a0b0bd0e7d4a889fMon Sep 17 00:00:00 2001
From: Ian Rogers <[email protected]>
Date: Wed, 12 Apr 2023 12:45:45 -0300
Subject: [PATCH 1/1] perf cpumap: Useperf_cpu_map__nr(cpus)to access
cpus->nrSo that we can have a single point where to refcount check 'struct
perf_cpu_map' instances for use after free, etc.
Thanks! In one of your previous messages you mentioned adding some setters for cpu_map to bury the macro usage. As cpu maps are immutable, can we make these internal APIs? Other than that, thanks for helping to get this landed!
Ian
Quoted 70 lines
Signed-off-by Ian Rogers <[email protected]>Cc Adrian Hunter <[email protected]>Cc Alexey Bayduraev <[email protected]>Cc Dmitriy Vyukov <[email protected]>Cc Jiri Olsa <[email protected]>Cc Namhyung Kim <[email protected]>Cc Riccardo Mancini <[email protected]>Cc Stephane Eranian <[email protected]>Cc Stephen Brennan <[email protected]>Signed-off-by Arnaldo Carvalho de Melo <[email protected]>--- tools/perf/util/cpumap.c | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-)tools/perf/util/cpumap.c +6
-7@@ -239,7 +239,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, {int idx;struct perf_cpu cpu; -struct cpu_aggr_map *c =cpu_aggr_map__empty_new (cpus->nr); +struct cpu_aggr_map *c =cpu_aggr_map__empty_new (perf_cpu_map__nr (cpus));if (!c)return NULL ;@@ -263,7 +263,7 @@ struct cpu_aggr_map *cpu_aggr_map__new(const struct perf_cpu_map *cpus, } }/* Trim. */ -if (c->nr != cpus->nr) { +if (c->nr !=perf_cpu_map__nr (cpus)) {struct cpu_aggr_map *trimmed_c =realloc (c,sizeof (struct cpu_aggr_map ) +sizeof (struct aggr_cpu_id ) * c->nr);@@ -582,9 +582,9 @@ size_t cpu_map__snprint(struct perf_cpu_map *map, char *buf, size_t size)#define COMMA first ? "" : "," -for (i =0 ; i < map->nr +1 ; i++) { +for (i =0 ; i <perf_cpu_map__nr (map) +1 ; i++) {struct perf_cpu cpu = { .cpu =INT_MAX }; -bool last = i == map->nr; +bool last = i ==perf_cpu_map__nr (map);if (!last) cpu = map->map[i];@@ -633,7 +633,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)int i, cpu;char *ptr = buf;unsigned char *bitmap; -struct perf_cpu last_cpu =perf_cpu_map__cpu (map, map->nr -1 ); +struct perf_cpu last_cpu =perf_cpu_map__cpu (map,perf_cpu_map__nr (map) -1 );if (buf ==NULL )return 0 ;@@ -644,7 +644,7 @@ size_t cpu_map__snprint_mask(struct perf_cpu_map *map, char *buf, size_t size)return 0 ; } -for (i =0 ; i < map->nr; i++) { +for (i =0 ; i <perf_cpu_map__nr (map); i++) { cpu =perf_cpu_map__cpu (map, i).cpu; bitmap[cpu /8 ] |=1 << (cpu %8 ); } --2.39.2
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
In reply to Arnaldo Carvalho de MeloEm Tue, Apr 11, 2023 at 03:19:06PM -0300, Arnaldo Carvalho de Melo escreveu:
Quoted 11 lines
Em Fri, Apr 07, 2023 at 04:04:02PM -0700, Ian Rogers escreveu:
Quoted 9 lines
This change is intended to catch:
- use after put: using a cpumap after you have put it will cause a segv.
- unbalanced puts: two puts for a get will result in a double free that can be captured and reported by tools like address sanitizer, including with the associated stack traces of allocation and frees.
- missing puts: if a put is missing then the get turns into a memory leak that can be reported by leak sanitizer, including the stack trace at the point the get occurs.
Quoted 9 lines
I think this should be further split into self contained patches as it does:
2. Exports
perf_cpu_map__alloc()from libperf for use intools/perfAnd its usage should be on a separate patch:
Quoted 2 lines
(quoted diff) +1
-1- struct perf_cpu_map *cpus = malloc(sizeof(*cpus) + sizeof(int) * nr); + struct perf_cpu_map *cpus = perf_cpu_map__alloc(nr);
From 1f94479edb4decdcec3e902528abb47f0ccd5d16 Mon Sep 17 00:00:00 2001
From: Ian Rogers <[email protected]>
Date: Wed, 12 Apr 2023 12:54:44 -0300
Subject: [PATCH 1/1] libperf: Make perf_cpu_map__alloc() available as an
internal function for tools/perf to use
We had the open coded equivalent in perf_cpu_map__empty_new(), so reuse what is in libperf.
--- tools/lib/perf/cpumap.c | 2 +- tools/lib/perf/include/internal/cpumap.h | 1 + tools/perf/util/cpumap.c | 2 +- 3 files changed, 3 insertions(+), 2 deletions(-)
tools/lib/perf/cpumap.c +1 -1
@@ -10,7 +10,7 @@#include <ctype.h> #include <limits.h> -static struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus) +struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus) {struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (struct perf_cpu ) * nr_cpus);
tools/lib/perf/include/internal/cpumap.h +1 -0
@@ -24,6 +24,7 @@ struct perf_cpu_map {#define MAX_NR_CPUS 2048#endif +struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus);int perf_cpu_map__idx (const struct perf_cpu_map *cpus,struct perf_cpu cpu);bool perf_cpu_map__is_subset (const struct perf_cpu_map *a,const struct perf_cpu_map *b);
tools/perf/util/cpumap.c +1 -1
@@ -160,7 +160,7 @@ size_t cpu_map__fprintf(struct perf_cpu_map *map, FILE *fp)struct perf_cpu_map *perf_cpu_map__empty_new (int nr) { -struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (int ) * nr); +struct perf_cpu_map *cpus =perf_cpu_map__alloc (nr);if (cpus !=NULL ) {int i;
Signature · 1 line
2.39.2
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
In reply to Arnaldo Carvalho de MeloEm Tue, Apr 11, 2023 at 03:19:06PM -0300, Arnaldo Carvalho de Melo escreveu:
Quoted 7 lines
Em Fri, Apr 07, 2023 at 04:04:02PM -0700, Ian Rogers escreveu:
I think this should be further split into self contained patches as it does:
These should be in a separate patchset using a newperf_cpu_map__set_nr()macro:Quoted 2 lines
(quoted diff) +2
-0+ RC_CHK_ACCESS(unmatched_cpus)->nr = unmatched_nr; + RC_CHK_ACCESS(matched_cpus)->nr = matched_nr;
One more, next one will be this:
⬢[acme@toolbox perf-tools-next]$ git diff
tools/perf/util/pmu.c +2 -2
@@ -2020,8 +2020,8 @@ int perf_pmu__cpus_match(struct perf_pmu *pmu, struct perf_cpu_map *cpus, matched_cpus->map[matched_nr++] = cpu; } - unmatched_cpus->nr = unmatched_nr; - matched_cpus->nr = matched_nr; +perf_cpu_map__set_nr (unmatched_cpus, unmatched_nr); +perf_cpu_map__set_nr (matched_cpus, matched_nr); *mcpus_ptr = matched_cpus; *ucpus_ptr = unmatched_cpus;return 0 ;
⬢[acme@toolbox perf-tools-next]$
From b277851417e0149aff5e6986e1ad6e2d8054e4a6 Mon Sep 17 00:00:00 2001
From: Arnaldo Carvalho de Melo <[email protected]>
Date: Wed, 12 Apr 2023 14:53:35 -0300
Subject: [PATCH 1/1] libperf: Add a perf_cpu_map__set_nr() available as an
internal function for tools/perf to use
We'll need to reference count check 'struct perf_cpu_map', so wrap accesses to its internal state to allow intercepting accesses to its instances.
--- tools/lib/perf/cpumap.c | 5 +++++ tools/lib/perf/include/internal/cpumap.h | 2 ++ 2 files changed, 7 insertions(+)
tools/lib/perf/cpumap.c +5 -0
@@ -10,6 +10,11 @@#include <ctype.h> #include <limits.h> +void perf_cpu_map__set_nr (struct perf_cpu_map *map,int nr_cpus) +{ + map->nr = nr_cpus; +} +struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus) {struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (struct perf_cpu ) * nr_cpus);
tools/lib/perf/include/internal/cpumap.h +2 -0
@@ -28,4 +28,6 @@ struct perf_cpu_map *perf_cpu_map__alloc(int nr_cpus);int perf_cpu_map__idx (const struct perf_cpu_map *cpus,struct perf_cpu cpu);bool perf_cpu_map__is_subset (const struct perf_cpu_map *a,const struct perf_cpu_map *b); +void perf_cpu_map__set_nr (struct perf_cpu_map *map,int nr_cpus); +#endif /* __LIBPERF_INTERNAL_CPUMAP_H */
Signature · 1 line
2.39.2
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
In reply to Arnaldo Carvalho de MeloEm Tue, Apr 11, 2023 at 03:19:06PM -0300, Arnaldo Carvalho de Melo escreveu:
Quoted 7 lines
I think this should be further split into self contained patches as it does:
These should be in a separate patchset using a new
perf_cpu_map__set_nr()macro:Quoted 2 lines
(quoted diff) +2
-0+ RC_CHK_ACCESS(unmatched_cpus)->nr = unmatched_nr; + RC_CHK_ACCESS(matched_cpus)->nr = matched_nr;
One more:
From bd346e2074d07031d28b34a56a43fe848f7445ca Mon Sep 17 00:00:00 2001
From: Arnaldo Carvalho de Melo <[email protected]>
Date: Wed, 12 Apr 2023 14:56:28 -0300
Subject: [PATCH 1/1] perf pmu: Use perf_cpu_map__set_nr() in
perf_pmu__cpus_match() to allow for refcnt checking
One more step to allow for checking reference counting, user after free, etc.
--- tools/perf/util/pmu.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
tools/perf/util/pmu.c +2 -2
@@ -2020,8 +2020,8 @@ int perf_pmu__cpus_match(struct perf_pmu *pmu, struct perf_cpu_map *cpus, matched_cpus->map[matched_nr++] = cpu; } - unmatched_cpus->nr = unmatched_nr; - matched_cpus->nr = matched_nr; +perf_cpu_map__set_nr (unmatched_cpus, unmatched_nr); +perf_cpu_map__set_nr (matched_cpus, matched_nr); *mcpus_ptr = matched_cpus; *ucpus_ptr = unmatched_cpus;return 0 ;
Signature · 1 line
2.39.2
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 2/5] perf cpumap: Add reference count checking
In reply to Ian RogersEm Fri, Apr 07, 2023 at 04:04:02PM -0700, Ian Rogers escreveu:
Quoted 68 lines
Enabled when
REFCNT_CHECKINGis defined. The change adds a memory allocated pointer that is interposed between the reference counted cpu map at a get and freed by a put. The pointer replaces the originalperf_cpu_mapstruct, so use of theperf_cpu_mapvia APIs remains unchanged. Any use of the cpu map without the API requires two versions, handled via theRC_CHK_ACCESSmacro.This change is intended to catch:
- use after put: using a cpumap after you have put it will cause a segv.
- unbalanced puts: two puts for a get will result in a double free that can be captured and reported by tools like address sanitizer, including with the associated stack traces of allocation and frees.
- missing puts: if a put is missing then the get turns into a memory leak that can be reported by leak sanitizer, including the stack trace at the point the get occurs.Signed-off-by Ian Rogers <[email protected]>--- tools/lib/perf/Makefile | 2 +- tools/lib/perf/cpumap.c | 94 +++++++++++++----------- tools/lib/perf/include/internal/cpumap.h | 4 +- tools/perf/tests/cpumap.c | 4 +- tools/perf/util/cpumap.c | 40 +++++----- tools/perf/util/pmu.c | 8 +- 6 files changed, 81 insertions(+), 71 deletions(-)tools/lib/perf/Makefile +1
-1@@ -188,7 +188,7 @@ install_lib: libs cp -fpR $(LIBPERF_ALL) $(DESTDIR)$(libdir_SQ) HDRS := bpf_perf.h core.h cpumap.h threadmap.h evlist.h evsel.h event.h mmap.h -INTERNAL_HDRS := cpumap.h evlist.h evsel.h lib.h mmap.h threadmap.h xyarray.h +INTERNAL_HDRS := cpumap.h evlist.h evsel.h lib.h mmap.h rc_check.h threadmap.h xyarray.h INSTALL_HDRS_PFX := $(DESTDIR)$(prefix)/include/perf INSTALL_HDRS := $(addprefix $(INSTALL_HDRS_PFX)/, $(HDRS))tools/lib/perf/cpumap.c +6
-6@@ -10,16 +10,16 @@#include <ctype.h> #include <limits.h> -static struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus) +struct perf_cpu_map *perf_cpu_map__alloc (int nr_cpus) { -struct perf_cpu_map *cpus =malloc (sizeof (*cpus) +sizeof (struct perf_cpu ) * nr_cpus); - -if (cpus !=NULL ) { +struct perf_cpu_map *result; +RC_STRUCT (perf_cpu_map) *cpus = +malloc (sizeof (*cpus) +sizeof (struct perf_cpu ) * nr_cpus); +if (ADD_RC_CHK (result, cpus)) { cpus->nr = nr_cpus;refcount_set (&cpus->refcnt,1 ); - } -return cpus; +return result; }struct perf_cpu_map *perf_cpu_map__dummy_new (void )
tools/lib/perf/cpumap.c struct perf_cpu_map *perf_cpu_map__dummy_new(void) · line 30
Quoted 5 lines
tools/lib/perf/cpumap.c +1
-1@@ -27,7 +27,7 @@ struct perf_cpu_map *perf_cpu_map__dummy_new(void)struct perf_cpu_map *cpus =perf_cpu_map__alloc (1 );if (cpus) - cpus->map[0 ].cpu =-1 ; +RC_CHK_ACCESS (cpus)->map[0 ].cpu =-1 ;
One more:
From 93bbe2e90194f70df537e0ea4836277c316b3050 Mon Sep 17 00:00:00 2001
From: Arnaldo Carvalho de Melo <[email protected]>
Date: Mon, 17 Apr 2023 12:47:49 -0300
Subject: [PATCH 1/1] libperf: Add perf_cpu_map__refcnt() interanl accessor to
use in the maps test
To remove one more direct access to 'struct perf_cpu_map' so that we can intercept accesses to its instantiations and refcount check it to catch use after free, etc.
--- tools/lib/perf/cpumap.c | 6 +++--- tools/lib/perf/include/internal/cpumap.h | 4 ++++ tools/perf/tests/cpumap.c | 4 ++-- 3 files changed, 9 insertions(+), 5 deletions(-)
tools/lib/perf/cpumap.c +3 -3
@@ -40,7 +40,7 @@ struct perf_cpu_map *perf_cpu_map__dummy_new(void)static void cpu_map__delete (struct perf_cpu_map *map) {if (map) { -WARN_ONCE (refcount_read (&map->refcnt) !=0 , +WARN_ONCE (refcount_read (perf_cpu_map__refcnt (map)) !=0 ,"cpu_map refcnt unbalanced\n" );free (map); }
@@ -49,13 +49,13 @@ static void cpu_map__delete(struct perf_cpu_map *map)struct perf_cpu_map *perf_cpu_map__get (struct perf_cpu_map *map) {if (map) -refcount_inc (&map->refcnt); +refcount_inc (perf_cpu_map__refcnt (map));return map; }void perf_cpu_map__put (struct perf_cpu_map *map) { -if (map &&refcount_dec_and_test (&map->refcnt)) +if (map &&refcount_dec_and_test (perf_cpu_map__refcnt (map)))cpu_map__delete (map); }
tools/lib/perf/include/internal/cpumap.h +4 -0
@@ -30,4 +30,8 @@ bool perf_cpu_map__is_subset(const struct perf_cpu_map *a, const struct perf_cpuvoid perf_cpu_map__set_nr (struct perf_cpu_map *map,int nr_cpus); +static inline refcount_t *perf_cpu_map__refcnt (struct perf_cpu_map *map) +{ +return &map->refcnt; +}#endif /* __LIBPERF_INTERNAL_CPUMAP_H */
tools/perf/tests/cpumap.c +2 -2
@@ -68,7 +68,7 @@ static int process_event_cpus(struct perf_tool *tool __maybe_unused,TEST_ASSERT_VAL ("wrong nr" ,perf_cpu_map__nr (map) ==2 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,0 ).cpu ==1 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,1 ).cpu ==256 ); -TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&map->refcnt) ==1 ); +TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (perf_cpu_map__refcnt (map)) ==1 );perf_cpu_map__put (map);return 0 ; }
@@ -94,7 +94,7 @@ static int process_event_range_cpus(struct perf_tool *tool __maybe_unused,TEST_ASSERT_VAL ("wrong nr" ,perf_cpu_map__nr (map) ==256 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__cpu (map,0 ).cpu ==1 );TEST_ASSERT_VAL ("wrong cpu" ,perf_cpu_map__max (map).cpu ==256 ); -TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (&map->refcnt) ==1 ); +TEST_ASSERT_VAL ("wrong refcnt" ,refcount_read (perf_cpu_map__refcnt (map)) ==1 );perf_cpu_map__put (map);return 0 ; }
Signature · 1 line
2.39.2
Ian Rogers
reviewerPATCH v7 3/5 perf namespaces: Add reference count checking
In reply to Ian RogersAdd reference count checking controlled by REFCNT_CHECKING ifdef. The reference count checking interposes an allocated pointer between the reference counted struct on a get and frees the pointer on a put. Accesses after a put cause faults and use after free, missed puts are caughts as leaks and double puts are double frees.
This checking helped resolve a memory leak and use after free:
https://lore.kernel.org/linux-perf-users/CAP-5=fWZH20L4kv-BwVtGLwR=Em3AOOT+Q4QGivvQuYn5AsPRg@mail.gmail.com/
--- tools/perf/builtin-inject.c | 2 +- tools/perf/util/annotate.c | 2 +- tools/perf/util/dso.c | 2 +- tools/perf/util/dsos.c | 2 +- tools/perf/util/namespaces.c | 132 ++++++++++++++++++++--------------- tools/perf/util/namespaces.h | 3 +- tools/perf/util/symbol.c | 2 +- 7 files changed, 83 insertions(+), 62 deletions(-)
tools/perf/builtin-inject.c +1 -1
@@ -632,7 +632,7 @@ static int dso__read_build_id(struct dso *dso)else if (dso->nsinfo) {char *new_name; - new_name =filename_with_chroot (dso->nsinfo->pid, + new_name =filename_with_chroot (RC_CHK_ACCESS (dso->nsinfo)->pid, dso->long_name);if (new_name &&filename__read_build_id (new_name, &dso->bid) >0 ) dso->has_build_id = true;
tools/perf/util/annotate.c +1 -1
@@ -1691,7 +1691,7 @@ static int dso__disassemble_filename(struct dso *dso, char *filename, size_t filmutex_lock (&dso->lock);if (access (filename,R_OK ) && errno ==ENOENT && dso->nsinfo) { -char *new_name =filename_with_chroot (dso->nsinfo->pid, +char *new_name =filename_with_chroot (RC_CHK_ACCESS (dso->nsinfo)->pid, filename);if (new_name) {strlcpy (filename, new_name, filename_size);
tools/perf/util/dso.c +1 -1
@@ -515,7 +515,7 @@ static int __open_dso(struct dso *dso, struct machine *machine)if (errno !=ENOENT || dso->nsinfo ==NULL ) goto out; - new_name =filename_with_chroot (dso->nsinfo->pid, name); + new_name =filename_with_chroot (RC_CHK_ACCESS (dso->nsinfo)->pid, name);if (!new_name) goto out;
tools/perf/util/dsos.c +1 -1
@@ -91,7 +91,7 @@ bool __dsos__read_build_ids(struct list_head *head, bool with_hits) have_build_id = true; pos->has_build_id = true; } else if (errno == ENOENT && pos->nsinfo) { - char *new_name = filename_with_chroot(pos->nsinfo->pid, + char *new_name = filename_with_chroot(RC_CHK_ACCESS(pos->nsinfo)->pid, pos->long_name); if (new_name && filename__read_build_id(new_name,
tools/perf/util/namespaces.c +76 -56
240 lines not on this page · raw message
tools/perf/util/namespaces.h +2 -1
@@ -13,6 +13,7 @@#include <linux/perf_event.h> #include <linux/refcount.h> #include <linux/types.h> +#include <internal/rc_check.h> #ifndef HAVE_SETNS_SUPPORT int setns (int fd,int nstype);
@@ -29,7 +30,7 @@ struct namespaces {struct namespaces *namespaces__new (struct perf_record_namespaces *event);void namespaces__free (struct namespaces *namespaces); -struct nsinfo { +DECLARE_RC_STRUCT (nsinfo) {pid_t pid;pid_t tgid;pid_t nstgid;
tools/perf/util/symbol.c +1 -1
@@ -1963,7 +1963,7 @@ int dso__load(struct dso *dso, struct map *map) is_reg =is_regular_file (name);if (!is_reg && errno ==ENOENT && dso->nsinfo) { -char *new_name =filename_with_chroot (dso->nsinfo->pid, +char *new_name =filename_with_chroot (RC_CHK_ACCESS (dso->nsinfo)->pid, name);if (new_name) { is_reg =is_regular_file (new_name);
Signature · 1 line
2.40.0.577.gac1e443424-goog
Arnaldo Carvalho de Melo
maintainerRe: [PATCH v7 3/5] perf namespaces: Add reference count checking
Em Fri, Apr 07, 2023 at 04:04:03PM -0700, Ian Rogers escreveu:
Quoted 25 lines
Add reference count checking controlled by
REFCNT_CHECKINGifdef. The reference count checking interposes an allocated pointer between the reference counted struct on a get and frees the pointer on a put. Accesses after a put cause faults and use after free, missed puts are caughts as leaks and double puts are double frees.This checking helped resolve a memory leak and use after free:
https://lore.kernel.org/linux-perf-users/CAP-5=fWZH20L4kv-BwVtGLwR=Em3AOOT+Q4QGivvQuYn5AsPRg@mail.gmail.com/Signed-off-by Ian Rogers <[email protected]>--- tools/perf/builtin-inject.c | 2 +- tools/perf/util/annotate.c | 2 +- tools/perf/util/dso.c | 2 +- tools/perf/util/dsos.c | 2 +- tools/perf/util/namespaces.c | 132 ++++++++++++++++++++--------------- tools/perf/util/namespaces.h | 3 +- tools/perf/util/symbol.c | 2 +- 7 files changed, 83 insertions(+), 62 deletions(-)tools/perf/builtin-inject.c +0
-0
tools/perf/builtin-inject.c static int dso__read_build_id(struct dso *dso) · line 636
Quoted 6 lines
tools/perf/builtin-inject.c +1
-1@@ -632,7 +632,7 @@ static int dso__read_build_id(struct dso *dso)else if (dso->nsinfo) {char *new_name; - new_name =filename_with_chroot (dso->nsinfo->pid, + new_name =filename_with_chroot (RC_CHK_ACCESS (dso->nsinfo)->pid, dso->long_name);
To reduce these:
From c80478cfc86cf24f6f075576d731d99e0fa8fe4f Mon Sep 17 00:00:00 2001
From: Arnaldo Carvalho de Melo <[email protected]>
Date: Mon, 17 Apr 2023 18:28:01 -0300
Subject: [PATCH 1/1] perf dso: Add dso__filename_with_chroot() to reduce
number of accesses to dso->nsinfo members
We'll need to reference count dso->nsinfo, so reduce the number of direct accesses by having a shorter form of obtaining a filename with a chroot (namespace one).
--- tools/perf/builtin-inject.c | 4 +--- tools/perf/util/annotate.c | 3 +-- tools/perf/util/dso.c | 7 ++++++- tools/perf/util/dso.h | 2 ++ tools/perf/util/dsos.c | 3 +-- tools/perf/util/symbol.c | 3 +-- 6 files changed, 12 insertions(+), 10 deletions(-)
tools/perf/builtin-inject.c +1 -3
@@ -630,10 +630,8 @@ static int dso__read_build_id(struct dso *dso)if (filename__read_build_id (dso->long_name, &dso->bid) >0 ) dso->has_build_id = true;else if (dso->nsinfo) { -char *new_name; +char *new_name =dso__filename_with_chroot (dso, dso->long_name); - new_name =filename_with_chroot (dso->nsinfo->pid, - dso->long_name);if (new_name &&filename__read_build_id (new_name, &dso->bid) >0 ) dso->has_build_id = true;free (new_name);
tools/perf/util/annotate.c +1 -2
@@ -1692,8 +1692,7 @@ static int dso__disassemble_filename(struct dso *dso, char *filename, size_t filmutex_lock (&dso->lock);if (access (filename,R_OK ) && errno ==ENOENT && dso->nsinfo) { -char *new_name =filename_with_chroot (dso->nsinfo->pid, - filename); +char *new_name =dso__filename_with_chroot (dso, filename);if (new_name) {strlcpy (filename, new_name, filename_size);free (new_name);
tools/perf/util/dso.c +6 -1
@@ -491,6 +491,11 @@ static int do_open(char *name)return -1 ; } +char *dso__filename_with_chroot (const struct dso *dso,const char *filename) +{ +return filename_with_chroot (dso->nsinfo->pid, filename); +} +static int __open_dso (struct dso *dso,struct machine *machine) {int fd = -EINVAL ;
@@ -515,7 +520,7 @@ static int __open_dso(struct dso *dso, struct machine *machine)if (errno !=ENOENT || dso->nsinfo ==NULL ) goto out; - new_name =filename_with_chroot (dso->nsinfo->pid, name); + new_name =dso__filename_with_chroot (dso, name);if (!new_name) goto out;
tools/perf/util/dso.h +2 -0
@@ -266,6 +266,8 @@ static inline bool dso__has_symbols(const struct dso *dso)return !RB_EMPTY_ROOT (&dso->symbols.rb_root); } +char *dso__filename_with_chroot (const struct dso *dso,const char *filename); +bool dso__sorted_by_name (const struct dso *dso);void dso__set_sorted_by_name (struct dso *dso);void dso__sort_by_name (struct dso *dso);
tools/perf/util/dsos.c +1 -2
@@ -91,8 +91,7 @@ bool __dsos__read_build_ids(struct list_head *head, bool with_hits) have_build_id = true; pos->has_build_id = true; }else if (errno ==ENOENT && pos->nsinfo) { -char *new_name =filename_with_chroot (pos->nsinfo->pid, - pos->long_name); +char *new_name =dso__filename_with_chroot (pos, pos->long_name);if (new_name &&filename__read_build_id (new_name, &pos->bid) >0 ) {
tools/perf/util/symbol.c +1 -2
@@ -1963,8 +1963,7 @@ int dso__load(struct dso *dso, struct map *map) is_reg =is_regular_file (name);if (!is_reg && errno ==ENOENT && dso->nsinfo) { -char *new_name =filename_with_chroot (dso->nsinfo->pid, - name); +char *new_name =dso__filename_with_chroot (dso, name);if (new_name) { is_reg =is_regular_file (new_name);strlcpy (name, new_name,PATH_MAX );
Signature · 1 line
2.39.2
Ian Rogers
reviewerPATCH v7 4/5 perf maps: Add reference count checking.
In reply to Ian RogersAdd reference count checking to make sure of good use of get and put. Add and use accessors to reduce RC_CHK clutter.
The only significant issue was in tests/thread-maps-share.c where reference counts were released in the reverse order to acquisition, leading to a use after put. This was fixed by reversing the put order.
--- tools/perf/tests/thread-maps-share.c | 29 ++++++------- tools/perf/util/machine.c | 2 +- tools/perf/util/maps.c | 53 +++++++++++++----------- tools/perf/util/maps.h | 17 ++++---- tools/perf/util/symbol.c | 13 +++--- tools/perf/util/unwind-libdw.c | 2 +- tools/perf/util/unwind-libunwind-local.c | 2 +- tools/perf/util/unwind-libunwind.c | 2 +- 8 files changed, 64 insertions(+), 56 deletions(-)
tools/perf/tests/thread-maps-share.c +15 -14
@@ -43,12 +43,12 @@ static int test__thread_maps_share(struct test_suite *test __maybe_unused, int s leader && t1 && t2 && t3 && other); maps = leader->maps; -TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&maps->refcnt),4 ); +TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (maps)->refcnt),4 );/* test the maps pointer is shared */ -TEST_ASSERT_VAL ("maps don't match" , maps == t1->maps); -TEST_ASSERT_VAL ("maps don't match" , maps == t2->maps); -TEST_ASSERT_VAL ("maps don't match" , maps == t3->maps); +TEST_ASSERT_VAL ("maps don't match" ,RC_CHK_ACCESS (maps) ==RC_CHK_ACCESS (t1->maps)); +TEST_ASSERT_VAL ("maps don't match" ,RC_CHK_ACCESS (maps) ==RC_CHK_ACCESS (t2->maps)); +TEST_ASSERT_VAL ("maps don't match" ,RC_CHK_ACCESS (maps) ==RC_CHK_ACCESS (t3->maps));/* * Verify the other leader was created by previous call.
@@ -71,25 +71,26 @@ static int test__thread_maps_share(struct test_suite *test __maybe_unused, int smachine__remove_thread (machine, other_leader); other_maps = other->maps; -TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&other_maps->refcnt),2 ); +TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (other_maps)->refcnt),2 ); -TEST_ASSERT_VAL ("maps don't match" , other_maps == other_leader->maps); +TEST_ASSERT_VAL ("maps don't match" , +RC_CHK_ACCESS (other_maps) ==RC_CHK_ACCESS (other_leader->maps));/* release thread group */ -thread__put (leader); -TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&maps->refcnt),3 ); - -thread__put (t1); -TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&maps->refcnt),2 ); +thread__put (t3); +TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (maps)->refcnt),3 );thread__put (t2); -TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&maps->refcnt),1 ); +TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (maps)->refcnt),2 ); -thread__put (t3); +thread__put (t1); +TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (maps)->refcnt),1 ); + +thread__put (leader);/* release other group */ thread__put (other_leader); -TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&other_maps->refcnt),1 ); +TEST_ASSERT_EQUAL ("wrong refcnt" ,refcount_read (&RC_CHK_ACCESS (other_maps)->refcnt),1 );thread__put (other);
tools/perf/util/machine.c +1 -1
@@ -435,7 +435,7 @@ static struct thread *findnew_guest_code(struct machine *machine,return NULL ;/* Assume maps are set up if there are any */ -if (thread->maps->nr_maps) +if (RC_CHK_ACCESS (thread->maps)->nr_maps)return thread; host_thread =machine__find_thread (host_machine,-1 , pid);
tools/perf/util/maps.c +29 -24
120 lines not on this page · raw message
tools/perf/util/maps.h +9 -8
@@ -8,6 +8,7 @@#include <stdbool.h> #include <linux/types.h> #include "rwsem.h" +#include <internal/rc_check.h> struct ref_reloc_sym ;struct machine ;
@@ -32,7 +33,7 @@ struct map *maps__find(struct maps *maps, u64 addr);for (map =maps__first (maps), next =map_rb_node__next (map); map; \ map = next, next =map_rb_node__next (map)) -struct maps { +DECLARE_RC_STRUCT(maps) {struct rb_root entries;struct rw_semaphore lock;struct machine *machine;
@@ -65,38 +66,38 @@ void maps__put(struct maps *maps);static inline struct rb_root *maps__entries (struct maps *maps) { -return &maps->entries; +return &RC_CHK_ACCESS (maps)->entries; }static inline struct machine *maps__machine (struct maps *maps) { -return maps->machine; +return RC_CHK_ACCESS (maps)->machine; }static inline struct rw_semaphore *maps__lock (struct maps *maps) { -return &maps->lock; +return &RC_CHK_ACCESS (maps)->lock; }static inline struct map **maps__maps_by_name (struct maps *maps) { -return maps->maps_by_name; +return RC_CHK_ACCESS (maps)->maps_by_name; }static inline unsigned int maps__nr_maps (const struct maps *maps) { -return maps->nr_maps; +return RC_CHK_ACCESS (maps)->nr_maps; }#ifdef HAVE_LIBUNWIND_SUPPORT static inline void *maps__addr_space (struct maps *maps) { -return maps->addr_space; +return RC_CHK_ACCESS (maps)->addr_space; }static inline const struct unwind_libunwind_ops *maps__unwind_libunwind_ops (const struct maps *maps) { -return maps->unwind_libunwind_ops; +return RC_CHK_ACCESS (maps)->unwind_libunwind_ops; }#endif
tools/perf/util/symbol.c +7 -6
@@ -2097,8 +2097,8 @@ static int map__groups__sort_by_name_from_rbtree(struct maps *maps)up_read (maps__lock (maps));down_write (maps__lock (maps)); - maps->maps_by_name = maps_by_name; - maps->nr_maps_allocated =maps__nr_maps (maps); +RC_CHK_ACCESS (maps)->maps_by_name = maps_by_name; +RC_CHK_ACCESS (maps)->nr_maps_allocated =maps__nr_maps (maps);maps__for_each_entry (maps, rb_node) maps_by_name[i++] =map__get (rb_node->map);
@@ -2133,11 +2133,12 @@ struct map *maps__find_by_name(struct maps *maps, const char *name)down_read (maps__lock (maps)); -if (maps->last_search_by_name) { -const struct dso *dso =map__dso (maps->last_search_by_name); + +if (RC_CHK_ACCESS (maps)->last_search_by_name) { +const struct dso *dso =map__dso (RC_CHK_ACCESS (maps)->last_search_by_name);if (strcmp (dso->short_name, name) ==0 ) { - map = maps->last_search_by_name; + map =RC_CHK_ACCESS (maps)->last_search_by_name; goto out_unlock; } }
@@ -2157,7 +2158,7 @@ struct map *maps__find_by_name(struct maps *maps, const char *name) map = rb_node->map; dso =map__dso (map);if (strcmp (dso->short_name, name) ==0 ) { - maps->last_search_by_name = map; +RC_CHK_ACCESS (maps)->last_search_by_name = map; goto out_unlock; } }
tools/perf/util/unwind-libdw.c +1 -1
@@ -230,7 +230,7 @@ int unwind__get_entries(unwind_entry_cb_t cb, void *arg,struct unwind_info *ui, ui_buf = { .sample = data, .thread = thread, - .machine = thread->maps->machine, + .machine =RC_CHK_ACCESS (thread->maps)->machine, .cb = cb, .arg = arg, .max_stack = max_stack,
tools/perf/util/unwind-libunwind-local.c +1 -1
@@ -677,7 +677,7 @@ static int _unwind__prepare_access(struct maps *maps) {void *addr_space =unw_create_addr_space (&accessors,0 ); - maps->addr_space = addr_space; +RC_CHK_ACCESS (maps)->addr_space = addr_space;if (!addr_space) {pr_err ("unwind: Can't create unwind address space.\n" );return -ENOMEM ;
tools/perf/util/unwind-libunwind.c +1 -1
@@ -14,7 +14,7 @@ struct unwind_libunwind_ops __weak *arm64_unwind_libunwind_ops;static void unwind__register_ops (struct maps *maps,struct unwind_libunwind_ops *ops) { - maps->unwind_libunwind_ops = ops; +RC_CHK_ACCESS (maps)->unwind_libunwind_ops = ops; }int unwind__prepare_access (struct maps *maps,struct map *map,bool *initialized)
Signature · 1 line
2.40.0.577.gac1e443424-goog
Ian Rogers
reviewerPATCH v7 5/5 perf map: Add reference count checking
In reply to Ian RogersThere's no strict get/put policy with map that leads to leaks or use after free. Reference count checking identifies correct pairing of gets and puts.
--- tools/perf/builtin-top.c | 4 +- tools/perf/tests/hists_link.c | 2 +- tools/perf/tests/maps.c | 20 ++++----- tools/perf/tests/vmlinux-kallsyms.c | 4 +- tools/perf/util/machine.c | 25 ++++++----- tools/perf/util/map.c | 69 ++++++++++++++++------------- tools/perf/util/map.h | 32 +++++++------ tools/perf/util/maps.c | 11 ++--- tools/perf/util/symbol-elf.c | 26 ++++++----- tools/perf/util/symbol.c | 40 +++++++++-------- 10 files changed, 126 insertions(+), 107 deletions(-)
tools/perf/builtin-top.c +2 -2
@@ -191,7 +191,7 @@ static void ui__warn_map_erange(struct map *map, struct symbol *sym, u64 ip)if (use_browser <=0 )sleep (5 ); - map->erange_warned = true; +RC_CHK_ACCESS (map)->erange_warned = true; } static void perf_top__record_precise_ip(struct perf_top *top,
@@ -225,7 +225,7 @@ static void perf_top__record_precise_ip(struct perf_top *top,*/ mutex_unlock (&he->hists->lock); -if (err == -ERANGE && !he->ms.map->erange_warned) +if (err == -ERANGE && !RC_CHK_ACCESS (he->ms.map)->erange_warned)ui__warn_map_erange (he->ms.map, sym, ip);else if (err == -ENOMEM ) { pr_err("Not enough memory for annotating '%s' symbol!\n",
tools/perf/tests/hists_link.c +1 -1
@@ -145,7 +145,7 @@ static int find_sample(struct sample *samples, size_t nr_samples, {while (nr_samples--) {if (samples->thread == t && - samples->map == m && +RC_CHK_ACCESS (samples->map) ==RC_CHK_ACCESS (m) && samples->sym == s)return 1 ; samples++;
tools/perf/tests/maps.c +10 -10
@@ -30,7 +30,7 @@ static int check_maps(struct map_def *merged, unsigned int size, struct maps *maif (map__start (map) != merged[i].start ||map__end (map) != merged[i].end ||strcmp (map__dso (map)->name, merged[i].name) || -refcount_read (&map->refcnt) !=1 ) { +refcount_read (&RC_CHK_ACCESS (map)->refcnt) !=1 ) { failed = true; } i++;
@@ -50,7 +50,7 @@ static int check_maps(struct map_def *merged, unsigned int size, struct maps *mamap__start (map),map__end (map),map__dso (map)->name, - refcount_read(&map->refcnt)); + refcount_read(&RC_CHK_ACCESS(map)->refcnt)); } }return failed ?TEST_FAIL :TEST_OK ;
@@ -95,8 +95,8 @@ static int test__maps__merge_in(struct test_suite *t __maybe_unused, int subtest map =dso__new_map (bpf_progs[i].name);TEST_ASSERT_VAL ("failed to create map" , map); - map->start = bpf_progs[i].start; - map->end = bpf_progs[i].end; +RC_CHK_ACCESS (map)->start = bpf_progs[i].start; +RC_CHK_ACCESS (map)->end = bpf_progs[i].end;TEST_ASSERT_VAL ("failed to insert map" ,maps__insert (maps, map) ==0 );map__put (map); }
@@ -111,16 +111,16 @@ static int test__maps__merge_in(struct test_suite *t __maybe_unused, int subtestTEST_ASSERT_VAL ("failed to create map" , map_kcore3);/* kcore1 map overlaps over all bpf maps */ - map_kcore1->start =100 ; - map_kcore1->end =1000 ; +RC_CHK_ACCESS (map_kcore1)->start =100 ; +RC_CHK_ACCESS (map_kcore1)->end =1000 ;/* kcore2 map hides behind bpf_prog_2 */ - map_kcore2->start =550 ; - map_kcore2->end =570 ; +RC_CHK_ACCESS (map_kcore2)->start =550 ; +RC_CHK_ACCESS (map_kcore2)->end =570 ;/* kcore3 map hides behind bpf_prog_3, kcore1 and adds new map */ - map_kcore3->start =880 ; - map_kcore3->end =1100 ; +RC_CHK_ACCESS (map_kcore3)->start =880 ; +RC_CHK_ACCESS (map_kcore3)->end =1100 ; ret =maps__merge_in (maps, map_kcore1);TEST_ASSERT_VAL ("failed to merge map" , !ret);
tools/perf/tests/vmlinux-kallsyms.c +2 -2
@@ -304,7 +304,7 @@ static int test__vmlinux_matches_kallsyms(struct test_suite *test __maybe_unused dso->short_name : dso->name));if (pair) { - pair->priv =1 ; +RC_CHK_ACCESS (pair)->priv =1 ; }else {if (!header_printed) {pr_info ("WARN: Maps only in vmlinux:\n" );
@@ -340,7 +340,7 @@ static int test__vmlinux_matches_kallsyms(struct test_suite *test __maybe_unusedpr_info (":\nWARN: *%" PRIx64"-%" PRIx64" %" PRIx64,map__start (pair),map__end (pair),map__pgoff (pair));pr_info (" %s\n" , dso->name); - pair->priv =1 ; +RC_CHK_ACCESS (pair)->priv =1 ; } }
tools/perf/util/machine.c +13 -12
@@ -910,8 +910,8 @@ static int machine__process_ksymbol_register(struct machine *machine,dso__set_loaded (dso); } - map->start = event->ksymbol.addr; - map->end =map__start (map) + event->ksymbol.len; +RC_CHK_ACCESS (map)->start = event->ksymbol.addr; +RC_CHK_ACCESS (map)->end =map__start (map) + event->ksymbol.len; err =maps__insert (machine__kernel_maps (machine), map);if (err) { err = -ENOMEM ;
@@ -953,7 +953,7 @@ static int machine__process_ksymbol_unregister(struct machine *machine,if (!map)return 0 ; -if (map != machine->vmlinux_map) +if (RC_CHK_ACCESS (map) !=RC_CHK_ACCESS (machine->vmlinux_map))maps__remove (machine__kernel_maps (machine), map);else {struct dso *dso =map__dso (map);
@@ -1218,8 +1218,8 @@ int machine__create_extra_kernel_map(struct machine *machine,if (!map)return -ENOMEM ; - map->end = xm->end; - map->pgoff = xm->pgoff; +RC_CHK_ACCESS (map)->end = xm->end; +RC_CHK_ACCESS (map)->pgoff = xm->pgoff; kmap =map__kmap (map);
@@ -1291,7 +1291,7 @@ int machine__map_x86_64_entry_trampolines(struct machine *machine, dest_map =maps__find (kmaps,map__pgoff (map));if (dest_map != map) - map->pgoff =map__map_ip (dest_map,map__pgoff (map)); +RC_CHK_ACCESS (map)->pgoff =map__map_ip (dest_map,map__pgoff (map)); found = true; }if (found || machine->trampolines_mapped)
@@ -1342,7 +1342,8 @@ __machine__create_kernel_maps(struct machine *machine, struct dso *kernel)if (machine->vmlinux_map ==NULL )return -ENOMEM ; - machine->vmlinux_map->map_ip = machine->vmlinux_map->unmap_ip = identity__map_ip; +RC_CHK_ACCESS (machine->vmlinux_map)->map_ip = identity__map_ip; +RC_CHK_ACCESS (machine->vmlinux_map)->unmap_ip = identity__map_ip;return maps__insert (machine__kernel_maps (machine), machine->vmlinux_map); }
@@ -1623,7 +1624,7 @@ static int machine__create_module(void *arg, const char *name, u64 start, map =machine__addnew_module_map (machine, start, name);if (map ==NULL )return -1 ; - map->end = start + size; +RC_CHK_ACCESS (map)->end = start + size;dso__kernel_module_get_build_id (map__dso (map), machine->root_dir);map__put (map);
@@ -1659,14 +1660,14 @@ static int machine__create_modules(struct machine *machine)static void machine__set_kernel_mmap (struct machine *machine,u64 start,u64 end) { - machine->vmlinux_map->start = start; - machine->vmlinux_map->end = end; +RC_CHK_ACCESS (machine->vmlinux_map)->start = start; +RC_CHK_ACCESS (machine->vmlinux_map)->end = end;/* * Be a bit paranoid here, some perf.data file came with * a zero sized synthesized MMAP event for the kernel. */ if (start ==0 && end ==0 ) - machine->vmlinux_map->end = ~0ULL ; +RC_CHK_ACCESS (machine->vmlinux_map)->end = ~0ULL ; } static int machine__update_kernel_mmap(struct machine *machine,
@@ -1810,7 +1811,7 @@ static int machine__process_kernel_mmap_event(struct machine *machine,if (map ==NULL ) goto out_problem; - map->end =map__start (map) + xm->end - xm->start; +RC_CHK_ACCESS (map)->end =map__start (map) + xm->end - xm->start;if (build_id__is_defined (bid))dso__set_build_id (map__dso (map), bid);
tools/perf/util/map.c +38 -31
158 lines not on this page · raw message
tools/perf/util/map.h +18 -14
@@ -10,12 +10,13 @@#include <string.h> #include <stdbool.h> #include <linux/types.h> +#include <internal/rc_check.h> struct dso ;struct maps ;struct machine ; -struct map { +DECLARE_RC_STRUCT (map) {u64 start;u64 end; bool erange_warned:1;
@@ -49,52 +50,52 @@ u64 identity__map_ip(const struct map *map __maybe_unused, u64 ip);static inline struct dso *map__dso (const struct map *map) { -return map->dso; +return RC_CHK_ACCESS (map)->dso; }static inline u64 map__map_ip (const struct map *map,u64 ip) { -return map->map_ip (map, ip); +return RC_CHK_ACCESS (map)->map_ip (map, ip); }static inline u64 map__unmap_ip (const struct map *map,u64 ip) { -return map->unmap_ip (map, ip); +return RC_CHK_ACCESS (map)->unmap_ip (map, ip); }static inline u64 map__start (const struct map *map) { -return map->start; +return RC_CHK_ACCESS (map)->start; }static inline u64 map__end (const struct map *map) { -return map->end; +return RC_CHK_ACCESS (map)->end; }static inline u64 map__pgoff (const struct map *map) { -return map->pgoff; +return RC_CHK_ACCESS (map)->pgoff; }static inline u64 map__reloc (const struct map *map) { -return map->reloc; +return RC_CHK_ACCESS (map)->reloc; }static inline u32 map__flags (const struct map *map) { -return map->flags; +return RC_CHK_ACCESS (map)->flags; }static inline u32 map__prot (const struct map *map) { -return map->prot; +return RC_CHK_ACCESS (map)->prot; }static inline bool map__priv (const struct map *map) { -return map->priv; +return RC_CHK_ACCESS (map)->priv; }static inline size_t map__size (const struct map *map)
@@ -153,9 +154,12 @@ struct map *map__clone(struct map *map);static inline struct map *map__get (struct map *map) { -if (map) -refcount_inc (&map->refcnt); -return map; +struct map *result; + +if (RC_CHK_GET (result, map)) +refcount_inc (&RC_CHK_ACCESS (map)->refcnt); + +return result; }void map__put (struct map *map);
tools/perf/util/maps.c +6 -5
@@ -126,7 +126,7 @@ void maps__remove(struct maps *maps, struct map *map)RC_CHK_ACCESS (maps)->last_search_by_name =NULL ; rb_node =maps__find_node (maps, map); -assert (rb_node->map == map); +assert (rb_node->RC_CHK_ACCESS (map) ==RC_CHK_ACCESS (map));__maps__remove (maps, rb_node);if (maps__maps_by_name (maps))__maps__free_maps_by_name (maps);
@@ -339,7 +339,7 @@ int maps__fixup_overlappings(struct maps *maps, struct map *map, FILE *fp) goto put_map; } - before->end =map__start (map); +RC_CHK_ACCESS (before)->end =map__start (map); err =__maps__insert (maps, before);if (err) {map__put (before);
@@ -359,8 +359,9 @@ int maps__fixup_overlappings(struct maps *maps, struct map *map, FILE *fp) goto put_map; } - after->start =map__end (map); - after->pgoff +=map__end (map) -map__start (pos->map); +RC_CHK_ACCESS (after)->start =map__end (map); +RC_CHK_ACCESS (after)->pgoff += +map__end (map) -map__start (pos->map);assert (map__map_ip (pos->map,map__end (map)) ==map__map_ip (after,map__end (map))); err =__maps__insert (maps, after);
@@ -420,7 +421,7 @@ struct map_rb_node *maps__find_node(struct maps *maps, struct map *map)struct map_rb_node *rb_node;maps__for_each_entry (maps, rb_node) { -if (rb_node->map == map) +if (rb_node->RC_CHK_ACCESS (map) ==RC_CHK_ACCESS (map))return rb_node; }return NULL ;
tools/perf/util/symbol-elf.c +14 -12
@@ -1354,11 +1354,11 @@ static int dso__process_kernel_symbol(struct dso *dso, struct map *map,*/ if (*remap_kernel && dso->kernel && !kmodule) { *remap_kernel = false; - map->start = shdr->sh_addr +ref_reloc (kmap); - map->end =map__start (map) + shdr->sh_size; - map->pgoff = shdr->sh_offset; - map->map_ip = map__dso_map_ip; - map->unmap_ip = map__dso_unmap_ip; +RC_CHK_ACCESS (map)->start = shdr->sh_addr +ref_reloc (kmap); +RC_CHK_ACCESS (map)->end =map__start (map) + shdr->sh_size; +RC_CHK_ACCESS (map)->pgoff = shdr->sh_offset; +RC_CHK_ACCESS (map)->map_ip = map__dso_map_ip; +RC_CHK_ACCESS (map)->unmap_ip = map__dso_unmap_ip;/* Ensure maps are correctly ordered */ if (kmaps) {int err;
@@ -1379,7 +1379,7 @@ static int dso__process_kernel_symbol(struct dso *dso, struct map *map,*/ if (*remap_kernel && kmodule) { *remap_kernel = false; - map->pgoff = shdr->sh_offset; +RC_CHK_ACCESS (map)->pgoff = shdr->sh_offset; } *curr_mapp = map;
@@ -1414,11 +1414,13 @@ static int dso__process_kernel_symbol(struct dso *dso, struct map *map,map__kmap (curr_map)->kmaps = kmaps;if (adjust_kernel_syms) { - curr_map->start = shdr->sh_addr +ref_reloc (kmap); - curr_map->end =map__start (curr_map) + shdr->sh_size; - curr_map->pgoff = shdr->sh_offset; +RC_CHK_ACCESS (curr_map)->start = shdr->sh_addr +ref_reloc (kmap); +RC_CHK_ACCESS (curr_map)->end =map__start (curr_map) + + shdr->sh_size; +RC_CHK_ACCESS (curr_map)->pgoff = shdr->sh_offset; }else { - curr_map->map_ip = curr_map->unmap_ip = identity__map_ip; +RC_CHK_ACCESS (curr_map)->map_ip = identity__map_ip; +RC_CHK_ACCESS (curr_map)->unmap_ip = identity__map_ip; } curr_dso->symtab_type = dso->symtab_type;if (maps__insert (kmaps, curr_map))
@@ -1525,7 +1527,7 @@ dso__load_sym_internal(struct dso *dso, struct map *map, struct symsrc *syms_ss,if (strcmp (elf_name, kmap->ref_reloc_sym->name))continue ; kmap->ref_reloc_sym->unrelocated_addr = sym.st_value; - map->reloc = kmap->ref_reloc_sym->addr - +RC_CHK_ACCESS (map)->reloc = kmap->ref_reloc_sym->addr - kmap->ref_reloc_sym->unrelocated_addr;break ; }
@@ -1536,7 +1538,7 @@ dso__load_sym_internal(struct dso *dso, struct map *map, struct symsrc *syms_ss,* attempted to prelink vdso to its virtual address. */ if (dso__is_vdso (dso)) - map->reloc =map__start (map) - dso->text_offset; +RC_CHK_ACCESS (map)->reloc =map__start (map) - dso->text_offset; dso->adjust_symbols = runtime_ss->adjust_symbols ||ref_reloc (kmap);/*
tools/perf/util/symbol.c +22 -18
@@ -279,7 +279,7 @@ void maps__fixup_end(struct maps *maps)maps__for_each_entry (maps, curr) {if (prev !=NULL && !map__end (prev->map)) - prev->map->end =map__start (curr->map); +RC_CHK_ACCESS (prev->map)->end =map__start (curr->map); prev = curr; }
@@ -289,7 +289,7 @@ void maps__fixup_end(struct maps *maps)* last map final address. */ if (curr && !map__end (curr->map)) - curr->map->end = ~0ULL ; +RC_CHK_ACCESS (curr->map)->end = ~0ULL ;up_write (maps__lock (maps)); }
@@ -865,7 +865,7 @@ static int maps__split_kallsyms(struct maps *kmaps, struct dso *dso, u64 delta, *module++ ='\0' ; curr_map_dso =map__dso (curr_map);if (strcmp (curr_map_dso->short_name, module)) { -if (curr_map != initial_map && +if (RC_CHK_ACCESS (curr_map) !=RC_CHK_ACCESS (initial_map) && dso->kernel ==DSO_SPACE__KERNEL_GUEST &&machine__is_default_guest (machine)) {/*
@@ -944,7 +944,8 @@ static int maps__split_kallsyms(struct maps *kmaps, struct dso *dso, u64 delta,return -1 ; } - curr_map->map_ip = curr_map->unmap_ip = identity__map_ip; +RC_CHK_ACCESS (curr_map)->map_ip = identity__map_ip; +RC_CHK_ACCESS (curr_map)->unmap_ip = identity__map_ip;if (maps__insert (kmaps, curr_map)) {dso__put (ndso);return -1 ;
@@ -1250,8 +1251,8 @@ static int kcore_mapfn(u64 start, u64 len, u64 pgoff, void *data)return -ENOMEM ; } - list_node->map->end =map__start (list_node->map) + len; - list_node->map->pgoff = pgoff; + list_node->RC_CHK_ACCESS (map)->end =map__start (list_node->map) + len; + list_node->RC_CHK_ACCESS (map)->pgoff = pgoff;list_add (&list_node->node, &md->maps);
@@ -1286,7 +1287,7 @@ int maps__merge_in(struct maps *kmaps, struct map *new_map)* |new......| -> |new..| * |old....| -> |old....| */ - new_map->end =map__start (old_map); +RC_CHK_ACCESS (new_map)->end =map__start (old_map); }else {/* * |new.............| -> |new..| |new..|
@@ -1306,10 +1307,12 @@ int maps__merge_in(struct maps *kmaps, struct map *new_map) goto out; } - m->map->end =map__start (old_map); + +RC_CHK_ACCESS (m->map)->end =map__start (old_map);list_add_tail (&m->node, &merged); - new_map->pgoff +=map__end (old_map) -map__start (new_map); - new_map->start =map__end (old_map); +RC_CHK_ACCESS (new_map)->pgoff += +map__end (old_map) -map__start (new_map); +RC_CHK_ACCESS (new_map)->start =map__end (old_map); } }else {/*
@@ -1329,8 +1332,9 @@ int maps__merge_in(struct maps *kmaps, struct map *new_map)* |new......| -> |new...| * |old....| -> |old....| */ - new_map->pgoff +=map__end (old_map) -map__start (new_map); - new_map->start =map__end (old_map); +RC_CHK_ACCESS (new_map)->pgoff += +map__end (old_map) -map__start (new_map); +RC_CHK_ACCESS (new_map)->start =map__end (old_map); } } }
@@ -1456,12 +1460,12 @@ static int dso__load_kcore(struct dso *dso, struct map *map,list_del_init (&new_node->node); -if (new_map == replacement_map) { - map->start =map__start (new_map); - map->end =map__end (new_map); - map->pgoff =map__pgoff (new_map); - map->map_ip = new_map->map_ip; - map->unmap_ip = new_map->unmap_ip; +if (RC_CHK_ACCESS (new_map) ==RC_CHK_ACCESS (replacement_map)) { +RC_CHK_ACCESS (map)->start =map__start (new_map); +RC_CHK_ACCESS (map)->end =map__end (new_map); +RC_CHK_ACCESS (map)->pgoff =map__pgoff (new_map); +RC_CHK_ACCESS (map)->map_ip =RC_CHK_ACCESS (new_map)->map_ip; +RC_CHK_ACCESS (map)->unmap_ip =RC_CHK_ACCESS (new_map)->unmap_ip;/* Ensure maps are correctly ordered */ map__get (map);maps__remove (kmaps, map);
Signature · 1 line
2.40.0.577.gac1e443424-goog