perf/core improvements and fixes for 5.3
Subsystems (2)
Arnaldo Carvalho de Melo
maintainerHi Ingo,
Please consider pulling,
Best regards,
- Arnaldo
Test results at the end of this message, as usual, this time with the versions for the clang compilers used accross the various containers, to give a further view of the build test coverage for perf, libbpf, libtraceevent, etc.
Test results:
The following changes since commit 849e96f30068d4f6f8352715e02a10533a46deba:
Merge tag 'perf-urgent-for-mingo-5.2-20190528' of git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux into perf/urgent (2019-05-28 23:16:22 +0200)
are available in the Git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux.git tags/perf-core-for-mingo-5.3-20190529
for you to fetch changes up to 14f1cfd4f7b4794e2f9d2ae214bcf049654b0b5c:
perf intel-pt: Rationalize intel_pt_sync_switch()'s use of next_tid (2019-05-28 18:37:45 -0300)
----------------------------------------------------------------
perf/core improvements and fixes:
BPF:
Jiri Olsa:
- Preserve eBPF maps when loading kcore.
- Fix up DSO name padding in 'perf script --call-trace', as BPF DSO names are much larger than what we used to have there.
- Add --show-bpf-events to 'perf script'.
perf trace:
Arnaldo Carvalho de Melo:
- Add string table generators and beautify arguments for the new fspick, fsmount, fsconfig, fsopen, move_mount and open_tree syscalls, as well as new values for arguments of clone and sync_file_range syscalls.
perf version:
Arnaldo Carvalho de Melo:
- Append 12 git SHA chars to the version string.
Namespaces:
Namhyung Kim:
- Add missing --namespaces option to 'perf top', to generate and process namespace events, just like present for 'perf record'.
Intel PT:
Andrian Hunter:
- Fix itrace defaults for 'perf script', not using the 'use_browser' variable to figure out what options are better for 'script' and 'report'
- Allow root fixing up buildid cache permissions in the perf-with-kcore.sh script when sharing that cache with another user.
- Improve sync_switch, a facility used to synchronize decoding of HW traces more closely with the point in the kerne where a context switch took place, by processing the PERF_RECORD_CONTEXT_SWITCH "in" metadata records too.
- Make the exported-sql-viewer.py GUI also support pyside2, which upgrades from qt4 used in pyside to qt5. Use the argparser module for more easily addition of new command line args.
----------------------------------------------------------------
Adrian Hunter (11):
perf-with-kcore.sh: Always allow fix_buildid_cache_permissions
perf intel-pt: Fix itrace defaults for perf script
perf auxtrace: Fix itrace defaults for perf script
perf intel-pt: Fix itrace defaults for perf script intel-pt documentation perf scripts python: exported-sql-viewer.py: Change python2 to python perf scripts python: exported-sql-viewer.py: Use argparse module for argument parsing perf scripts python: exported-sql-viewer.py: Add support for pyside2 perf scripts python: export-to-sqlite.py: Add support for pyside2
perf scripts python: export-to-postgresql.py: Add support for pyside2 perf intel-pt: Improve sync_switch by processing PERF_RECORD_SWITCH* in events perf intel-pt: Rationalize intel_pt_sync_switch()'s use of next_tid
Arnaldo Carvalho de Melo (17):
perf augmented_raw_syscalls: Fix up comment
perf beauty: Add generator for 'move_mount' flags argument
perf trace: Beautify 'move_mount' arguments
perf beauty: Add generator for fspick's 'flags' arg values
perf trace: Beautify 'fspick' arguments
perf beauty: Add generator for fsconfig's 'cmd' arg values
perf trace: Beautify 'fsconfig' arguments
perf beauty: Add generator for fsmount's 'attr_flags' arg values
perf trace: Introduce syscall_arg__scnprintf_strarray_flags
perf trace: Beautify 'fsmount' arguments
perf trace beauty clone: Handle CLONE_PIDFD
perf beauty: Add generator for sync_file_range's 'flags' arg values
perf trace: Beautify 'sync_file_range' arguments
perf version: Append 12 git SHA chars to the version string
perf annotate TUI browser: Do not use member from variable within its own initialization perf python: Remove -fstack-protector-strong if clang doesn't have it
perf top: Lower message level for failure on synthesizing events for pre-existing BPF programs
Donald Yandt (1):
perf machine: Return NULL instead of null-terminating /proc/version array
Jiri Olsa (10):
perf machine: Keep zero in pgoff BPF map
perf tools: Preserve eBPF maps when loading kcore perf dso: Separate generic code in dso__data_file_size() perf dso: Separate generic code in dso_cache__read perf dso: Simplify dso_cache__read function
perf dso: Add BPF DSO read and size hooks
perf script: Pad DSO name for --call-trace
perf tests: Add map_groups__merge_in test
perf script: Add --show-bpf-events to show eBPF related events perf script: Remove superfluous BPF event titles
Namhyung Kim (2):
perf top: Add --namespaces option
perf tools: Remove const from thread read accessors
tools/include/linux/kernel.h | 1 + tools/lib/vsprintf.c | 19 ++++ tools/perf/Documentation/intel-pt.txt | 10 +- tools/perf/Documentation/perf-script.txt | 3 + tools/perf/Documentation/perf-top.txt | 5 + tools/perf/Makefile.perf | 44 +++++++- tools/perf/builtin-script.c | 43 ++++++++ tools/perf/builtin-top.c | 7 +- tools/perf/builtin-trace.c | 35 ++++++ tools/perf/examples/bpf/augmented_raw_syscalls.c | 15 ++- tools/perf/perf-with-kcore.sh | 5 - tools/perf/scripts/python/export-to-postgresql.py | 43 ++++++-- tools/perf/scripts/python/export-to-sqlite.py | 44 ++++++-- tools/perf/scripts/python/exported-sql-viewer.py | 51 ++++++--- tools/perf/tests/Build | 1 + tools/perf/tests/builtin-test.c | 4 + tools/perf/tests/map_groups.c | 120 +++++++++++++++++++++ tools/perf/tests/tests.h | 1 + tools/perf/trace/beauty/Build | 4 + tools/perf/trace/beauty/beauty.h | 15 +++ tools/perf/trace/beauty/clone.c | 1 + tools/perf/trace/beauty/fsconfig.sh | 17 +++ tools/perf/trace/beauty/fsmount.c | 34 ++++++ tools/perf/trace/beauty/fsmount.sh | 22 ++++ tools/perf/trace/beauty/fspick.c | 24 +++++ tools/perf/trace/beauty/fspick.sh | 17 +++ tools/perf/trace/beauty/move_mount.c | 24 +++++ tools/perf/trace/beauty/move_mount_flags.sh | 17 +++ tools/perf/trace/beauty/sync_file_range.c | 31 ++++++ tools/perf/trace/beauty/sync_file_range.sh | 17 +++ tools/perf/ui/browsers/annotate.c | 5 +- tools/perf/util/PERF-VERSION-GEN | 2 +- tools/perf/util/auxtrace.c | 3 +- tools/perf/util/dso.c | 125 +++++++++++++++------- tools/perf/util/event.c | 4 +- tools/perf/util/hist.c | 2 +- tools/perf/util/intel-pt.c | 47 +++++++- tools/perf/util/machine.c | 8 +- tools/perf/util/map.c | 6 ++ tools/perf/util/map_groups.h | 2 + tools/perf/util/setup.py | 2 + tools/perf/util/symbol.c | 97 ++++++++++++++++- tools/perf/util/symbol_conf.h | 1 + tools/perf/util/thread.c | 12 +-- tools/perf/util/thread.h | 4 +- 45 files changed, 888 insertions(+), 106 deletions(-) create mode 100644 tools/perf/tests/map_groups.c create mode 100755 tools/perf/trace/beauty/fsconfig.sh create mode 100644 tools/perf/trace/beauty/fsmount.c create mode 100755 tools/perf/trace/beauty/fsmount.sh create mode 100644 tools/perf/trace/beauty/fspick.c create mode 100755 tools/perf/trace/beauty/fspick.sh create mode 100644 tools/perf/trace/beauty/move_mount.c create mode 100755 tools/perf/trace/beauty/move_mount_flags.sh create mode 100644 tools/perf/trace/beauty/sync_file_range.c create mode 100755 tools/perf/trace/beauty/sync_file_range.sh
The first ones are container based builds of tools/perf with and without libelf support. Where clang is available, it is also used to build perf with/without libelf, and building with LIBCLANGLLVM=1 (built-in clang) with gcc and clang when clang and its devel libraries are installed.
The objtool and samples/bpf/ builds are disabled now that I'm switching from using the sources in a local volume to fetching them from a http server to build it inside the container, to make it easier to build in a container cluster. Those will come back later.
Several are cross builds, the ones with -x-ARCH and the android one, and those may not have all the features built, due to lack of multi-arch devel packages, available and being used so far on just a few, like debian:experimental-x-{arm64,mipsel}.
The 'perf test' one will perform a variety of tests exercising tools/perf/util/, tools/lib/{bpf,traceevent,etc}, as well as run perf commands with a variety of command line event specifications to then intercept the sys_perf_event syscall to check that the perf_event_attr fields are set up as expected, among a variety of other unit tests.
Then there is the 'make -C tools/perf build-test' ones, that build tools/perf/ with a variety of feature sets, exercising the build with an incomplete set of features as well as with a complete one. It is planned to have it run on each of the containers mentioned above, using some container orchestration infrastructure. Get in contact if interested in helping having this in place.
$ export PERF_TARBALL=http://192.168.124.1/perf/perf-5.2.0-rc1.tar.xz $ dm 1 alpine:3.4 : Ok gcc (Alpine 5.3.0) 5.3.0 2 alpine:3.5 : Ok gcc (Alpine 6.2.1) 6.2.1 20160822 3 alpine:3.6 : Ok gcc (Alpine 6.3.0) 6.3.0 4 alpine:3.7 : Ok gcc (Alpine 6.4.0) 6.4.0 5 alpine:3.8 : Ok gcc (Alpine 6.4.0) 6.4.0 6 alpine:3.9 : Ok gcc (Alpine 8.3.0) 8.3.0, Alpine clang version 5.0.1 (tags/RELEASE_502/final) (based on LLVM 5.0.1) 7 alpine:edge : Ok gcc (Alpine 8.3.0) 8.3.0, Alpine clang version 7.0.1 (tags/RELEASE_701/final) (based on LLVM 7.0.1) 8 amazonlinux:1 : Ok gcc (GCC) 7.2.1 20170915 (Red Hat 7.2.1-2), clang version 3.6.2 (tags/RELEASE_362/final) 9 amazonlinux:2 : Ok gcc (GCC) 7.3.1 20180303 (Red Hat 7.3.1-5), clang version 7.0.1 (Amazon Linux 2 7.0.1-1.amzn2.0.2) 10 android-ndk:r12b-arm : Ok arm-linux-androideabi-gcc (GCC) 4.9.x 20150123 (prerelease) 11 android-ndk:r15c-arm : Ok arm-linux-androideabi-gcc (GCC) 4.9.x 20150123 (prerelease) 12 centos:5 : Ok gcc (GCC) 4.1.2 20080704 (Red Hat 4.1.2-55) 13 centos:6 : Ok gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-23) 14 centos:7 : Ok gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36) 15 clearlinux:latest : Ok gcc (Clear Linux OS for Intel Architecture) 9.0.1 20190501 (prerelease) gcc-8-branch@270761, clang version 8.0.0 (tags/RELEASE_800/final) 16 debian:8 : Ok gcc (Debian 4.9.2-10+deb8u2) 4.9.2, Debian clang version 3.5.0-10 (tags/RELEASE_350/final) (based on LLVM 3.5.0) 17 debian:9 : Ok gcc (Debian 6.3.0-18+deb9u1) 6.3.0 20170516, clang version 3.8.1-24 (tags/RELEASE_381/final) 18 debian:experimental : Ok gcc (Debian 8.3.0-7) 8.3.0, clang version 7.0.1-8 (tags/RELEASE_701/final) 19 debian:experimental-x-arm64 : Ok aarch64-linux-gnu-gcc (Debian 8.3.0-7) 8.3.0 20 debian:experimental-x-mips : Ok mips-linux-gnu-gcc (Debian 8.3.0-7) 8.3.0 21 debian:experimental-x-mips64 : Ok mips64-linux-gnuabi64-gcc (Debian 8.3.0-7) 8.3.0 22 debian:experimental-x-mipsel : Ok mipsel-linux-gnu-gcc (Debian 8.3.0-7) 8.3.0 23 fedora:20 : Ok gcc (GCC) 4.8.3 20140911 (Red Hat 4.8.3-7) 24 fedora:22 : Ok gcc (GCC) 5.3.1 20160406 (Red Hat 5.3.1-6) 25 fedora:23 : Ok gcc (GCC) 5.3.1 20160406 (Red Hat 5.3.1-6) 26 fedora:24 : Ok gcc (GCC) 6.3.1 20161221 (Red Hat 6.3.1-1) 27 fedora:24-x-ARC-uClibc : Ok arc-linux-gcc (ARCompact ISA Linux uClibc toolchain 2017.09-rc2) 7.1.1 20170710 28 fedora:25 : Ok gcc (GCC) 6.4.1 20170727 (Red Hat 6.4.1-1), clang version 3.9.1 (tags/RELEASE_391/final) 29 fedora:26 : Ok gcc (GCC) 7.3.1 20180130 (Red Hat 7.3.1-2), clang version 4.0.1 (tags/RELEASE_401/final) 30 fedora:27 : Ok gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-6), clang version 5.0.2 (tags/RELEASE_502/final) 31 fedora:28 : Ok gcc (GCC) 8.3.1 20190223 (Red Hat 8.3.1-2), clang version 6.0.1 (tags/RELEASE_601/final) 32 fedora:29 : Ok gcc (GCC) 8.3.1 20190223 (Red Hat 8.3.1-2), clang version 7.0.1 (Fedora 7.0.1-6.fc29) 33 fedora:30 : Ok gcc (GCC) 9.1.1 20190503 (Red Hat 9.1.1-1), clang version 8.0.0 (Fedora 8.0.0-1.fc30) 34 fedora:30-x-ARC-glibc : Ok arc-linux-gcc (ARC HS GNU/Linux glibc toolchain 2019.03-rc1) 8.3.1 20190225 35 fedora:30-x-ARC-uClibc : Ok arc-linux-gcc (ARCv2 ISA Linux uClibc toolchain 2019.03-rc1) 8.3.1 20190225 36 fedora:rawhide : Ok gcc (GCC) 9.0.1 20190418 (Red Hat 9.0.1-0.14), clang version 8.0.0 (Fedora 8.0.0-2.fc31) 37 gentoo-stage3-amd64:latest : Ok gcc (Gentoo 8.3.0-r1 p1.1) 8.3.0 38 mageia:5 : Ok gcc (GCC) 4.9.2 39 mageia:6 : Ok gcc (Mageia 5.5.0-1.mga6) 5.5.0 40 opensuse:15.0 : Ok gcc (SUSE Linux) 7.4.0 41 opensuse:15.1 : Ok gcc (SUSE Linux) 7.4.0 42 opensuse:42.3 : Ok gcc (SUSE Linux) 4.8.5, clang version 3.8.0 (tags/RELEASE_380/final 262553) 43 opensuse:tumbleweed : Ok gcc (SUSE Linux) 9.1.1 20190520 [gcc-9-branch revision 271396], clang version 7.0.1 (tags/RELEASE_701/final 349238) 44 oraclelinux:6 : Ok gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-23.0.1) 45 oraclelinux:7 : Ok gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36.0.1), clang version 3.4.2 (tags/RELEASE_34/dot2-final) 46 ubuntu:12.04.5 : Ok gcc (Ubuntu/Linaro 4.6.3-1ubuntu5) 4.6.3 47 ubuntu:14.04.4 : Ok gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4 48 ubuntu:16.04 : Ok gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, clang version 3.8.0-2ubuntu4 (tags/RELEASE_380/final) 49 ubuntu:16.04-x-arm : Ok arm-linux-gnueabihf-gcc (Ubuntu/Linaro 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609 50 ubuntu:16.04-x-arm64 : Ok aarch64-linux-gnu-gcc (Ubuntu/Linaro 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609 51 ubuntu:16.04-x-powerpc : Ok powerpc-linux-gnu-gcc (Ubuntu 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609 52 ubuntu:16.04-x-powerpc64 : Ok powerpc64-linux-gnu-gcc (Ubuntu/IBM 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609 53 ubuntu:16.04-x-powerpc64el : Ok powerpc64le-linux-gnu-gcc (Ubuntu/IBM 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609 54 ubuntu:16.04-x-s390 : Ok s390x-linux-gnu-gcc (Ubuntu 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609 55 ubuntu:17.10 : Ok gcc (Ubuntu 7.2.0-8ubuntu3.2) 7.2.0, clang version 4.0.1-6 (tags/RELEASE_401/final) 56 ubuntu:18.04 : Ok gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0, clang version 6.0.0-1ubuntu2 (tags/RELEASE_600/final) 57 ubuntu:18.04-x-arm : Ok arm-linux-gnueabihf-gcc (Ubuntu/Linaro 7.4.0-1ubuntu1~18.04) 7.4.0 58 ubuntu:18.04-x-arm64 : Ok aarch64-linux-gnu-gcc (Ubuntu/Linaro 7.4.0-1ubuntu1~18.04) 7.4.0 59 ubuntu:18.04-x-m68k : Ok m68k-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 60 ubuntu:18.04-x-powerpc : Ok powerpc-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 61 ubuntu:18.04-x-powerpc64 : Ok powerpc64-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 62 ubuntu:18.04-x-powerpc64el : Ok powerpc64le-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 63 ubuntu:18.04-x-riscv64 : Ok riscv64-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 64 ubuntu:18.04-x-s390 : Ok s390x-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 65 ubuntu:18.04-x-sh4 : Ok sh4-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 66 ubuntu:18.04-x-sparc64 : Ok sparc64-linux-gnu-gcc (Ubuntu 7.4.0-1ubuntu1~18.04) 7.4.0 67 ubuntu:18.10 : Ok gcc (Ubuntu 8.3.0-6ubuntu1~18.10) 8.3.0, clang version 7.0.0-3 (tags/RELEASE_700/final) 68 ubuntu:19.04 : Ok gcc (Ubuntu 8.3.0-6ubuntu1) 8.3.0, clang version 8.0.0-3 (tags/RELEASE_800/final) 69 ubuntu:19.04-x-alpha : Ok alpha-linux-gnu-gcc (Ubuntu 8.3.0-6ubuntu1) 8.3.0 70 ubuntu:19.04-x-arm64 : Ok aarch64-linux-gnu-gcc (Ubuntu/Linaro 8.3.0-6ubuntu1) 8.3.0 71 ubuntu:19.04-x-hppa : Ok hppa-linux-gnu-gcc (Ubuntu 8.3.0-6ubuntu1) 8.3.0 $
# uname -a
Linux quaco 5.2.0-rc1+ #1 SMP Thu May 23 10:37:55 -03 2019 x86_64 x86_64 x86_64 GNU/Linux
# git log --oneline -1
14f1cfd4f7b4 perf intel-pt: Rationalize intel_pt_sync_switch()'s use of next_tid
# perf version --build-options
perf version 5.2.rc1.gdb3a270ffd55
dwarf: [ on ] # HAVE_DWARF_SUPPORT
dwarf_getlocations: [ on ] # HAVE_DWARF_GETLOCATIONS_SUPPORT
glibc: [ on ] # HAVE_GLIBC_SUPPORT
gtk2: [ on ] # HAVE_GTK2_SUPPORT
syscall_table: [ on ] # HAVE_SYSCALL_TABLE_SUPPORT
libbfd: [ on ] # HAVE_LIBBFD_SUPPORT
libelf: [ on ] # HAVE_LIBELF_SUPPORT
libnuma: [ on ] # HAVE_LIBNUMA_SUPPORT
numa_num_possible_cpus: [ on ] # HAVE_LIBNUMA_SUPPORT
libperl: [ on ] # HAVE_LIBPERL_SUPPORT
libpython: [ on ] # HAVE_LIBPYTHON_SUPPORT
libslang: [ on ] # HAVE_SLANG_SUPPORT
libcrypto: [ on ] # HAVE_LIBCRYPTO_SUPPORT
libunwind: [ on ] # HAVE_LIBUNWIND_SUPPORT
libdw-dwarf-unwind: [ on ] # HAVE_DWARF_SUPPORT
zlib: [ on ] # HAVE_ZLIB_SUPPORT
lzma: [ on ] # HAVE_LZMA_SUPPORT
get_cpuid: [ on ] # HAVE_AUXTRACE_SUPPORT
bpf: [ on ] # HAVE_LIBBPF_SUPPORT
aio: [ on ] # HAVE_AIO_SUPPORT
zstd: [ on ] # HAVE_ZSTD_SUPPORT
# perf test
1: vmlinux symtab matches kallsyms : Ok
2: Detect openat syscall event : Ok
3: Detect openat syscall event on all cpus : Ok
4: Read samples using the mmap interface : Ok
5: Test data source output : Ok
6: Parse event definition strings : Ok
7: Simple expression parser : Ok
8: PERF_RECORD_* events & perf_sample fields : Ok
9: Parse perf pmu format : Ok
10: DSO data read : Ok
11: DSO data cache : Ok
12: DSO data reopen : Ok
13: Roundtrip evsel->name : Ok
14: Parse sched tracepoints fields : Ok
15: syscalls:sys_enter_openat event fields : Ok
16: Setup struct perf_event_attr : Ok
17: Match and link multiple hists : Ok
18: 'import perf' in python : Ok
19: Breakpoint overflow signal handler : Ok
20: Breakpoint overflow sampling : Ok
21: Breakpoint accounting : Ok
22: Watchpoint :
22.1: Read Only Watchpoint : Skip
22.2: Write Only Watchpoint : Ok
22.3: Read / Write Watchpoint : Ok
22.4: Modify Watchpoint : Ok
23: Number of exit events of a simple workload : Ok
24: Software clock events period values : Ok
25: Object code reading : Ok
26: Sample parsing : Ok
27: Use a dummy software event to keep tracking : Ok
28: Parse with no sample_id_all bit set : Ok
29: Filter hist entries : Ok
30: Lookup mmap thread : Ok
31: Share thread mg : Ok
32: Sort output of hist entries : Ok
33: Cumulate child hist entries : Ok
34: Track with sched_switch : Ok
35: Filter fds with revents mask in a fdarray : Ok
36: Add fd to a fdarray, making it autogrow : Ok
37: kmod_path__parse : Ok
38: Thread map : Ok
39: LLVM search and compile :
39.1: Basic BPF llvm compile : Ok
39.2: kbuild searching : Ok
39.3: Compile source for BPF prologue generation : Ok
39.4: Compile source for BPF relocation : Ok
40: Session topology : Ok
41: BPF filter :
41.1: Basic BPF filtering : Ok
41.2: BPF pinning : Ok
41.3: BPF prologue generation : Ok
41.4: BPF relocation checker : Ok
42: Synthesize thread map : Ok
43: Remove thread map : Ok
44: Synthesize cpu map : Ok
45: Synthesize stat config : Ok
46: Synthesize stat : Ok
47: Synthesize stat round : Ok
48: Synthesize attr update : Ok
49: Event times : Ok
50: Read backward ring buffer : Ok
51: Print cpu map : Ok
52: Probe SDT events : Ok
53: is_printable_array : Ok
54: Print bitmap : Ok
55: perf hooks : Ok
56: builtin clang support : Skip (not compiled in)
57: unit_number__scnprintf : Ok
58: mem2node : Ok
59: map_groups__merge_in : Ok
60: x86 rdpmc : Ok
61: Convert perf time to TSC : Ok
62: DWARF unwind : Ok
63: x86 instruction decoder - new instructions : Ok
64: x86 bp modify : Ok
65: probe libc's inet_pton & backtrace it with ping : Ok
66: Use vfs_getname probe to get syscall args filenames : Ok
67: Add vfs_getname probe to get syscall args filenames : Ok
68: Check open filename arg using perf trace + vfs_getname: Ok
69: Zstd perf.data compression/decompression : Ok
# $ make -C tools/perf build-test
make: Entering directory '/home/acme/git/perf/tools/perf'
- tarpkg: ./tests/perf-targz-src-pkg .
make_no_ui_O: make NO_NEWT=1 NO_SLANG=1 NO_GTK2=1
make_no_libunwind_O: make NO_LIBUNWIND=1
make_no_libperl_O: make NO_LIBPERL=1
make_cscope_O: make cscope
make_clean_all_O: make clean all
make_install_prefix_slash_O: make install prefix=/tmp/krava/
make_help_O: make help
make_pure_O: make
make_no_libbionic_O: make NO_LIBBIONIC=1
make_no_slang_O: make NO_SLANG=1
make_static_O: make LDFLAGS=-static
make_with_clangllvm_O: make LIBCLANGLLVM=1
make_doc_O: make doc
make_no_libelf_O: make NO_LIBELF=1
make_tags_O: make tags
make_no_backtrace_O: make NO_BACKTRACE=1
make_no_libbpf_O: make NO_LIBBPF=1
make_util_pmu_bison_o_O: make util/pmu-bison.o
make_util_map_o_O: make util/map.o
make_no_libdw_dwarf_unwind_O: make NO_LIBDW_DWARF_UNWIND=1
make_no_demangle_O: make NO_DEMANGLE=1
make_install_O: make install
make_install_bin_O: make install-bin
make_no_newt_O: make NO_NEWT=1
make_no_libaudit_O: make NO_LIBAUDIT=1
make_minimal_O: make NO_LIBPERL=1 NO_LIBPYTHON=1 NO_NEWT=1 NO_GTK2=1 NO_DEMANGLE=1 NO_LIBELF=1 NO_LIBUNWIND=1 NO_BACKTRACE=1 NO_LIBNUMA=1 NO_LIBAUDIT=1 NO_LIBBIONIC=1 NO_LIBDW_DWARF_UNWIND=1 NO_AUXTRACE=1 NO_LIBBPF=1 NO_LIBCRYPTO=1 NO_SDT=1 NO_JVMTI=1 NO_LIBZSTD=1
make_debug_O: make DEBUG=1
make_with_babeltrace_O: make LIBBABELTRACE=1
make_no_auxtrace_O: make NO_AUXTRACE=1
make_install_prefix_O: make install prefix=/tmp/krava
make_perf_o_O: make perf.o
make_no_scripts_O: make NO_LIBPYTHON=1 NO_LIBPERL=1
make_no_libpython_O: make NO_LIBPYTHON=1
make_no_libnuma_O: make NO_LIBNUMA=1
make_no_gtk2_O: make NO_GTK2=1
OK
make: Leaving directory '/home/acme/git/perf/tools/perf'
$ Arnaldo Carvalho de Melo
maintainerPATCH 1/41 perf-with-kcore.sh: Always allow fix_buildid_cache_permissions
From: Adrian Hunter <[email protected]>
The user's buildid cache may contain entries added by root even if root has its own home directory (e.g. by using perfconfig to specify the same buildid dir), so remove that validation.
--- tools/perf/perf-with-kcore.sh | 5 ----- 1 file changed, 5 deletions(-)
tools/perf/perf-with-kcore.sh +0 -5
@@ -111,11 +111,6 @@ fix_buildid_cache_permissions() USER_HOME=$(bash <<< "echo ~$SUDO_USER") - if [ "$HOME" != "$USER_HOME" ] ; then - echo "Fix unnecessary because root has a home: $HOME" >&2 - exit 1 - fi - echo "Fixing buildid cache permissions" find "$USER_HOME/.debug" -xdev -type d ! -user "$SUDO_USER" -ls -exec chown "$SUDO_USER" \{\} \;
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 2/41 perf intel-pt: Fix itrace defaults for perf script
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
Commit 4eb068157121 ("perf script: Make itrace script default to all calls") does not work because 'use_browser' is being used to determine whether to default to periodic sampling (i.e. better for perf report). The result is that nothing but CBR events display for perf script when no --itrace option is specified.
Fix by using 'default_no_sample' and 'inject' instead.
Example:
Before:
$ perf record -e intel_pt/cyc/u ls $ perf script > cmp1.txt $ perf script --itrace=cepwx > cmp2.txt $ diff -sq cmp1.txt cmp2.txt Files cmp1.txt and cmp2.txt differ
After:
$ perf script > cmp1.txt $ perf script --itrace=cepwx > cmp2.txt $ diff -sq cmp1.txt cmp2.txt Files cmp1.txt and cmp2.txt are identical
--- tools/perf/util/intel-pt.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
tools/perf/util/intel-pt.c +2 -1
@@ -2588,7 +2588,8 @@ int intel_pt_process_auxtrace_info(union perf_event *event, }else {itrace_synth_opts__set_default (&pt->synth_opts, session->itrace_synth_opts->default_no_sample); -if (use_browser !=-1 ) { +if (!session->itrace_synth_opts->default_no_sample && + !session->itrace_synth_opts->inject) { pt->synth_opts.branches = false; pt->synth_opts.callchain = true; }
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 3/41 perf auxtrace: Fix itrace defaults for perf script
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
Commit 4eb068157121 ("perf script: Make itrace script default to all calls") does not work for the case when '--itrace' only is used, because default_no_sample is not being passed.
Example:
Before:
$ perf record -e intel_pt/cyc/u ls $ perf script --itrace > cmp1.txt $ perf script --itrace=cepwx > cmp2.txt $ diff -sq cmp1.txt cmp2.txt Files cmp1.txt and cmp2.txt differ
After:
$ perf script --itrace > cmp1.txt $ perf script --itrace=cepwx > cmp2.txt $ diff -sq cmp1.txt cmp2.txt Files cmp1.txt and cmp2.txt are identical
--- tools/perf/util/auxtrace.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
tools/perf/util/auxtrace.c +2 -1
@@ -1010,7 +1010,8 @@ int itrace_parse_synth_opts(const struct option *opt, const char *str, }if (!str) { -itrace_synth_opts__set_default (synth_opts, false); +itrace_synth_opts__set_default (synth_opts, + synth_opts->default_no_sample);return 0 ; }
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 4/41 perf intel-pt: Fix itrace defaults for perf script intel-pt documentation
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
Fix intel-pt documentation to reflect the change of itrace defaults for perf script.
--- tools/perf/Documentation/intel-pt.txt | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-)
tools/perf/Documentation/intel-pt.txt +5 -5
@@ -88,16 +88,16 @@ smaller. To represent software control flow, "branches" samples are produced. By default a branch sample is synthesized for every single branch. To get an idea what -data is available you can use the 'perf script' tool with no parameters, which -will list all the samples. +data is available you can use the 'perf script' tool with all itrace sampling +options, which will list all the samples. perf record -e intel_pt//u ls - perf script + perf script --itrace=ibxwpe An interesting field that is not printed by default is 'flags' which can be displayed as follows: - perf script -Fcomm,tid,pid,time,cpu,event,trace,ip,sym,dso,addr,symoff,flags + perf script --itrace=ibxwpe -F+flags The flags are "bcrosyiABEx" which stand for branch, call, return, conditional, system, asynchronous, interrupt, transaction abort, trace begin, trace end, and
@@ -713,7 +713,7 @@ Having no option is the same as which, in turn, is the same as - --itrace=ibxwpe + --itrace=cepwx The letters are:
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 5/41 perf machine: Keep zero in pgoff BPF map
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
With pgoff set to zero, the map__map_ip function will return BPF addresses based from 0, which is what we need when we read the data from a BPF DSO.
Adding BPF symbols with mapped IP addresses as well.
--- tools/perf/util/machine.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
tools/perf/util/machine.c +2 -2
@@ -704,12 +704,12 @@ static int machine__process_ksymbol_register(struct machine *machine,return -ENOMEM ; map->start = event->ksymbol_event.addr; - map->pgoff = map->start; map->end = map->start + event->ksymbol_event.len;map_groups__insert (&machine->kmaps, map); } - sym =symbol__new (event->ksymbol_event.addr, event->ksymbol_event.len, + sym =symbol__new (map->map_ip (map, map->start), + event->ksymbol_event.len,0 ,0 , event->ksymbol_event.name);if (!sym)return -ENOMEM ;
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 6/41 perf tools: Preserve eBPF maps when loading kcore
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
We need to preserve eBPF maps even if they are covered by kcore, because we need to access eBPF dso for source data.
Add the map_groups__merge_in function to do that. It merges a map into map_groups by splitting the new map within the existing map regions.
--- tools/perf/util/symbol.c | 97 ++++++++++++++++++++++++++++++++++++++-- 1 file changed, 93 insertions(+), 4 deletions(-)
tools/perf/util/symbol.c +93 -4
@@ -1166,6 +1166,85 @@ static int kcore_mapfn(u64 start, u64 len, u64 pgoff, void *data)return 0 ; } +/* +* Merges map into map_groups by splitting the new map +* within the existing map regions. +*/ +static int map_groups__merge_in (struct map_groups *kmaps,struct map *new_map) +{ +struct map *old_map; +LIST_HEAD (merged); + +for (old_map =map_groups__first (kmaps); old_map; + old_map =map_groups__next (old_map)) { + +/* no overload with this one */ +if (new_map->end < old_map->start || + new_map->start >= old_map->end) +continue ; + +if (new_map->start < old_map->start) { +/* +* |new...... +* |old.... +*/ +if (new_map->end < old_map->end) { +/* +* |new......| -> |new..| +* |old....| -> |old....| +*/ + new_map->end = old_map->start; + }else { +/* +* |new.............| -> |new..| |new..| +* |old....| -> |old....| +*/ +struct map *m =map__clone (new_map); + +if (!m) +return -ENOMEM ; + + m->end = old_map->start; +list_add_tail (&m->node, &merged); + new_map->start = old_map->end; + } + }else { +/* +* |new...... +* |old.... +*/ +if (new_map->end < old_map->end) { +/* +* |new..| -> x +* |old.........| -> |old.........| +*/ +map__put (new_map); + new_map =NULL ; +break ; + }else { +/* +* |new......| -> |new...| +* |old....| -> |old....| +*/ + new_map->start = old_map->end; + } + } + } + +while (!list_empty (&merged)) { + old_map = list_entry(merged.next, struct map, node); +list_del_init (&old_map->node); +map_groups__insert (kmaps, old_map); +map__put (old_map); + } + +if (new_map) { +map_groups__insert (kmaps, new_map); +map__put (new_map); + } +return 0 ; +} +static int dso__load_kcore (struct dso *dso,struct map *map,const char *kallsyms_filename) {
@@ -1222,7 +1301,12 @@ static int dso__load_kcore(struct dso *dso, struct map *map,while (old_map) {struct map *next =map_groups__next (old_map); -if (old_map != map) +/* +* We need to preserve eBPF maps even if they are +* covered by kcore, because we need to access +* eBPF dso for source data. +*/ +if (old_map != map && !__map__is_bpf_prog (old_map))map_groups__remove (kmaps, old_map); old_map = next; }
@@ -1256,11 +1340,16 @@ static int dso__load_kcore(struct dso *dso, struct map *map,map_groups__remove (kmaps, map);map_groups__insert (kmaps, map);map__put (map); +map__put (new_map); }else { -map_groups__insert (kmaps, new_map); +/* +* Merge kcore map into existing maps, +* and ensure that current maps (eBPF) +* stay intact. +*/ +if (map_groups__merge_in (kmaps, new_map)) + goto out_err; } - -map__put (new_map); }if (machine__is (machine,"x86_64" )) {
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 7/41 perf augmented_raw_syscalls: Fix up comment
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Cut'n'paste error, the second comment is about the syscalls that have as its second arg a string.
--- tools/perf/examples/bpf/augmented_raw_syscalls.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
tools/perf/examples/bpf/augmented_raw_syscalls.c +1 -1
@@ -87,7 +87,7 @@ struct augmented_filename {#define SYS_SYMLINKAT 266#define SYS_MEMFD_CREATE 319 -/* syscalls where the first arg is a string */ +/* syscalls where the second arg is a string */ #define SYS_PWRITE64 18#define SYS_EXECVE 59
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 8/41 perf beauty: Add generator for 'move_mount' flags argument
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
$ tools/perf/trace/beauty/move_mount_flags.sh
static const char *move_mount_flags[] = {
[ilog2(0x00000001) + 1] = "F_SYMLINKS",
[ilog2(0x00000002) + 1] = "F_AUTOMOUNTS",
[ilog2(0x00000004) + 1] = "F_EMPTY_PATH",
[ilog2(0x00000010) + 1] = "T_SYMLINKS",
[ilog2(0x00000020) + 1] = "T_AUTOMOUNTS",
[ilog2(0x00000040) + 1] = "T_EMPTY_PATH",
};
$Will be wired up to the 'perf trace' arg in a followup patch.
--- tools/perf/trace/beauty/move_mount_flags.sh | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100755 tools/perf/trace/beauty/move_mount_flags.sh
tools/perf/trace/beauty/move_mount_flags.sh new file +17 -0
@@ -0,0 +1,17 @@ +#!/bin/sh +# SPDX-License-Identifier: LGPL-2.1 + +if [ $# -ne 1 ] ; then + linux_header_dir=tools/include/uapi/linux +else + linux_header_dir=$1 +fi + +linux_mount=${linux_header_dir}/mount.h + +printf "static const char *move_mount_flags[] = {\n" +regex='^[[:space:]]*#[[:space:]]*define[[:space:]]+MOVE_MOUNT_([FT]_[[:alnum:]_]+)[[:space:]]+(0x[[:xdigit:]]+)[[:space:]]*.*' +egrep $regex ${linux_mount} | \ + sed -r "s/$regex/\2 \1/g" | \ + xargs printf "\t[ilog2(%s) + 1] = \"%s\",\n" +printf "};\n"
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 9/41 perf trace: Beautify 'move_mount' arguments
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Use existing beautifiers for the first 4 args (to/from fds, pathnames) and wire up the recently introduced move_mount flags table generator.
Now it should be possible to just use:
perf trace -e move_mount
As root and see all move_mount syscalls with its args beautified, except for the filenames, that need work in the augmented_raw_syscalls.c eBPF helper to pass more than one, see comment in the augmented_raw_syscalls.c source code, the other args should work in all cases, i.e. all that is needed can be obtained directly from the raw_syscalls:sys_enter tracepoint args.
Running without the strace "skin" (.perfconfig setting output formatting switches to look like strace output + BPF to collect strings, as we still need to support collecting multiple string args for the same syscall, like with move_mount):
# cat sys_move_mount.c #define _GNU_SOURCE /* See feature_test_macros(7) */ #include <unistd.h> #include <sys/syscall.h> /* For SYS_xxx definitions */
#define __NR_move_mount 429
#define MOVE_MOUNT_F_SYMLINKS 0x00000001 /* Follow symlinks on from path */
#define MOVE_MOUNT_F_AUTOMOUNTS 0x00000002 /* Follow automounts on from path */
#define MOVE_MOUNT_F_EMPTY_PATH 0x00000004 /* Empty from path permitted */
#define MOVE_MOUNT_T_SYMLINKS 0x00000010 /* Follow symlinks on to path */
#define MOVE_MOUNT_T_AUTOMOUNTS 0x00000020 /* Follow automounts on to path */
#define MOVE_MOUNT_T_EMPTY_PATH 0x00000040 /* Empty to path permitted */
static inline int sys_move_mount(int from_fd, const char *from_pathname,
int to_fd, const char *to_pathname,
int flags)
{
syscall(__NR_move_mount, from_fd, from_pathname, to_fd, to_pathname, flags);
}
int main(int argc, char *argv[])
{
int flags = 0, from_fd = 0, to_fd = 100;
sys_move_mount(from_fd++, "/foo", to_fd++, "bar", flags);
flags |= MOVE_MOUNT_F_SYMLINKS;
sys_move_mount(from_fd++, "/foo1", to_fd++, "bar1", flags);
flags |= MOVE_MOUNT_F_AUTOMOUNTS;
sys_move_mount(from_fd++, "/foo2", to_fd++, "bar2", flags);
flags |= MOVE_MOUNT_F_EMPTY_PATH;
sys_move_mount(from_fd++, "/foo3", to_fd++, "bar3", flags);
flags |= MOVE_MOUNT_T_SYMLINKS;
sys_move_mount(from_fd++, "/foo4", to_fd++, "bar4", flags);
flags |= MOVE_MOUNT_T_AUTOMOUNTS;
sys_move_mount(from_fd++, "/foo5", to_fd++, "bar5", flags);
flags |= MOVE_MOUNT_T_EMPTY_PATH;
return sys_move_mount(from_fd++, "/foo6", to_fd++, "bar6", flags);
}
# mv ~/.perfconfig ~/.perfconfig.OFF
# perf trace -e move_mount ./sys_move_mount
0.000 ( 0.009 ms): sys_move_mount/28971 move_mount(from_pathname: 0x402010, to_dfd: 100, to_pathname: 0x402015) = -1 ENOENT (No such file or directory)
0.011 ( 0.003 ms): sys_move_mount/28971 move_mount(from_dfd: 1, from_pathname: 0x40201e, to_dfd: 101, to_pathname: 0x402019, flags: F_SYMLINKS) = -1 ENOENT (No such file or directory)
0.016 ( 0.002 ms): sys_move_mount/28971 move_mount(from_dfd: 2, from_pathname: 0x402029, to_dfd: 102, to_pathname: 0x402024, flags: F_SYMLINKS|F_AUTOMOUNTS) = -1 ENOENT (No such file or directory)
0.020 ( 0.002 ms): sys_move_mount/28971 move_mount(from_dfd: 3, from_pathname: 0x402034, to_dfd: 103, to_pathname: 0x40202f, flags: F_SYMLINKS|F_AUTOMOUNTS|F_EMPTY_PATH) = -1 ENOENT (No such file or directory)
0.023 ( 0.002 ms): sys_move_mount/28971 move_mount(from_dfd: 4, from_pathname: 0x40203f, to_dfd: 104, to_pathname: 0x40203a, flags: F_SYMLINKS|F_AUTOMOUNTS|F_EMPTY_PATH|T_SYMLINKS) = -1 ENOENT (No such file or directory)
0.027 ( 0.002 ms): sys_move_mount/28971 move_mount(from_dfd: 5, from_pathname: 0x40204a, to_dfd: 105, to_pathname: 0x402045, flags: F_SYMLINKS|F_AUTOMOUNTS|F_EMPTY_PATH|T_SYMLINKS|T_AUTOMOUNTS) = -1 ENOENT (No such file or directory)
0.031 ( 0.017 ms): sys_move_mount/28971 move_mount(from_dfd: 6, from_pathname: 0x402055, to_dfd: 106, to_pathname: 0x402050, flags: F_SYMLINKS|F_AUTOMOUNTS|F_EMPTY_PATH|T_SYMLINKS|T_AUTOMOUNTS|T_EMPTY_PATH) = -1 ENOENT (No such file or directory)
#--- tools/perf/Makefile.perf | 8 +++++++ tools/perf/builtin-trace.c | 6 +++++ .../examples/bpf/augmented_raw_syscalls.c | 11 +++++++++ tools/perf/trace/beauty/Build | 1 + tools/perf/trace/beauty/beauty.h | 3 +++ tools/perf/trace/beauty/move_mount.c | 24 +++++++++++++++++++ 6 files changed, 53 insertions(+) create mode 100644 tools/perf/trace/beauty/move_mount.c
tools/perf/Makefile.perf +8 -0
@@ -493,6 +493,12 @@ mount_flags_tbl := $(srctree)/tools/perf/trace/beauty/mount_flags.sh $(mount_flags_array): $(linux_uapi_dir)/fs.h $(mount_flags_tbl) $(Q)$(SHELL) '$(mount_flags_tbl)' $(linux_uapi_dir) > $@ +move_mount_flags_array := $(beauty_outdir)/move_mount_flags_array.c +move_mount_flags_tbl := $(srctree)/tools/perf/trace/beauty/move_mount_flags.sh + +$(move_mount_flags_array): $(linux_uapi_dir)/fs.h $(move_mount_flags_tbl) + $(Q)$(SHELL) '$(move_mount_flags_tbl)' $(linux_uapi_dir) > $@ + prctl_option_array := $(beauty_outdir)/prctl_option_array.c prctl_hdr_dir := $(srctree)/tools/include/uapi/linux/ prctl_option_tbl := $(srctree)/tools/perf/trace/beauty/prctl_option.sh
@@ -638,6 +644,7 @@ prepare: $(OUTPUT)PERF-VERSION-FILE $(OUTPUT)common-cmds.h archheaders $(drm_ioc $(madvise_behavior_array) \ $(mmap_flags_array) \ $(mount_flags_array) \ + $(move_mount_flags_array) \ $(perf_ioctl_array) \ $(prctl_option_array) \ $(usbdevfs_ioctl_array) \
@@ -925,6 +932,7 @@ clean:: $(LIBTRACEEVENT)-clean $(LIBAPI)-clean $(LIBBPF)-clean $(LIBSUBCMD)-clea $(OUTPUT)$(madvise_behavior_array) \ $(OUTPUT)$(mmap_flags_array) \ $(OUTPUT)$(mount_flags_array) \ + $(OUTPUT)$(move_mount_flags_array) \ $(OUTPUT)$(drm_ioctl_array) \ $(OUTPUT)$(pkey_alloc_access_rights_array) \ $(OUTPUT)$(sndrv_ctl_ioctl_array) \
tools/perf/builtin-trace.c +6 -0
@@ -775,6 +775,12 @@ static struct syscall_fmt { .arg = { [0] = { .scnprintf = SCA_FILENAME, /* dev_name */ }, [3] = { .scnprintf = SCA_MOUNT_FLAGS, /* flags */ .mask_val = SCAMV_MOUNT_FLAGS, /* flags */ }, }, }, + { .name = "move_mount", + .arg = { [0] = { .scnprintf = SCA_FDAT, /* from_dfd */ }, + [1] = { .scnprintf = SCA_FILENAME, /* from_pathname */ }, + [2] = { .scnprintf = SCA_FDAT, /* to_dfd */ }, + [3] = { .scnprintf = SCA_FILENAME, /* to_pathname */ }, + [4] = { .scnprintf = SCA_MOVE_MOUNT_FLAGS, /* flags */ }, }, }, { .name = "mprotect", .arg = { [0] = { .scnprintf = SCA_HEX, /* start */ }, [2] = { .scnprintf = SCA_MMAP_PROT, /* prot */ }, }, },
tools/perf/examples/bpf/augmented_raw_syscalls.c +11 -0
@@ -117,6 +117,7 @@ struct augmented_filename {#define SYS_RENAMEAT2 316#define SYS_EXECVEAT 322#define SYS_STATX 332 +#define SYS_MOVE_MOUNT 429pid_filter (pids_filtered);
@@ -257,6 +258,16 @@ int sys_enter(struct syscall_enter_args *args)case SYS_LINKAT :case SYS_MKDIRAT :case SYS_MKNODAT : +// case SYS_MOVE_MOUNT: +// For now don't copy move_mount first string arg, as it has two and +// 'perf trace's syscall_arg__scnprintf_filename() will use the one +// copied here, the first, for both args, duplicating the first and +// ignoring the second. +// +// We need to copy both here and make syscall_arg__scnprintf_filename +// skip the first when reading the second, using the size of the first, etc. +// Shouldn't be difficult, but now its perf/urgent time, lets wait for +// the next devel window. case SYS_MQ_TIMEDSEND :case SYS_NAME_TO_HANDLE_AT :case SYS_NEWFSTATAT :
tools/perf/trace/beauty/Build +1 -0
@@ -6,6 +6,7 @@ perf-y += ioctl.o endif perf-y += kcmp.o perf-y += mount_flags.o +perf-y += move_mount.o perf-y += pkey_alloc.o perf-y += arch_prctl.o perf-y += prctl.o
tools/perf/trace/beauty/beauty.h +3 -0
@@ -156,6 +156,9 @@ unsigned long syscall_arg__mask_val_mount_flags(struct syscall_arg *arg, unsignesize_t syscall_arg__scnprintf_mount_flags (char *bf,size_t size,struct syscall_arg *arg);#define SCA_MOUNT_FLAGS syscall_arg__scnprintf_mount_flags +size_t syscall_arg__scnprintf_move_mount_flags (char *bf,size_t size,struct syscall_arg *arg); +#define SCA_MOVE_MOUNT_FLAGS syscall_arg__scnprintf_move_mount_flags +size_t syscall_arg__scnprintf_pkey_alloc_access_rights (char *bf,size_t size,struct syscall_arg *arg);#define SCA_PKEY_ALLOC_ACCESS_RIGHTS syscall_arg__scnprintf_pkey_alloc_access_rights
tools/perf/trace/beauty/move_mount.c new file +24 -0
@@ -0,0 +1,24 @@ +// SPDX-License-Identifier: LGPL-2.1 +/* +* trace/beauty/move_mount.c +* +* Copyright (C) 2019, Red Hat Inc, Arnaldo Carvalho de Melo <[email protected]> +*/ + +#include "trace/beauty/beauty.h" +#include <linux/log2.h> + +static size_t move_mount__scnprintf_flags (unsigned long flags,char *bf,size_t size,bool show_prefix) +{ +#include "trace/beauty/generated/move_mount_flags_array.c" + static DEFINE_STRARRAY(move_mount_flags, "MOVE_MOUNT_"); + +return strarray__scnprintf_flags (&strarray__move_mount_flags, bf, size, show_prefix, flags); +} + +size_t syscall_arg__scnprintf_move_mount_flags (char *bf,size_t size,struct syscall_arg *arg) +{ +unsigned long flags = arg->val; + +return move_mount__scnprintf_flags (flags, bf, size, arg->show_string_prefix); +}
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 10/41 perf beauty: Add generator for fspick's 'flags' arg values
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
$ tools/perf/trace/beauty/fspick.sh
static const char *fspick_flags[] = {
[ilog2(0x00000001) + 1] = "CLOEXEC",
[ilog2(0x00000002) + 1] = "SYMLINK_NOFOLLOW",
[ilog2(0x00000004) + 1] = "NO_AUTOMOUNT",
[ilog2(0x00000008) + 1] = "EMPTY_PATH",
};
$--- tools/perf/trace/beauty/fspick.sh | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100755 tools/perf/trace/beauty/fspick.sh
tools/perf/trace/beauty/fspick.sh new file +17 -0
@@ -0,0 +1,17 @@ +#!/bin/sh +# SPDX-License-Identifier: LGPL-2.1 + +if [ $# -ne 1 ] ; then + linux_header_dir=tools/include/uapi/linux +else + linux_header_dir=$1 +fi + +linux_mount=${linux_header_dir}/mount.h + +printf "static const char *fspick_flags[] = {\n" +regex='^[[:space:]]*#[[:space:]]*define[[:space:]]+FSPICK_([[:alnum:]_]+)[[:space:]]+(0x[[:xdigit:]]+)[[:space:]]*.*' +egrep $regex ${linux_mount} | \ + sed -r "s/$regex/\2 \1/g" | \ + xargs printf "\t[ilog2(%s) + 1] = \"%s\",\n" +printf "};\n"
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 11/41 perf trace: Beautify 'fspick' arguments
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Use existing beautifiers for the first 2 args (dfd, path) and wire up the recently introduced fspick flags table generator.
Now it should be possible to just use:
perf trace -e fspick
As root and see all move_mount syscalls with its args beautified, either using the vfs_getname perf probe method or using the augmented_raw_syscalls.c eBPF helper to get the pathnames, the other args should work in all cases, i.e. all that is needed can be obtained directly from the raw_syscalls:sys_enter tracepoint args.
# cat sys_fspick.c #define _GNU_SOURCE /* See feature_test_macros(7) */ #include <unistd.h> #include <sys/syscall.h> /* For SYS_xxx definitions */ #include <fcntl.h>
#define __NR_fspick 433
#define FSPICK_CLOEXEC 0x00000001
#define FSPICK_SYMLINK_NOFOLLOW 0x00000002
#define FSPICK_NO_AUTOMOUNT 0x00000004
#define FSPICK_EMPTY_PATH 0x00000008
static inline int sys_fspick(int fd, const char *path, int flags)
{
syscall(__NR_fspick, fd, path, flags);
}
int main(int argc, char *argv[])
{
int flags = 0, fd = 0;
open("/foo", 0);
sys_fspick(fd++, "/foo1", flags);
flags |= FSPICK_CLOEXEC;
sys_fspick(fd++, "/foo2", flags);
flags |= FSPICK_SYMLINK_NOFOLLOW;
sys_fspick(fd++, "/foo3", flags);
flags |= FSPICK_NO_AUTOMOUNT;
sys_fspick(fd++, "/foo4", flags);
flags |= FSPICK_EMPTY_PATH;
return sys_fspick(fd++, "/foo5", flags);
}
# perf trace -e fspick ./sys_fspick
LLVM: dumping /home/acme/git/perf/tools/perf/examples/bpf/augmented_raw_syscalls.o
fspick(0, "/foo1", 0) = -1 ENOENT (No such file or directory)
fspick(1, "/foo2", FSPICK_CLOEXEC) = -1 ENOENT (No such file or directory)
fspick(2, "/foo3", FSPICK_CLOEXEC|FSPICK_SYMLINK_NOFOLLOW) = -1 ENOENT (No such file or directory)
fspick(3, "/foo4", FSPICK_CLOEXEC|FSPICK_SYMLINK_NOFOLLOW|FSPICK_NO_AUTOMOUNT) = -1 ENOENT (No such file or directory)
fspick(4, "/foo5", FSPICK_CLOEXEC|FSPICK_SYMLINK_NOFOLLOW|FSPICK_NO_AUTOMOUNT|FSPICK_EMPTY_PATH) = -1 ENOENT (No such file or directory)
#--- tools/perf/Makefile.perf | 8 +++++++ tools/perf/builtin-trace.c | 4 ++++ .../examples/bpf/augmented_raw_syscalls.c | 2 ++ tools/perf/trace/beauty/Build | 1 + tools/perf/trace/beauty/beauty.h | 3 +++ tools/perf/trace/beauty/fspick.c | 24 +++++++++++++++++++ 6 files changed, 42 insertions(+) create mode 100644 tools/perf/trace/beauty/fspick.c
tools/perf/Makefile.perf +8 -0
@@ -419,6 +419,12 @@ fadvise_advice_tbl := $(srctree)/tools/perf/trace/beauty/fadvise.sh $(fadvise_advice_array): $(linux_uapi_dir)/in.h $(fadvise_advice_tbl) $(Q)$(SHELL) '$(fadvise_advice_tbl)' $(linux_uapi_dir) > $@ +fspick_arrays := $(beauty_outdir)/fspick_arrays.c +fspick_tbls := $(srctree)/tools/perf/trace/beauty/fspick.sh + +$(fspick_arrays): $(linux_uapi_dir)/fs.h $(fspick_tbls) + $(Q)$(SHELL) '$(fspick_tbls)' $(linux_uapi_dir) > $@ + pkey_alloc_access_rights_array := $(beauty_outdir)/pkey_alloc_access_rights_array.c asm_generic_hdr_dir := $(srctree)/tools/include/uapi/asm-generic/ pkey_alloc_access_rights_tbl := $(srctree)/tools/perf/trace/beauty/pkey_alloc_access_rights.sh
@@ -634,6 +640,7 @@ build-dir = $(if $(__build-dir),$(__build-dir),.) prepare: $(OUTPUT)PERF-VERSION-FILE $(OUTPUT)common-cmds.h archheaders $(drm_ioctl_array) \ $(fadvise_advice_array) \ + $(fspick_arrays) \ $(pkey_alloc_access_rights_array) \ $(sndrv_pcm_ioctl_array) \ $(sndrv_ctl_ioctl_array) \
@@ -929,6 +936,7 @@ clean:: $(LIBTRACEEVENT)-clean $(LIBAPI)-clean $(LIBBPF)-clean $(LIBSUBCMD)-clea $(OUTPUT)tests/llvm-src-{base,kbuild,prologue,relocation}.c \ $(OUTPUT)pmu-events/pmu-events.c \ $(OUTPUT)$(fadvise_advice_array) \ + $(OUTPUT)$(fspick_arrays) \ $(OUTPUT)$(madvise_behavior_array) \ $(OUTPUT)$(mmap_flags_array) \ $(OUTPUT)$(mount_flags_array) \
tools/perf/builtin-trace.c +4 -0
@@ -713,6 +713,10 @@ static struct syscall_fmt { [2] = { .scnprintf = SCA_FCNTL_ARG, /* arg */ }, }, }, { .name = "flock", .arg = { [1] = { .scnprintf = SCA_FLOCK, /* cmd */ }, }, }, + { .name = "fspick", + .arg = { [0] = { .scnprintf = SCA_FDAT, /* dfd */ }, + [1] = { .scnprintf = SCA_FILENAME, /* path */ }, + [2] = { .scnprintf = SCA_FSPICK_FLAGS, /* flags */ }, }, }, { .name = "fstat", .alias = "newfstat", }, { .name = "fstatat", .alias = "newfstatat", }, { .name = "futex",
tools/perf/examples/bpf/augmented_raw_syscalls.c +2 -0
@@ -118,6 +118,7 @@ struct augmented_filename {#define SYS_EXECVEAT 322#define SYS_STATX 332#define SYS_MOVE_MOUNT 429 +#define SYS_FSPICK 433pid_filter (pids_filtered);
@@ -253,6 +254,7 @@ int sys_enter(struct syscall_enter_args *args)case SYS_FINIT_MODULE :case SYS_FREMOVEXATTR :case SYS_FSETXATTR : +case SYS_FSPICK :case SYS_FUTIMESAT :case SYS_INOTIFY_ADD_WATCH :case SYS_LINKAT :
tools/perf/trace/beauty/Build +1 -0
@@ -1,6 +1,7 @@ perf-y += clone.o perf-y += fcntl.o perf-y += flock.o +perf-y += fspick.o ifeq ($(SRCARCH),$(filter $(SRCARCH),x86)) perf-y += ioctl.o endif
tools/perf/trace/beauty/beauty.h +3 -0
@@ -141,6 +141,9 @@ size_t syscall_arg__scnprintf_fcntl_arg(char *bf, size_t size, struct syscall_arsize_t syscall_arg__scnprintf_flock (char *bf,size_t size,struct syscall_arg *arg);#define SCA_FLOCK syscall_arg__scnprintf_flock +size_t syscall_arg__scnprintf_fspick_flags (char *bf,size_t size,struct syscall_arg *arg); +#define SCA_FSPICK_FLAGS syscall_arg__scnprintf_fspick_flags +size_t syscall_arg__scnprintf_ioctl_cmd (char *bf,size_t size,struct syscall_arg *arg);#define SCA_IOCTL_CMD syscall_arg__scnprintf_ioctl_cmd
tools/perf/trace/beauty/fspick.c new file +24 -0
@@ -0,0 +1,24 @@ +// SPDX-License-Identifier: LGPL-2.1 +/* +* trace/beauty/fspick.c +* +* Copyright (C) 2019, Red Hat Inc, Arnaldo Carvalho de Melo <[email protected]> +*/ + +#include "trace/beauty/beauty.h" +#include <linux/log2.h> + +static size_t fspick__scnprintf_flags (unsigned long flags,char *bf,size_t size,bool show_prefix) +{ +#include "trace/beauty/generated/fspick_arrays.c" + static DEFINE_STRARRAY(fspick_flags, "FSPICK_"); + +return strarray__scnprintf_flags (&strarray__fspick_flags, bf, size, show_prefix, flags); +} + +size_t syscall_arg__scnprintf_fspick_flags (char *bf,size_t size,struct syscall_arg *arg) +{ +unsigned long flags = arg->val; + +return fspick__scnprintf_flags (flags, bf, size, arg->show_string_prefix); +}
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 12/41 perf beauty: Add generator for fsconfig's 'cmd' arg values
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
$ tools/perf/trace/beauty/fsconfig.sh
static const char *fsconfig_cmds[] = {
[0] = "SET_FLAG",
[1] = "SET_STRING",
[2] = "SET_BINARY",
[3] = "SET_PATH",
[4] = "SET_PATH_EMPTY",
[5] = "SET_FD",
[6] = "CMD_CREATE",
[7] = "CMD_RECONFIGURE",
};
$--- tools/perf/trace/beauty/fsconfig.sh | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100755 tools/perf/trace/beauty/fsconfig.sh
tools/perf/trace/beauty/fsconfig.sh new file +17 -0
@@ -0,0 +1,17 @@ +#!/bin/sh +# SPDX-License-Identifier: LGPL-2.1 + +if [ $# -ne 1 ] ; then + linux_header_dir=tools/include/uapi/linux +else + linux_header_dir=$1 +fi + +linux_mount=${linux_header_dir}/mount.h + +printf "static const char *fsconfig_cmds[] = {\n" +regex='^[[:space:]]*+FSCONFIG_([[:alnum:]_]+)[[:space:]]*=[[:space:]]*([[:digit:]]+)[[:space:]]*,[[:space:]]*.*' +egrep $regex ${linux_mount} | \ + sed -r "s/$regex/\2 \1/g" | \ + xargs printf "\t[%s] = \"%s\",\n" +printf "};\n"
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 13/41 perf trace: Beautify 'fsconfig' arguments
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Use existing beautifiers for the first arg, fd, assigned using the heuristic that looks for syscall arg names and associates SCA_FD with 'fd' named argumes, and wire up the recently introduced fsconfig cmd table generator.
Now it should be possible to just use:
perf trace -e fsconfig
As root and see all fsconfig syscalls with its args beautified, more work needed to look at the command and according to it handle the 'key', 'value' and 'aux' args, using the 'fcntl' and 'futex' beautifiers as a starting point to see how to suppress sets of these last three args that may not be used by the 'cmd' arg, etc.
# cat sys_fsconfig.c #define _GNU_SOURCE /* See feature_test_macros(7) */ #include <unistd.h> #include <sys/syscall.h> /* For SYS_xxx definitions */ #include <fcntl.h>
#define __NR_fsconfig 431
enum fsconfig_command {
FSCONFIG_SET_FLAG = 0, /* Set parameter, supplying no value */
FSCONFIG_SET_STRING = 1, /* Set parameter, supplying a string value */
FSCONFIG_SET_BINARY = 2, /* Set parameter, supplying a binary blob value */
FSCONFIG_SET_PATH = 3, /* Set parameter, supplying an object by path */
FSCONFIG_SET_PATH_EMPTY = 4, /* Set parameter, supplying an object by (empty) path */
FSCONFIG_SET_FD = 5, /* Set parameter, supplying an object by fd */
FSCONFIG_CMD_CREATE = 6, /* Invoke superblock creation */
FSCONFIG_CMD_RECONFIGURE = 7, /* Invoke superblock reconfiguration */
}; static inline int sys_fsconfig(int fd, int cmd, const char *key, const void *value, int aux) {
syscall(__NR_fsconfig, fd, cmd, key, value, aux);
}
int main(int argc, char *argv[])
{
int fd = 0, aux = 0;
open("/foo", 0);
sys_fsconfig(fd++, FSCONFIG_SET_FLAG, "/foo1", "/bar1", aux++);
sys_fsconfig(fd++, FSCONFIG_SET_STRING, "/foo2", "/bar2", aux++);
sys_fsconfig(fd++, FSCONFIG_SET_BINARY, "/foo3", "/bar3", aux++);
sys_fsconfig(fd++, FSCONFIG_SET_PATH, "/foo4", "/bar4", aux++);
sys_fsconfig(fd++, FSCONFIG_SET_PATH_EMPTY, "/foo5", "/bar5", aux++);
sys_fsconfig(fd++, FSCONFIG_SET_FD, "/foo6", "/bar6", aux++);
sys_fsconfig(fd++, FSCONFIG_CMD_CREATE, "/foo7", "/bar7", aux++);
sys_fsconfig(fd++, FSCONFIG_CMD_RECONFIGURE, "/foo8", "/bar8", aux++);
return 0;
}
# trace -e fsconfig ./sys_fsconfig
fsconfig(0, FSCONFIG_SET_FLAG, 0x40201b, 0x402015, 0) = -1 EINVAL (Invalid argument)
fsconfig(1, FSCONFIG_SET_STRING, 0x402027, 0x402021, 1) = -1 EINVAL (Invalid argument)
fsconfig(2, FSCONFIG_SET_BINARY, 0x402033, 0x40202d, 2) = -1 EINVAL (Invalid argument)
fsconfig(3, FSCONFIG_SET_PATH, 0x40203f, 0x402039, 3) = -1 EBADF (Bad file descriptor)
fsconfig(4, FSCONFIG_SET_PATH_EMPTY, 0x40204b, 0x402045, 4) = -1 EBADF (Bad file descriptor)
fsconfig(5, FSCONFIG_SET_FD, 0x402057, 0x402051, 5) = -1 EINVAL (Invalid argument)
fsconfig(6, FSCONFIG_CMD_CREATE, 0x402063, 0x40205d, 6) = -1 EINVAL (Invalid argument)
fsconfig(7, FSCONFIG_CMD_RECONFIGURE, 0x40206f, 0x402069, 7) = -1 EINVAL (Invalid argument)
#--- tools/perf/Makefile.perf | 8 ++++++++ tools/perf/builtin-trace.c | 6 ++++++ 2 files changed, 14 insertions(+)
tools/perf/Makefile.perf +8 -0
@@ -425,6 +425,12 @@ fspick_tbls := $(srctree)/tools/perf/trace/beauty/fspick.sh $(fspick_arrays): $(linux_uapi_dir)/fs.h $(fspick_tbls) $(Q)$(SHELL) '$(fspick_tbls)' $(linux_uapi_dir) > $@ +fsconfig_arrays := $(beauty_outdir)/fsconfig_arrays.c +fsconfig_tbls := $(srctree)/tools/perf/trace/beauty/fsconfig.sh + +$(fsconfig_arrays): $(linux_uapi_dir)/fs.h $(fsconfig_tbls) + $(Q)$(SHELL) '$(fsconfig_tbls)' $(linux_uapi_dir) > $@ + pkey_alloc_access_rights_array := $(beauty_outdir)/pkey_alloc_access_rights_array.c asm_generic_hdr_dir := $(srctree)/tools/include/uapi/asm-generic/ pkey_alloc_access_rights_tbl := $(srctree)/tools/perf/trace/beauty/pkey_alloc_access_rights.sh
@@ -640,6 +646,7 @@ build-dir = $(if $(__build-dir),$(__build-dir),.) prepare: $(OUTPUT)PERF-VERSION-FILE $(OUTPUT)common-cmds.h archheaders $(drm_ioctl_array) \ $(fadvise_advice_array) \ + $(fsconfig_arrays) \ $(fspick_arrays) \ $(pkey_alloc_access_rights_array) \ $(sndrv_pcm_ioctl_array) \
@@ -936,6 +943,7 @@ clean:: $(LIBTRACEEVENT)-clean $(LIBAPI)-clean $(LIBBPF)-clean $(LIBSUBCMD)-clea $(OUTPUT)tests/llvm-src-{base,kbuild,prologue,relocation}.c \ $(OUTPUT)pmu-events/pmu-events.c \ $(OUTPUT)$(fadvise_advice_array) \ + $(OUTPUT)$(fsconfig_arrays) \ $(OUTPUT)$(fspick_arrays) \ $(OUTPUT)$(madvise_behavior_array) \ $(OUTPUT)$(mmap_flags_array) \
tools/perf/builtin-trace.c +6 -0
@@ -482,6 +482,10 @@ static const char *bpf_cmd[] = { }; static DEFINE_STRARRAY(bpf_cmd, "BPF_"); +#include "trace/beauty/generated/fsconfig_arrays.c" + +static DEFINE_STRARRAY(fsconfig_cmds, "FSCONFIG_"); +static const char *epoll_ctl_ops[] = {"ADD" ,"DEL" ,"MOD" , }; static DEFINE_STRARRAY_OFFSET(epoll_ctl_ops, "EPOLL_CTL_", 1);
@@ -713,6 +717,8 @@ static struct syscall_fmt { [2] = { .scnprintf = SCA_FCNTL_ARG, /* arg */ }, }, }, { .name = "flock", .arg = { [1] = { .scnprintf = SCA_FLOCK, /* cmd */ }, }, }, + { .name = "fsconfig", + .arg = { [1] = STRARRAY(cmd, fsconfig_cmds), }, }, { .name = "fspick", .arg = { [0] = { .scnprintf = SCA_FDAT, /* dfd */ }, [1] = { .scnprintf = SCA_FILENAME, /* path */ },
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 14/41 perf beauty: Add generator for fsmount's 'attr_flags' arg values
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
$ tools/perf/trace/beauty/fsmount.sh
static const char *fsmount_attr_flags[] = {
[ilog2(0x00000001) + 1] = "RDONLY",
[ilog2(0x00000002) + 1] = "NOSUID",
[ilog2(0x00000004) + 1] = "NODEV",
[ilog2(0x00000008) + 1] = "NOEXEC",
[ilog2(0x00000010) + 1] = "NOATIME",
[ilog2(0x00000020) + 1] = "STRICTATIME",
[ilog2(0x00000080) + 1] = "NODIRATIME",
}MOUNT_ATTR__ATIME and MOUNT_ATTR_RELATIME will be special cased in the fsmount__scnprintf_flags() beautifier.
--- tools/perf/trace/beauty/fsmount.sh | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+) create mode 100755 tools/perf/trace/beauty/fsmount.sh
tools/perf/trace/beauty/fsmount.sh new file +22 -0
@@ -0,0 +1,22 @@ +#!/bin/sh +# SPDX-License-Identifier: LGPL-2.1 + +if [ $# -ne 1 ] ; then + linux_header_dir=tools/include/uapi/linux +else + linux_header_dir=$1 +fi + +linux_mount=${linux_header_dir}/mount.h + +# Remove MOUNT_ATTR_RELATIME as it is zeros, handle it a special way in the beautifier +# Only handle MOUNT_ATTR_ followed by a capital letter/num as __ is special case +# for things like MOUNT_ATTR__ATIME that is a mask for the possible ATIME handling +# bits. Special case it as well in the beautifier + +printf "static const char *fsmount_attr_flags[] = {\n" +regex='^[[:space:]]*#[[:space:]]*define[[:space:]]+MOUNT_ATTR_([[:alnum:]][[:alnum:]_]+)[[:space:]]+(0x[[:xdigit:]]+)[[:space:]]*.*' +egrep $regex ${linux_mount} | grep -v MOUNT_ATTR_RELATIME | \ + sed -r "s/$regex/\2 \1/g" | \ + xargs printf "\t[ilog2(%s) + 1] = \"%s\",\n" +printf "};\n"
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 15/41 perf trace: Introduce syscall_arg__scnprintf_strarray_flags
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
So that one can just define a strarray and process it as a set of flags, similar to syscall_arg__scnprintf_strarray() with plain arrays.
--- tools/perf/builtin-trace.c | 5 +++++ tools/perf/trace/beauty/beauty.h | 3 +++ 2 files changed, 8 insertions(+)
tools/perf/builtin-trace.c +5 -0
@@ -403,6 +403,11 @@ static size_t syscall_arg__scnprintf_strarray(char *bf, size_t size,#define SCA_STRARRAY syscall_arg__scnprintf_strarray +size_t syscall_arg__scnprintf_strarray_flags (char *bf,size_t size,struct syscall_arg *arg) +{ +return strarray__scnprintf_flags (arg->parm, bf, size, arg->show_string_prefix, arg->val); +} +size_t strarrays__scnprintf (struct strarrays *sas,char *bf,size_t size,const char *intfmt,bool show_prefix,int val) {size_t printed;
tools/perf/trace/beauty/beauty.h +3 -0
@@ -108,6 +108,9 @@ struct syscall_arg {unsigned long syscall_arg__val (struct syscall_arg *arg,u8 idx); +size_t syscall_arg__scnprintf_strarray_flags (char *bf,size_t size,struct syscall_arg *arg); +#define SCA_STRARRAY_FLAGS syscall_arg__scnprintf_strarray_flags +size_t syscall_arg__scnprintf_strarrays (char *bf,size_t size,struct syscall_arg *arg);#define SCA_STRARRAYS syscall_arg__scnprintf_strarrays
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 16/41 perf trace: Beautify 'fsmount' arguments
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Use existing beautifiers for the first arg, fd, assigned using the heuristic that looks for syscall arg names and associates SCA_FD with 'fd' named argumes, and wire up the recently introduced fsmount attr_flags table generator.
Now it should be possible to just use:
perf trace -e fsmount
As root and see all fsmount syscalls with its args beautified.
# cat sys_fsmount.c #define _GNU_SOURCE /* See feature_test_macros(7) */ #include <unistd.h> #include <sys/syscall.h> /* For SYS_xxx definitions */
#define __NR_fsmount 432
#define MOUNT_ATTR_RDONLY 0x00000001 /* Mount read-only */
#define MOUNT_ATTR_NOSUID 0x00000002 /* Ignore suid and sgid bits */
#define MOUNT_ATTR_NODEV 0x00000004 /* Disallow access to device special files */
#define MOUNT_ATTR_NOEXEC 0x00000008 /* Disallow program execution */
#define MOUNT_ATTR__ATIME 0x00000070 /* Setting on how atime should be updated */
#define MOUNT_ATTR_RELATIME 0x00000000 /* - Update atime relative to mtime/ctime. */
#define MOUNT_ATTR_NOATIME 0x00000010 /* - Do not update access times. */
#define MOUNT_ATTR_STRICTATIME 0x00000020 /* - Always perform atime updates */
#define MOUNT_ATTR_NODIRATIME 0x00000080 /* Do not update directory access times */
static inline int sys_fsmount(int fs_fd, int flags, int attr_flags)
{
syscall(__NR_fsmount, fs_fd, flags, attr_flags);
}
int main(int argc, char *argv[])
{
int attr_flags = 0, fs_fd = 0;
sys_fsmount(fs_fd++, 0, attr_flags);
attr_flags |= MOUNT_ATTR_RDONLY;
sys_fsmount(fs_fd++, 1, attr_flags);
attr_flags |= MOUNT_ATTR_NOSUID;
sys_fsmount(fs_fd++, 0, attr_flags);
attr_flags |= MOUNT_ATTR_NODEV;
sys_fsmount(fs_fd++, 1, attr_flags);
attr_flags |= MOUNT_ATTR_NOEXEC;
sys_fsmount(fs_fd++, 0, attr_flags);
attr_flags |= MOUNT_ATTR_NOATIME;
sys_fsmount(fs_fd++, 1, attr_flags);
attr_flags |= MOUNT_ATTR_STRICTATIME;
sys_fsmount(fs_fd++, 0, attr_flags);
attr_flags |= MOUNT_ATTR_NODIRATIME;
sys_fsmount(fs_fd++, 0, attr_flags);
return 0;
}
#
# perf trace -e fsmount ./sys_fsmount
fsmount(0, 0, MOUNT_ATTR_RELATIME) = -1 EINVAL (Invalid argument)
fsmount(1, FSMOUNT_CLOEXEC, MOUNT_ATTR_RDONLY|MOUNT_ATTR_RELATIME) = -1 EINVAL (Invalid argument)
fsmount(2, 0, MOUNT_ATTR_RDONLY|MOUNT_ATTR_NOSUID|MOUNT_ATTR_RELATIME) = -1 EINVAL (Invalid argument)
fsmount(3, FSMOUNT_CLOEXEC, MOUNT_ATTR_RDONLY|MOUNT_ATTR_NOSUID|MOUNT_ATTR_NODEV|MOUNT_ATTR_RELATIME) = -1 EBADF (Bad file descriptor)
fsmount(4, 0, MOUNT_ATTR_RDONLY|MOUNT_ATTR_NOSUID|MOUNT_ATTR_NODEV|MOUNT_ATTR_NOEXEC|MOUNT_ATTR_RELATIME) = -1 EBADF (Bad file descriptor)
fsmount(5, FSMOUNT_CLOEXEC, MOUNT_ATTR_RDONLY|MOUNT_ATTR_NOSUID|MOUNT_ATTR_NODEV|MOUNT_ATTR_NOEXEC|MOUNT_ATTR_NOATIME) = -1 EBADF (Bad file descriptor)
fsmount(6, 0, MOUNT_ATTR_RDONLY|MOUNT_ATTR_NOSUID|MOUNT_ATTR_NODEV|MOUNT_ATTR_NOEXEC|MOUNT_ATTR_NOATIME|MOUNT_ATTR_STRICTATIME) = -1 EINVAL (Invalid argument)
fsmount(7, 0, MOUNT_ATTR_RDONLY|MOUNT_ATTR_NOSUID|MOUNT_ATTR_NODEV|MOUNT_ATTR_NOEXEC|MOUNT_ATTR_NOATIME|MOUNT_ATTR_STRICTATIME|MOUNT_ATTR_NODIRATIME) = -1 EINVAL (Invalid argument)
#--- tools/perf/Makefile.perf | 8 ++++++++ tools/perf/builtin-trace.c | 12 +++++++++++ tools/perf/trace/beauty/Build | 1 + tools/perf/trace/beauty/beauty.h | 3 +++ tools/perf/trace/beauty/fsmount.c | 34 +++++++++++++++++++++++++++++++ 5 files changed, 58 insertions(+) create mode 100644 tools/perf/trace/beauty/fsmount.c
tools/perf/Makefile.perf +8 -0
@@ -419,6 +419,12 @@ fadvise_advice_tbl := $(srctree)/tools/perf/trace/beauty/fadvise.sh $(fadvise_advice_array): $(linux_uapi_dir)/in.h $(fadvise_advice_tbl) $(Q)$(SHELL) '$(fadvise_advice_tbl)' $(linux_uapi_dir) > $@ +fsmount_arrays := $(beauty_outdir)/fsmount_arrays.c +fsmount_tbls := $(srctree)/tools/perf/trace/beauty/fsmount.sh + +$(fsmount_arrays): $(linux_uapi_dir)/fs.h $(fsmount_tbls) + $(Q)$(SHELL) '$(fsmount_tbls)' $(linux_uapi_dir) > $@ + fspick_arrays := $(beauty_outdir)/fspick_arrays.c fspick_tbls := $(srctree)/tools/perf/trace/beauty/fspick.sh
@@ -647,6 +653,7 @@ build-dir = $(if $(__build-dir),$(__build-dir),.) prepare: $(OUTPUT)PERF-VERSION-FILE $(OUTPUT)common-cmds.h archheaders $(drm_ioctl_array) \ $(fadvise_advice_array) \ $(fsconfig_arrays) \ + $(fsmount_arrays) \ $(fspick_arrays) \ $(pkey_alloc_access_rights_array) \ $(sndrv_pcm_ioctl_array) \
@@ -944,6 +951,7 @@ clean:: $(LIBTRACEEVENT)-clean $(LIBAPI)-clean $(LIBBPF)-clean $(LIBSUBCMD)-clea $(OUTPUT)pmu-events/pmu-events.c \ $(OUTPUT)$(fadvise_advice_array) \ $(OUTPUT)$(fsconfig_arrays) \ + $(OUTPUT)$(fsmount_arrays) \ $(OUTPUT)$(fspick_arrays) \ $(OUTPUT)$(madvise_behavior_array) \ $(OUTPUT)$(mmap_flags_array) \
tools/perf/builtin-trace.c +12 -0
@@ -487,6 +487,11 @@ static const char *bpf_cmd[] = { }; static DEFINE_STRARRAY(bpf_cmd, "BPF_"); +static const char *fsmount_flags[] = { + [1 ] ="CLOEXEC" , +}; +static DEFINE_STRARRAY(fsmount_flags, "FSMOUNT_"); +#include "trace/beauty/generated/fsconfig_arrays.c" static DEFINE_STRARRAY(fsconfig_cmds, "FSCONFIG_");
@@ -651,6 +656,10 @@ static size_t syscall_arg__scnprintf_getrandom_flags(char *bf, size_t size, { .scnprintf = SCA_STRARRAY, \ .parm = &strarray__##array, } +#define STRARRAY_FLAGS (name, array) \ + { .scnprintf = SCA_STRARRAY_FLAGS, \ + .parm = &strarray__##array, } +#include "trace/beauty/arch_errno_names.c" #include "trace/beauty/eventfd.c" #include "trace/beauty/futex_op.c"
@@ -724,6 +733,9 @@ static struct syscall_fmt { .arg = { [1] = { .scnprintf = SCA_FLOCK, /* cmd */ }, }, }, { .name = "fsconfig", .arg = { [1] = STRARRAY(cmd, fsconfig_cmds), }, }, + { .name = "fsmount", + .arg = { [1] = STRARRAY_FLAGS(flags, fsmount_flags), + [2] = { .scnprintf = SCA_FSMOUNT_ATTR_FLAGS, /* attr_flags */ }, }, }, { .name = "fspick", .arg = { [0] = { .scnprintf = SCA_FDAT, /* dfd */ }, [1] = { .scnprintf = SCA_FILENAME, /* path */ },
tools/perf/trace/beauty/Build +1 -0
@@ -1,6 +1,7 @@ perf-y += clone.o perf-y += fcntl.o perf-y += flock.o +perf-y += fsmount.o perf-y += fspick.o ifeq ($(SRCARCH),$(filter $(SRCARCH),x86)) perf-y += ioctl.o
tools/perf/trace/beauty/beauty.h +3 -0
@@ -144,6 +144,9 @@ size_t syscall_arg__scnprintf_fcntl_arg(char *bf, size_t size, struct syscall_arsize_t syscall_arg__scnprintf_flock (char *bf,size_t size,struct syscall_arg *arg);#define SCA_FLOCK syscall_arg__scnprintf_flock +size_t syscall_arg__scnprintf_fsmount_attr_flags (char *bf,size_t size,struct syscall_arg *arg); +#define SCA_FSMOUNT_ATTR_FLAGS syscall_arg__scnprintf_fsmount_attr_flags +size_t syscall_arg__scnprintf_fspick_flags (char *bf,size_t size,struct syscall_arg *arg);#define SCA_FSPICK_FLAGS syscall_arg__scnprintf_fspick_flags
tools/perf/trace/beauty/fsmount.c new file +34 -0
@@ -0,0 +1,34 @@ +// SPDX-License-Identifier: LGPL-2.1 +/* +* trace/beauty/fsmount.c +* +* Copyright (C) 2019, Red Hat Inc, Arnaldo Carvalho de Melo <[email protected]> +*/ + +#include "trace/beauty/beauty.h" +#include <linux/log2.h> +#include <uapi/linux/mount.h> + +static size_t fsmount__scnprintf_attr_flags (unsigned long flags,char *bf,size_t size,bool show_prefix) +{ +#include "trace/beauty/generated/fsmount_arrays.c" + static DEFINE_STRARRAY(fsmount_attr_flags, "MOUNT_ATTR_"); +size_t printed =0 ; + +if ((flags & ~MOUNT_ATTR__ATIME ) !=0 ) + printed +=strarray__scnprintf_flags (&strarray__fsmount_attr_flags, bf, size, show_prefix, flags); + +if ((flags &MOUNT_ATTR__ATIME ) ==MOUNT_ATTR_RELATIME ) { + printed +=scnprintf (bf + printed, size - printed,"%s%s%s" , + printed ?"|" :"" , show_prefix ?"MOUNT_ATTR_" :"" ,"RELATIME" ); + } + +return printed; +} + +size_t syscall_arg__scnprintf_fsmount_attr_flags (char *bf,size_t size,struct syscall_arg *arg) +{ +unsigned long flags = arg->val; + +return fsmount__scnprintf_attr_flags (flags, bf, size, arg->show_string_prefix); +}
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 17/41 perf trace beauty clone: Handle CLONE_PIDFD
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
In addition to the older flags. This will allow something like this to be implemented in 'perf trace"
perf trace -e clone/PIDFD in flags/
I.e. ask for strace like tracing, system wide, looking for 'clone' syscalls that have the CLONE_PIDFD bit set in the 'flags' arg.
For now we'll just see PIDFD if it is set in the 'flags' arg.
--- tools/perf/trace/beauty/clone.c | 1 + 1 file changed, 1 insertion(+)
tools/perf/trace/beauty/clone.c +1 -0
@@ -25,6 +25,7 @@ static size_t clone__scnprintf_flags(unsigned long flags, char *bf, size_t size,P_FLAG (FS );P_FLAG (FILES );P_FLAG (SIGHAND ); +P_FLAG (PIDFD );P_FLAG (PTRACE );P_FLAG (VFORK );P_FLAG (PARENT );
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 18/41 perf beauty: Add generator for sync_file_range's 'flags' arg values
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
$ tools/perf/trace/beauty/sync_file_range.sh
static const char *sync_file_range_flags[] = {
[ilog2(1) + 1] = "WAIT_BEFORE",
[ilog2(2) + 1] = "WRITE",
[ilog2(4) + 1] = "WAIT_AFTER",
};
$When all are the above are present, then we have something called SYNC_FILE_RANGE_WRITE_AND_WAIT, that will be special cased in the upcoming scnprintf beautifier for this flags arg.
--- tools/perf/trace/beauty/sync_file_range.sh | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100755 tools/perf/trace/beauty/sync_file_range.sh
tools/perf/trace/beauty/sync_file_range.sh new file +17 -0
@@ -0,0 +1,17 @@ +#!/bin/sh +# SPDX-License-Identifier: LGPL-2.1 + +if [ $# -ne 1 ] ; then + linux_header_dir=tools/include/uapi/linux +else + linux_header_dir=$1 +fi + +linux_fs=${linux_header_dir}/fs.h + +printf "static const char *sync_file_range_flags[] = {\n" +regex='^[[:space:]]*#[[:space:]]*define[[:space:]]+SYNC_FILE_RANGE_([[:alnum:]_]+)[[:space:]]+([[:xdigit:]]+)[[:space:]]*.*' +egrep $regex ${linux_fs} | \ + sed -r "s/$regex/\2 \1/g" | \ + xargs printf "\t[ilog2(%s) + 1] = \"%s\",\n" +printf "};\n"
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 19/41 perf trace: Beautify 'sync_file_range' arguments
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Use existing beautifiers for the first arg, fd, assigned using the heuristic that looks for syscall arg names and associates SCA_FD with 'fd' named argumes, and wire up the recently introduced sync_file_range flags table generator.
Now it should be possible to just use:
perf trace -e sync_file_range
As root and see all sync_file_range syscalls with its args beautified.
Doing a syscall strace like session looking for this syscall, then run postgresql's initdb command:
# perf trace -e sync_file_range <SNIP> initdb/1332 sync_file_range(6</var/lib/pgsql/data/global/1260_fsm>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(6</var/lib/pgsql/data/global/1260_fsm>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(7</var/lib/pgsql/data/base/1/2682>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(6</var/lib/pgsql/data/global/1260_fsm>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(7</var/lib/pgsql/data/base/1/2682>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(6</var/lib/pgsql/data/global/1260_fsm>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(5</var/lib/pgsql/data/global>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(4</var/lib/pgsql/data>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 initdb/1332 sync_file_range(4</var/lib/pgsql/data>, 0, 0, SYNC_FILE_RANGE_WRITE) = 0 ^C #
--- tools/perf/Makefile.perf | 12 +++++++-- tools/perf/builtin-trace.c | 2 ++ tools/perf/trace/beauty/Build | 1 + tools/perf/trace/beauty/beauty.h | 3 +++ tools/perf/trace/beauty/sync_file_range.c | 31 +++++++++++++++++++++++ 5 files changed, 47 insertions(+), 2 deletions(-) create mode 100644 tools/perf/trace/beauty/sync_file_range.c
tools/perf/Makefile.perf +10 -2
@@ -549,6 +549,12 @@ arch_errno_tbl := $(srctree)/tools/perf/trace/beauty/arch_errno_names.sh $(arch_errno_name_array): $(arch_errno_tbl) $(Q)$(SHELL) '$(arch_errno_tbl)' $(CC) $(arch_errno_hdr_dir) > $@ +sync_file_range_arrays := $(beauty_outdir)/sync_file_range_arrays.c +sync_file_range_tbls := $(srctree)/tools/perf/trace/beauty/sync_file_range.sh + +$(sync_file_range_arrays): $(linux_uapi_dir)/fs.h $(sync_file_range_tbls) + $(Q)$(SHELL) '$(sync_file_range_tbls)' $(linux_uapi_dir) > $@ + all: shell_compatibility_test $(ALL_PROGRAMS) $(LANG_BINDINGS) $(OTHER_PROGRAMS) # Create python binding output directory if not already present
@@ -671,7 +677,8 @@ prepare: $(OUTPUT)PERF-VERSION-FILE $(OUTPUT)common-cmds.h archheaders $(drm_ioc $(usbdevfs_ioctl_array) \ $(x86_arch_prctl_code_array) \ $(rename_flags_array) \ - $(arch_errno_name_array) + $(arch_errno_name_array) \ + $(sync_file_range_arrays) $(OUTPUT)%.o: %.c prepare FORCE $(Q)$(MAKE) -f $(srctree)/tools/build/Makefile.build dir=$(build-dir) $@
@@ -970,7 +977,8 @@ clean:: $(LIBTRACEEVENT)-clean $(LIBAPI)-clean $(LIBBPF)-clean $(LIBSUBCMD)-clea $(OUTPUT)$(usbdevfs_ioctl_array) \ $(OUTPUT)$(x86_arch_prctl_code_array) \ $(OUTPUT)$(rename_flags_array) \ - $(OUTPUT)$(arch_errno_name_array) + $(OUTPUT)$(arch_errno_name_array) \ + $(OUTPUT)$(sync_file_range_arrays) $(QUIET_SUBDIR0)Documentation $(QUIET_SUBDIR1) clean #
tools/perf/builtin-trace.c +2 -0
@@ -912,6 +912,8 @@ static struct syscall_fmt { .arg = { [0] = { .scnprintf = SCA_FILENAME, /* specialfile */ }, }, }, { .name = "symlinkat", .arg = { [0] = { .scnprintf = SCA_FDAT, /* dfd */ }, }, }, + { .name = "sync_file_range", + .arg = { [3] = { .scnprintf = SCA_SYNC_FILE_RANGE_FLAGS, /* flags */ }, }, }, { .name = "tgkill", .arg = { [2] = { .scnprintf = SCA_SIGNUM, /* sig */ }, }, }, { .name = "tkill",
tools/perf/trace/beauty/Build +1 -0
@@ -16,3 +16,4 @@ perf-y += renameat.o perf-y += sockaddr.o perf-y += socket.o perf-y += statx.o +perf-y += sync_file_range.o
tools/perf/trace/beauty/beauty.h +3 -0
@@ -201,6 +201,9 @@ size_t syscall_arg__scnprintf_statx_flags(char *bf, size_t size, struct syscall_size_t syscall_arg__scnprintf_statx_mask (char *bf,size_t size,struct syscall_arg *arg);#define SCA_STATX_MASK syscall_arg__scnprintf_statx_mask +size_t syscall_arg__scnprintf_sync_file_range_flags (char *bf,size_t size,struct syscall_arg *arg); +#define SCA_SYNC_FILE_RANGE_FLAGS syscall_arg__scnprintf_sync_file_range_flags +size_t open__scnprintf_flags (unsigned long flags,char *bf,size_t size,bool show_prefix); void syscall_arg__set_ret_scnprintf(struct syscall_arg *arg,
tools/perf/trace/beauty/sync_file_range.c new file +31 -0
@@ -0,0 +1,31 @@ +// SPDX-License-Identifier: LGPL-2.1 +/* +* trace/beauty/sync_file_range.c +* +* Copyright (C) 2019, Red Hat Inc, Arnaldo Carvalho de Melo <[email protected]> +*/ + +#include "trace/beauty/beauty.h" +#include <linux/log2.h> +#include <uapi/linux/fs.h> + +static size_t sync_file_range__scnprintf_flags (unsigned long flags,char *bf,size_t size,bool show_prefix) +{ +#include "trace/beauty/generated/sync_file_range_arrays.c" + static DEFINE_STRARRAY(sync_file_range_flags, "SYNC_FILE_RANGE_"); +size_t printed =0 ; + +if ((flags &SYNC_FILE_RANGE_WRITE_AND_WAIT ) ==SYNC_FILE_RANGE_WRITE_AND_WAIT ) { + printed +=scnprintf (bf + printed, size - printed,"%s%s" , show_prefix ?"SYNC_FILE_RANGE_" :"" ,"WRITE_AND_WAIT" ); + flags &= ~SYNC_FILE_RANGE_WRITE_AND_WAIT ; + } + +return printed +strarray__scnprintf_flags (&strarray__sync_file_range_flags, bf + printed, size - printed, show_prefix, flags); +} + +size_t syscall_arg__scnprintf_sync_file_range_flags (char *bf,size_t size,struct syscall_arg *arg) +{ +unsigned long flags = arg->val; + +return sync_file_range__scnprintf_flags (flags, bf, size, arg->show_string_prefix); +}
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 20/41 perf top: Add --namespaces option
In reply to Arnaldo Carvalho de MeloFrom: Namhyung Kim <[email protected]>
Since 'perf record' already have this option, let's have it for 'perf top' as well.
--- tools/perf/Documentation/perf-top.txt | 5 +++++ tools/perf/builtin-top.c | 5 +++++ 2 files changed, 10 insertions(+)
tools/perf/Documentation/perf-top.txt +5 -0
@@ -262,6 +262,11 @@ Default is to monitor all CPUS. The number of threads to run when synthesizing events for existing processes. By default, the number of threads equals to the number of online CPUs. +--namespaces:: + Record events of type PERF_RECORD_NAMESPACES and display it with the + 'cgroup_id' sort key. + + INTERACTIVE PROMPTING KEYS --------------------------
tools/perf/builtin-top.c +5 -0
@@ -1208,6 +1208,9 @@ static int __cmd_top(struct perf_top *top)init_process_thread (top); +if (opts->record_namespaces) + top->tool.namespace_events = true; + ret =perf_event__synthesize_bpf_events (top->session, perf_event__process, &top->session->machines.host, &top->record_opts);
@@ -1500,6 +1503,8 @@ int cmd_top(int argc, const char **argv)OPT_BOOLEAN (0 ,"force" , &symbol_conf.force,"don't complain, do it" ),OPT_UINTEGER (0 ,"num-thread-synthesize" , &top.nr_threads_synthesize,"number of thread to run event synthesize" ), +OPT_BOOLEAN (0 ,"namespaces" , &opts->record_namespaces, +"Record namespaces events" ), OPT_END() };struct perf_evlist *sb_evlist =NULL ;
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 21/41 perf tools: Remove const from thread read accessors
In reply to Arnaldo Carvalho de MeloFrom: Namhyung Kim <[email protected]>
The namespaces and comm fields of a thread are protected by rwsem and require write access for it. So it ended up using a cast to remove the const qualifier. Let's get rid of the const then.
--- tools/perf/util/hist.c | 2 +- tools/perf/util/thread.c | 12 ++++++------ tools/perf/util/thread.h | 4 ++-- 3 files changed, 9 insertions(+), 9 deletions(-)
tools/perf/util/hist.c +1 -1
@@ -2561,7 +2561,7 @@ int __hists__scnprintf_title(struct hists *hists, char *bf, size_t size, bool shchar unit;int printed;const struct dso *dso = hists->dso_filter; -const struct thread *thread = hists->thread_filter; +struct thread *thread = hists->thread_filter;int socket_id = hists->socket_filter;unsigned long nr_samples = hists->stats.nr_events[PERF_RECORD_SAMPLE ];u64 nr_events = hists->stats.total_period;
tools/perf/util/thread.c +6 -6
@@ -141,13 +141,13 @@ static struct namespaces *__thread__namespaces(const struct thread *thread) return list_first_entry(&thread->namespaces_list, struct namespaces, list); } -struct namespaces *thread__namespaces (const struct thread *thread) +struct namespaces *thread__namespaces (struct thread *thread) {struct namespaces *ns; -down_read ((struct rw_semaphore *)&thread->namespaces_lock); +down_read (&thread->namespaces_lock); ns =__thread__namespaces (thread); -up_read ((struct rw_semaphore *)&thread->namespaces_lock); +up_read (&thread->namespaces_lock);return ns; }
@@ -271,13 +271,13 @@ static const char *__thread__comm_str(const struct thread *thread)return comm__str (comm); } -const char *thread__comm_str (const struct thread *thread) +const char *thread__comm_str (struct thread *thread) {const char *str; -down_read ((struct rw_semaphore *)&thread->comm_lock); +down_read (&thread->comm_lock); str =__thread__comm_str (thread); -up_read ((struct rw_semaphore *)&thread->comm_lock); +up_read (&thread->comm_lock);return str; }
tools/perf/util/thread.h +2 -2
@@ -76,7 +76,7 @@ static inline void thread__exited(struct thread *thread) thread->dead = true; } -struct namespaces *thread__namespaces (const struct thread *thread); +struct namespaces *thread__namespaces (struct thread *thread);int thread__set_namespaces (struct thread *thread,u64 timestamp,struct namespaces_event *event);
@@ -93,7 +93,7 @@ int thread__set_comm_from_proc(struct thread *thread);int thread__comm_len (struct thread *thread);struct comm *thread__comm (const struct thread *thread);struct comm *thread__exec_comm (const struct thread *thread); -const char *thread__comm_str (const struct thread *thread); +const char *thread__comm_str (struct thread *thread);int thread__insert_map (struct thread *thread,struct map *map);int thread__fork (struct thread *thread,struct thread *parent,u64 timestamp,bool do_maps_clone);size_t thread__fprintf (struct thread *thread,FILE *fp);
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 22/41 perf dso: Separate generic code in dso__data_file_size()
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
Moving file specific code in dso__data_file_size function into separate file_size function. I'll add bpf specific code in following patches.
--- tools/perf/util/dso.c | 19 ++++++++++++------- 1 file changed, 12 insertions(+), 7 deletions(-)
tools/perf/util/dso.c +12 -7
@@ -898,18 +898,12 @@ static ssize_t cached_read(struct dso *dso, struct machine *machine,return r; } -int dso__data_file_size (struct dso *dso,struct machine *machine) +static int file_size (struct dso *dso,struct machine *machine) {int ret =0 ;struct stat st;char sbuf[STRERR_BUFSIZE ]; -if (dso->data.file_size) -return 0 ; - -if (dso->data.status ==DSO_DATA_STATUS_ERROR ) -return -1 ; -pthread_mutex_lock (&dso__data_open_lock);/*
@@ -938,6 +932,17 @@ int dso__data_file_size(struct dso *dso, struct machine *machine)return ret; } +int dso__data_file_size (struct dso *dso,struct machine *machine) +{ +if (dso->data.file_size) +return 0 ; + +if (dso->data.status ==DSO_DATA_STATUS_ERROR ) +return -1 ; + +return file_size (dso, machine); +} +/** * dso__data_size - Return dso data size * @dso: dso object
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 23/41 perf dso: Separate generic code in dso_cache__read
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
Move the file specific code in the dso_cache__read function to a separate file_read function. I'll add BPF specific code in the following patches.
--- tools/perf/util/dso.c | 48 ++++++++++++++++++++++++------------------- 1 file changed, 27 insertions(+), 21 deletions(-)
tools/perf/util/dso.c +27 -21
@@ -794,6 +794,31 @@ dso_cache__memcpy(struct dso_cache *cache, u64 offset,return cache_size; } +static ssize_t file_read (struct dso *dso,struct machine *machine, +u64 offset,char *data) +{ +ssize_t ret; + +pthread_mutex_lock (&dso__data_open_lock); + +/* +* dso->data.fd might be closed if other thread opened another +* file (dso) due to open file limit (RLIMIT_NOFILE). +*/ +try_to_open_dso (dso, machine); + +if (dso->data.fd <0 ) { + dso->data.status =DSO_DATA_STATUS_ERROR ; + ret = -errno; + goto out; + } + + ret =pread (dso->data.fd, data,DSO__DATA_CACHE_SIZE , offset); +out: +pthread_mutex_unlock (&dso__data_open_lock); +return ret; +} +static ssize_t dso_cache__read (struct dso *dso,struct machine *machine,u64 offset,u8 *data,ssize_t size)
@@ -803,37 +828,18 @@ dso_cache__read(struct dso *dso, struct machine *machine,ssize_t ret;do { -u64 cache_offset; +u64 cache_offset = offset &DSO__DATA_CACHE_MASK ; cache =zalloc (sizeof (*cache) +DSO__DATA_CACHE_SIZE );if (!cache)return -ENOMEM ; -pthread_mutex_lock (&dso__data_open_lock); - -/* -* dso->data.fd might be closed if other thread opened another -* file (dso) due to open file limit (RLIMIT_NOFILE). -*/ -try_to_open_dso (dso, machine); - -if (dso->data.fd <0 ) { - ret = -errno; - dso->data.status =DSO_DATA_STATUS_ERROR ; -break ; - } - - cache_offset = offset &DSO__DATA_CACHE_MASK ; - - ret =pread (dso->data.fd, cache->data,DSO__DATA_CACHE_SIZE , cache_offset); -if (ret <=0 ) -break ; + ret =file_read (dso, machine, cache_offset, cache->data); cache->offset = cache_offset; cache->size = ret; }while (0 ); -pthread_mutex_unlock (&dso__data_open_lock);if (ret >0 ) { old =dso_cache__insert (dso, cache);
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 24/41 perf dso: Simplify dso_cache__read function
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
There's no need for the while loop now, also we can connect two (ret >
0) condition legs together.
--- tools/perf/util/dso.c | 17 ++++++----------- 1 file changed, 6 insertions(+), 11 deletions(-)
tools/perf/util/dso.c +6 -11
@@ -823,25 +823,20 @@ static ssize_t dso_cache__read(struct dso *dso, struct machine *machine, u64 offset, u8 *data, ssize_t size) { + u64 cache_offset = offset & DSO__DATA_CACHE_MASK;struct dso_cache *cache;struct dso_cache *old;ssize_t ret; -do { -u64 cache_offset = offset &DSO__DATA_CACHE_MASK ; - - cache =zalloc (sizeof (*cache) +DSO__DATA_CACHE_SIZE ); -if (!cache) -return -ENOMEM ; - - ret =file_read (dso, machine, cache_offset, cache->data); + cache =zalloc (sizeof (*cache) +DSO__DATA_CACHE_SIZE ); +if (!cache) +return -ENOMEM ; + ret =file_read (dso, machine, cache_offset, cache->data); +if (ret >0 ) { cache->offset = cache_offset; cache->size = ret; - }while (0 ); - -if (ret >0 ) { old =dso_cache__insert (dso, cache);if (old) {/* we lose the race */
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 25/41 perf dso: Add BPF DSO read and size hooks
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
Add BPF related code into DSO reading paths to return size (bpf_size) and read the BPF code (bpf_read).
--- tools/perf/util/dso.c | 49 ++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 48 insertions(+), 1 deletion(-)
tools/perf/util/dso.c +48 -1
@@ -9,6 +9,8 @@#include <errno.h> #include <fcntl.h> #include <libgen.h> +#include <bpf/libbpf.h> +#include "bpf-event.h" #include "compress.h" #include "namespaces.h" #include "path.h"
@@ -706,6 +708,44 @@ bool dso__data_status_seen(struct dso *dso, enum dso_data_status_seen by)return false; } +static ssize_t bpf_read (struct dso *dso,u64 offset,char *data) +{ +struct bpf_prog_info_node *node; +ssize_t size =DSO__DATA_CACHE_SIZE ; +u64 len; +u8 *buf; + + node =perf_env__find_bpf_prog_info (dso->bpf_prog.env, dso->bpf_prog.id); +if (!node || !node->info_linear) { + dso->data.status =DSO_DATA_STATUS_ERROR ; +return -1 ; + } + + len = node->info_linear->info.jited_prog_len; + buf = (u8 *)(uintptr_t )node->info_linear->info.jited_prog_insns; + +if (offset >= len) +return -1 ; + + size = (ssize_t )min (len - offset, (u64 )size); +memcpy (data, buf + offset, size); +return size; +} + +static int bpf_size (struct dso *dso) +{ +struct bpf_prog_info_node *node; + + node =perf_env__find_bpf_prog_info (dso->bpf_prog.env, dso->bpf_prog.id); +if (!node || !node->info_linear) { + dso->data.status =DSO_DATA_STATUS_ERROR ; +return -1 ; + } + + dso->data.file_size = node->info_linear->info.jited_prog_len; +return 0 ; +} +static void dso_cache__free (struct dso *dso) {
@@ -832,7 +872,11 @@ dso_cache__read(struct dso *dso, struct machine *machine,if (!cache)return -ENOMEM ; - ret =file_read (dso, machine, cache_offset, cache->data); +if (dso->binary_type ==DSO_BINARY_TYPE__BPF_PROG_INFO ) + ret =bpf_read (dso, cache_offset, cache->data); +else + ret =file_read (dso, machine, cache_offset, cache->data); +if (ret >0 ) { cache->offset = cache_offset; cache->size = ret;
@@ -941,6 +985,9 @@ int dso__data_file_size(struct dso *dso, struct machine *machine)if (dso->data.status ==DSO_DATA_STATUS_ERROR )return -1 ; +if (dso->binary_type ==DSO_BINARY_TYPE__BPF_PROG_INFO ) +return bpf_size (dso); +return file_size (dso, machine); }
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 26/41 perf script: Pad DSO name for --call-trace
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
Pad the DSO name in --call-trace so we don't have the indent screwed by different DSO name lengths, as now for kernel there's also BPF code displayed.
# perf-with-kcore record pt -e intel_pt//ku -- sleep 1 # perf-core/perf-with-kcore script pt --call-trace
Before:
sleep 3660 [16] 57036.806464404: ([kernel.kallsyms]) kretprobe_perf_func
sleep 3660 [16] 57036.806464404: ([kernel.kallsyms]) trace_call_bpf
sleep 3660 [16] 57036.806464404: ([kernel.kallsyms]) __x86_indirect_thunk_rax
sleep 3660 [16] 57036.806464404: ([kernel.kallsyms]) __x86_indirect_thunk_rax
sleep 3660 [16] 57036.806464725: (bpf_prog_da4fe6b3d2c29b25_trace_return) bpf_get_current_pid_tgid
sleep 3660 [16] 57036.806464725: (bpf_prog_da4fe6b3d2c29b25_trace_return) bpf_ktime_get_ns
sleep 3660 [16] 57036.806464725: ([kernel.kallsyms]) __x86_indirect_thunk_rax
sleep 3660 [16] 57036.806464725: ([kernel.kallsyms]) __x86_indirect_thunk_rax
sleep 3660 [16] 57036.806465045: (bpf_prog_da4fe6b3d2c29b25_trace_return) __htab_map_lookup_elem
sleep 3660 [16] 57036.806465366: ([kernel.kallsyms]) memcmp
sleep 3660 [16] 57036.806465687: (bpf_prog_da4fe6b3d2c29b25_trace_return) bpf_probe_read
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) probe_kernel_read
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) __check_object_size
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) check_stack_object
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) copy_user_enhanced_fast_string
sleep 3660 [16] 57036.806465687: (bpf_prog_da4fe6b3d2c29b25_trace_return) bpf_probe_read
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) probe_kernel_read
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) __check_object_size
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) check_stack_object
sleep 3660 [16] 57036.806465687: ([kernel.kallsyms]) copy_user_enhanced_fast_string
sleep 3660 [16] 57036.806466008: (bpf_prog_da4fe6b3d2c29b25_trace_return) bpf_get_current_uid_gid
sleep 3660 [16] 57036.806466008: ([kernel.kallsyms]) from_kgid
sleep 3660 [16] 57036.806466008: ([kernel.kallsyms]) from_kuid
sleep 3660 [16] 57036.806466008: (bpf_prog_da4fe6b3d2c29b25_trace_return) bpf_perf_event_output
sleep 3660 [16] 57036.806466328: ([kernel.kallsyms]) perf_event_output
sleep 3660 [16] 57036.806466328: ([kernel.kallsyms]) perf_prepare_sample
sleep 3660 [16] 57036.806466328: ([kernel.kallsyms]) perf_misc_flags
sleep 3660 [16] 57036.806466328: ([kernel.kallsyms]) __x86_indirect_thunk_rax
sleep 3660 [16] 57036.806466328: ([kernel.kallsyms]) __x86_indirect_thunk_rax
sleep 3660 [16] 57036.806466328: ([kvm]) kvm_is_in_guest
sleep 3660 [16] 57036.806466649: ([kernel.kallsyms]) __perf_event_header__init_id.isra.0
sleep 3660 [16] 57036.806466649: ([kernel.kallsyms]) perf_output_begin
After:
sleep 3660 [16] 57036.806464404: ([kernel.kallsyms] ) kretprobe_perf_func sleep 3660 [16] 57036.806464404: ([kernel.kallsyms] ) trace_call_bpf sleep 3660 [16] 57036.806464404: ([kernel.kallsyms] ) __x86_indirect_thunk_rax sleep 3660 [16] 57036.806464404: ([kernel.kallsyms] ) __x86_indirect_thunk_rax sleep 3660 [16] 57036.806464725: (bpf_prog_da4fe6b3d2c29b25_trace_return ) bpf_get_current_pid_tgid sleep 3660 [16] 57036.806464725: (bpf_prog_da4fe6b3d2c29b25_trace_return ) bpf_ktime_get_ns sleep 3660 [16] 57036.806464725: ([kernel.kallsyms] ) __x86_indirect_thunk_rax sleep 3660 [16] 57036.806464725: ([kernel.kallsyms] ) __x86_indirect_thunk_rax sleep 3660 [16] 57036.806465045: (bpf_prog_da4fe6b3d2c29b25_trace_return ) __htab_map_lookup_elem sleep 3660 [16] 57036.806465366: ([kernel.kallsyms] ) memcmp sleep 3660 [16] 57036.806465687: (bpf_prog_da4fe6b3d2c29b25_trace_return ) bpf_probe_read sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) probe_kernel_read sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) __check_object_size sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) check_stack_object sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) copy_user_enhanced_fast_string sleep 3660 [16] 57036.806465687: (bpf_prog_da4fe6b3d2c29b25_trace_return ) bpf_probe_read sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) probe_kernel_read sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) __check_object_size sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) check_stack_object sleep 3660 [16] 57036.806465687: ([kernel.kallsyms] ) copy_user_enhanced_fast_string sleep 3660 [16] 57036.806466008: (bpf_prog_da4fe6b3d2c29b25_trace_return ) bpf_get_current_uid_gid sleep 3660 [16] 57036.806466008: ([kernel.kallsyms] ) from_kgid sleep 3660 [16] 57036.806466008: ([kernel.kallsyms] ) from_kuid sleep 3660 [16] 57036.806466008: (bpf_prog_da4fe6b3d2c29b25_trace_return ) bpf_perf_event_output sleep 3660 [16] 57036.806466328: ([kernel.kallsyms] ) perf_event_output sleep 3660 [16] 57036.806466328: ([kernel.kallsyms] ) perf_prepare_sample sleep 3660 [16] 57036.806466328: ([kernel.kallsyms] ) perf_misc_flags sleep 3660 [16] 57036.806466328: ([kernel.kallsyms] ) __x86_indirect_thunk_rax sleep 3660 [16] 57036.806466328: ([kernel.kallsyms] ) __x86_indirect_thunk_rax
--- tools/include/linux/kernel.h | 1 + tools/lib/vsprintf.c | 19 +++++++++++++++++++ tools/perf/builtin-script.c | 1 + tools/perf/util/map.c | 6 ++++++ tools/perf/util/symbol_conf.h | 1 + 5 files changed, 28 insertions(+)
tools/include/linux/kernel.h +1 -0
@@ -102,6 +102,7 @@int vscnprintf (char *buf,size_t size,const char *fmt,va_list args);int scnprintf (char * buf,size_t size,const char * fmt, ...); +int scnprintf_pad (char * buf,size_t size,const char * fmt, ...);#define ARRAY_SIZE (arr) (sizeof(arr) / sizeof((arr)[0]) + __must_be_array(arr))
tools/lib/vsprintf.c +19 -0
@@ -23,3 +23,22 @@ int scnprintf(char * buf, size_t size, const char * fmt, ...)return (i >= ssize) ? (ssize -1 ) : i; } + +int scnprintf_pad (char * buf,size_t size,const char * fmt, ...) +{ +ssize_t ssize = size; +va_list args; +int i; + +va_start (args, fmt); + i =vscnprintf (buf, size, fmt, args); +va_end (args); + +if (i < (int ) size) { +for (; i < (int ) size; i++) + buf[i] =' ' ; + buf[i] =0x0 ; + } + +return (i >= ssize) ? (ssize -1 ) : i; +}
tools/perf/builtin-script.c +1 -0
@@ -3297,6 +3297,7 @@ static int parse_call_trace(const struct option *opt __maybe_unused,parse_output_fields (NULL ,"-ip,-addr,-event,-period,+callindent" ,0 );itrace_parse_synth_opts (opt,"cewp" ,0 ); symbol_conf.nanosecs = true; + symbol_conf.pad_output_len_dso =50 ;return 0 ; }
tools/perf/util/map.c +6 -0
@@ -405,6 +405,7 @@ size_t map__fprintf(struct map *map, FILE *fp)size_t map__fprintf_dsoname (struct map *map,FILE *fp) { +char buf[symbol_conf.pad_output_len_dso +1 ];const char *dsoname ="[unknown]" ;if (map && map->dso) {
@@ -414,6 +415,11 @@ size_t map__fprintf_dsoname(struct map *map, FILE *fp) dsoname = map->dso->name; } +if (symbol_conf.pad_output_len_dso) { +scnprintf_pad (buf, symbol_conf.pad_output_len_dso,"%s" , dsoname); + dsoname = buf; + } +return fprintf (fp,"%s" , dsoname); }
tools/perf/util/symbol_conf.h +1 -0
@@ -69,6 +69,7 @@ struct symbol_conf { *tid_list;const char *symfs;int res_sample; +int pad_output_len_dso; };extern struct symbol_conf symbol_conf;
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 27/41 perf tests: Add map_groups__merge_in test
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
Add map_groups__merge_in test to test the map_groups__merge_in function usage - merging kcore maps into existing eBPF maps.
Committer testing:
# perf test merge 59: map_groups__merge_in : Ok # perf test -v merge 59: map_groups__merge_in : --- start --- test child forked, pid 8349 test child finished with 0 ---- end ---- map_groups__merge_in: Ok #
--- tools/perf/tests/Build | 1 + tools/perf/tests/builtin-test.c | 4 ++ tools/perf/tests/map_groups.c | 120 ++++++++++++++++++++++++++++++++ tools/perf/tests/tests.h | 1 + tools/perf/util/map_groups.h | 2 + tools/perf/util/symbol.c | 2 +- 6 files changed, 129 insertions(+), 1 deletion(-) create mode 100644 tools/perf/tests/map_groups.c
tools/perf/tests/Build +1 -0
@@ -50,6 +50,7 @@ perf-y += perf-hooks.o perf-y += clang.o perf-y += unit_number__scnprintf.o perf-y += mem2node.o +perf-y += map_groups.o $(OUTPUT)tests/llvm-src-base.c: tests/bpf-script-example.c tests/Build $(call rule_mkdir)
tools/perf/tests/builtin-test.c +4 -0
@@ -289,6 +289,10 @@ static struct test generic_tests[] = { .desc = "mem2node", .func = test__mem2node, }, + { + .desc = "map_groups__merge_in", + .func = test__map_groups__merge_in, + }, { .func = NULL, },
tools/perf/tests/map_groups.c new file +120 -0
120 lines not on this page · raw message
tools/perf/tests/tests.h +1 -0
@@ -107,6 +107,7 @@ const char *test__clang_subtest_get_desc(int subtest);int test__clang_subtest_get_nr (void );int test__unit_number__scnprint (struct test *test,int subtest);int test__mem2node (struct test *t,int subtest); +int test__map_groups__merge_in (struct test *t,int subtest);bool test__bp_signal_is_supported (void );bool test__wp_is_supported (void );
tools/perf/util/map_groups.h +2 -0
@@ -88,4 +88,6 @@ int map_groups__fixup_overlappings(struct map_groups *mg, struct map *map, FILEstruct map *map_groups__find_by_name (struct map_groups *mg,const char *name); +int map_groups__merge_in (struct map_groups *kmaps,struct map *new_map); +#endif // __PERF_MAP_GROUPS_H
tools/perf/util/symbol.c +1 -1
@@ -1170,7 +1170,7 @@ static int kcore_mapfn(u64 start, u64 len, u64 pgoff, void *data)* Merges map into map_groups by splitting the new map * within the existing map regions. */ -static int map_groups__merge_in (struct map_groups *kmaps,struct map *new_map) +int map_groups__merge_in (struct map_groups *kmaps,struct map *new_map) {struct map *old_map;LIST_HEAD (merged);
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 28/41 perf script: Add --show-bpf-events to show eBPF related events
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
Add the --show-bpf-events command line option to show the eBPF related events:
PERF_RECORD_KSYMBOL
PERF_RECORD_BPF_EVENT
Usage:
# perf record -a ... # perf script --show-bpf-events ... swapper 0 [000] 0.000000: PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc0ef971d len 229 type 1 flags 0x0 name bpf_prog_2a142ef67aaad174 swapper 0 [000] 0.000000: PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 36 ...
Committer testing:
# perf script --show-bpf-events | egrep -i 'PERF_RECORD_(BPF|KSY)'
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc029a6c3 len 229 type 1 flags 0x0 name bpf_prog_7be49e3934a125ba
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 47
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc029c1ae len 229 type 1 flags 0x0 name bpf_prog_2a142ef67aaad174
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 48
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc02ddd1c len 229 type 1 flags 0x0 name bpf_prog_7be49e3934a125ba
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 49
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc02dfc11 len 229 type 1 flags 0x0 name bpf_prog_2a142ef67aaad174
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 50
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc045da0a len 229 type 1 flags 0x0 name bpf_prog_7be49e3934a125ba
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 51
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc04ef4b4 len 229 type 1 flags 0x0 name bpf_prog_2a142ef67aaad174
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 52
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc09e15da len 229 type 1 flags 0x0 name bpf_prog_7be49e3934a125ba
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 53
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc0d2b1a3 len 229 type 1 flags 0x0 name bpf_prog_2a142ef67aaad174
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 54
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc0fd9850 len 381 type 1 flags 0x0 name bpf_prog_819967866022f1e1_sys_enter
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 179
0 PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc0feb1ec len 191 type 1 flags 0x0 name bpf_prog_c1bd85c092d6e4aa_sys_exit
0 PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 180
^C[root@quaco pt]# perf evlist
intel_pt//ku
dummy:u
#--- tools/perf/Documentation/perf-script.txt | 3 ++ tools/perf/builtin-script.c | 42 ++++++++++++++++++++++++ 2 files changed, 45 insertions(+)
tools/perf/Documentation/perf-script.txt +3 -0
@@ -313,6 +313,9 @@ OPTIONS --show-round-events Display finished round events i.e. events of type PERF_RECORD_FINISHED_ROUND. +--show-bpf-events + Display bpf events i.e. events of type PERF_RECORD_KSYMBOL and PERF_RECORD_BPF_EVENT. + --demangle:: Demangle symbol names to human readable form. It's enabled by default, disable with --no-demangle.
tools/perf/builtin-script.c +42 -0
66 lines not on this page · raw message
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 29/41 perf script: Remove superfluous BPF event titles
In reply to Arnaldo Carvalho de MeloFrom: Jiri Olsa <[email protected]>
There's no need to display "ksymbol event with" text for the PERF_RECORD_KSYMBOL event and "bpf event with" test for the PERF_RECORD_BPF_EVENT event.
Remove it so it also goes along with other side-band events display.
Before:
# perf script --show-bpf-events ... swapper 0 [000] 0.000000: PERF_RECORD_KSYMBOL ksymbol event with addr ffffffffc0ef971d len 229 type 1 flags 0x0 name bpf_prog_2a142ef67aaad174 swapper 0 [000] 0.000000: PERF_RECORD_BPF_EVENT bpf event with type 1, flags 0, id 36
After:
# perf script --show-bpf-events ... swapper 0 [000] 0.000000: PERF_RECORD_KSYMBOL addr ffffffffc0ef971d len 229 type 1 flags 0x0 name bpf_prog_2a142ef67aaad174 swapper 0 [000] 0.000000: PERF_RECORD_BPF_EVENT type 1, flags 0, id 36
--- tools/perf/util/event.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
tools/perf/util/event.c +2 -2
@@ -1486,7 +1486,7 @@ static size_t perf_event__fprintf_lost(union perf_event *event, FILE *fp)size_t perf_event__fprintf_ksymbol (union perf_event *event,FILE *fp) { -return fprintf (fp," ksymbol event with addr %" PRIx64" len %u type %u flags 0x%x name %s\n" , +return fprintf (fp," addr %" PRIx64" len %u type %u flags 0x%x name %s\n" , event->ksymbol_event.addr, event->ksymbol_event.len, event->ksymbol_event.ksym_type, event->ksymbol_event.flags, event->ksymbol_event.name);
@@ -1494,7 +1494,7 @@ size_t perf_event__fprintf_ksymbol(union perf_event *event, FILE *fp)size_t perf_event__fprintf_bpf_event (union perf_event *event,FILE *fp) { -return fprintf (fp," bpf event with type %u, flags %u, id %u\n" , +return fprintf (fp," type %u, flags %u, id %u\n" , event->bpf_event.type, event->bpf_event.flags, event->bpf_event.id); }
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 30/41 perf version: Append 12 git SHA chars to the version string
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Bumping it from just 4:
Before:
$ perf -v perf version 5.2.rc1.g80978f $
After:
$ perf -v perf version 5.2.rc1.g80978fc864c5 $
--- tools/perf/util/PERF-VERSION-GEN | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
tools/perf/util/PERF-VERSION-GEN +1 -1
@@ -19,7 +19,7 @@ TAG= if test -d ../../.git -o -f ../../.git then TAG=$(git describe --abbrev=0 --match "v[0-9].[0-9]*" 2>/dev/null ) - CID=$(git log -1 --abbrev=4 --pretty=format:"%h" 2>/dev/null) && CID="-g$CID" + CID=$(git log -1 --abbrev=12 --pretty=format:"%h" 2>/dev/null) && CID="-g$CID" elif test -f ../../PERF-VERSION-FILE then TAG=$(cut -d' ' -f3 ../../PERF-VERSION-FILE | sed -e 's/\"//g')
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 31/41 perf machine: Return NULL instead of null-terminating /proc/version array
In reply to Arnaldo Carvalho de MeloFrom: Donald Yandt <[email protected]>
Return NULL instead of null-terminating version char array when fgets fails due to end-of-file or error.
--- tools/perf/util/machine.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
tools/perf/util/machine.c +2 -2
@@ -1241,9 +1241,9 @@ static char *get_kernel_version(const char *root_dir)return NULL ; tmp =fgets (version,sizeof (version), file); -if (!tmp) - *version ='\0' ;fclose (file); +if (!tmp) +return NULL ; name =strstr (version, prefix);if (!name)
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 32/41 perf annotate TUI browser: Do not use member from variable within its own initialization
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Some compilers will complain when using a member of a struct to initialize another member, in the same struct initialization.
For instance:
debian:8 Debian clang version 3.5.0-10 (tags/RELEASE_350/final) (based on LLVM 3.5.0)
oraclelinux:7 clang version 3.4.2 (tags/RELEASE_34/dot2-final)
Produce:
ui/browsers/annotate.c:104:12: error: variable 'ops' is uninitialized when used within its own initialization [-Werror,-Wuninitialized]
(!ops.current_entry ||
^~~1 error generated.
So use an extra variable, initialized just before that struct, to have the value used in the expressions used to init two of the struct members.
--- tools/perf/ui/browsers/annotate.c | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
tools/perf/ui/browsers/annotate.c +3 -2
@@ -97,11 +97,12 @@ static void annotate_browser__write(struct ui_browser *browser, void *entry, int struct annotate_browser *ab = container_of(browser, struct annotate_browser, b);struct annotation *notes =browser__annotation (browser); struct annotation_line *al = list_entry(entry, struct annotation_line, node); +const bool is_current_entry =ui_browser__is_current_entry (browser, row);struct annotation_write_ops ops = { .first_line = row ==0 , - .current_entry =ui_browser__is_current_entry (browser, row), + .current_entry = is_current_entry, .change_color = (!notes->options->hide_src_code && - (!ops.current_entry || + (!is_current_entry || (browser->use_navkeypressed && !browser->navkeypressed))), .width = browser->width,
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 33/41 perf python: Remove -fstack-protector-strong if clang doesn't have it
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Some distros put -fstack-protector-strong in the compiler flags to be used to build python extensions, but then, the clang version in that distro doesn't know about that, only gcc does.
Check if that is the case and remove it from the set of options used to build the python binding with clang.
Case at hand:
oraclelinux:7
$ head -2 /etc/os-release NAME="Oracle Linux Server" VERSION="7.6" $ grep stack-protector /usr/lib64/python2.7/_sysconfigdata.py | head -1 | cut -c-120 'CFLAGS': '-fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --para $ gcc version 4.8.5 20150623 (Red Hat 4.8.5-36.0.1) (GCC) clang version 3.4.2 (tags/RELEASE_34/dot2-final)
clang: error: unknown argument: '-fstack-protector-strong'
clang: error: unknown argument: '-fstack-protector-strong'
error: command 'clang' failed with exit status 1
cp: cannot stat '/tmp/build/perf/python_ext_build/lib/perf*.so': No such file or directory make[2]: *** [/tmp/build/perf/python/perf.so] Error 1
--- tools/perf/util/setup.py | 2 ++ 1 file changed, 2 insertions(+)
tools/perf/util/setup.py +2 -0
@@ -17,6 +17,8 @@ if cc == "clang": vars[var] = sub("-fcf-protection", "", vars[var]) if not clang_has_option("-fstack-clash-protection"): vars[var] = sub("-fstack-clash-protection", "", vars[var]) + if not clang_has_option("-fstack-protector-strong"): + vars[var] = sub("-fstack-protector-strong", "", vars[var]) from distutils.core import setup, Extension
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 34/41 perf top: Lower message level for failure on synthesizing events for pre-existing BPF programs
In reply to Arnaldo Carvalho de MeloFrom: Arnaldo Carvalho de Melo <[email protected]>
Move it from being a pr_warning() to a pr_debug(). Also capitalize BPF and explain what gets missing when we're not able to synthesize these
events: we'll not be able to resolve symbols, etc.
--- tools/perf/builtin-top.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
tools/perf/builtin-top.c +1 -1
@@ -1215,7 +1215,7 @@ static int __cmd_top(struct perf_top *top) &top->session->machines.host, &top->record_opts);if (ret <0 ) -pr_warning ("Couldn't synthesize bpf events.\n" ); +pr_debug ("Couldn't synthesize BPF events: Pre-existing BPF programs won't have symbols resolved.\n" ); machine__synthesize_threads(&top->session->machines.host, &opts->target, top->evlist->threads, false,
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 35/41 perf scripts python: exported-sql-viewer.py: Change python2 to python
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
Now that there is also support for python3, there is no need to specify python2 explicitly.
--- tools/perf/scripts/python/exported-sql-viewer.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
tools/perf/scripts/python/exported-sql-viewer.py +1 -1
@@ -1,4 +1,4 @@ -#!/usr/bin/env python2 +#!/usr/bin/env python # SPDX-License-Identifier: GPL-2.0 # exported-sql-viewer.py: view data from sql database # Copyright (c) 2014-2018, Intel Corporation.
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 36/41 perf scripts python: exported-sql-viewer.py: Use argparse module for argument parsing
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
The argparse module makes it easier to add new arguments.
--- .../scripts/python/exported-sql-viewer.py | 21 +++++++++++++------ 1 file changed, 15 insertions(+), 6 deletions(-)
tools/perf/scripts/python/exported-sql-viewer.py +15 -6
@@ -91,6 +91,7 @@ from __future__ import print_function import sys +import argparse import weakref import threading import string
@@ -3361,18 +3362,26 @@ class DBRef(): # Main def Main(): - if (len(sys.argv) < 2): - printerr("Usage is: exported-sql-viewer.py {<database name> | --help-only}"); - raise Exception("Too few arguments") - - dbname = sys.argv[1] - if dbname == "--help-only": + usage_str = "exported-sql-viewer.py [--pyside-version-1] <database name>\n" \ + " or: exported-sql-viewer.py --help-only" + ap = argparse.ArgumentParser(usage = usage_str, add_help = False) + ap.add_argument("dbname", nargs="?") + ap.add_argument("--help-only", action='store_true') + args = ap.parse_args() + + if args.help_only: app = QApplication(sys.argv) mainwindow = HelpOnlyWindow() mainwindow.show() err = app.exec_() sys.exit(err) + dbname = args.dbname + if dbname is None: + ap.print_usage() + print("Too few arguments") + sys.exit(1) + is_sqlite3 = False try: f = open(dbname, "rb")
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 37/41 perf scripts python: exported-sql-viewer.py: Add support for pyside2
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
pyside2 is the future for pyside support.
Note pyside use Qt4 whereas pyside2 uses Qt5.
Committer testing:
On a system with just:
# rpm -qa| grep -i pyside python2-pyside-1.2.4-7.fc29.x86_64 #
Running:
$ python ~acme/libexec/perf-core/scripts/python/exported-sql-viewer.py ~/c/adrian.hunter/simple-retpoline.db & [1] 7438
Makes it use the pyside 1 files:
$ grep -i pyside /proc/7438/maps | cut -d ' ' -f 6- | sort -u
/usr/lib64/libpyside-python2.7.so.1.2.4
/usr/lib64/python2.7/site-packages/PySide/QtCore.so
/usr/lib64/python2.7/site-packages/PySide/QtGui.so
/usr/lib64/python2.7/site-packages/PySide/QtSql.so
$ rpm -qf /usr/lib64/libpyside-python2.7.so.1.2.4
python2-pyside-1.2.4-7.fc29.x86_64
$To get PySide2 I guess one needs to do:
$ pip install PySide2
But thats a 142MiB download I can't do right now, perhaps before pushing upstream...
--- .../scripts/python/exported-sql-viewer.py | 28 ++++++++++++++----- 1 file changed, 21 insertions(+), 7 deletions(-)
tools/perf/scripts/python/exported-sql-viewer.py +21 -7
@@ -105,10 +105,23 @@ except ImportError: glb_nsz = 16 import re import os -from PySide.QtCore import * -from PySide.QtGui import * -from PySide.QtSql import * + pyside_version_1 = True +if not "--pyside-version-1" in sys.argv: + try: + from PySide2.QtCore import * + from PySide2.QtGui import * + from PySide2.QtSql import * + from PySide2.QtWidgets import * + pyside_version_1 = False + except: + pass + +if pyside_version_1: + from PySide.QtCore import * + from PySide.QtGui import * + from PySide.QtSql import * + from decimal import * from ctypes import * from multiprocessing import Process, Array, Value, Event
@@ -2755,7 +2768,7 @@ class WindowMenu(): action = self.window_menu.addAction(label) action.setCheckable(True) action.setChecked(sub_window == self.mdi_area.activeSubWindow()) - action.triggered.connect(lambda x=nr: self.setActiveSubWindow(x)) + action.triggered.connect(lambda a=None,x=nr: self.setActiveSubWindow(x)) self.window_menu.addAction(action) nr += 1
@@ -3115,14 +3128,14 @@ class MainWindow(QMainWindow): event = event.split(":")[0] if event == "branches": label = "All branches" if branches_events == 1 else "All branches " + "(id=" + dbid + ")" - reports_menu.addAction(CreateAction(label, "Create a new window displaying branch events", lambda x=dbid: self.NewBranchView(x), self)) + reports_menu.addAction(CreateAction(label, "Create a new window displaying branch events", lambda a=None,x=dbid: self.NewBranchView(x), self)) label = "Selected branches" if branches_events == 1 else "Selected branches " + "(id=" + dbid + ")" - reports_menu.addAction(CreateAction(label, "Create a new window displaying branch events", lambda x=dbid: self.NewSelectedBranchView(x), self)) + reports_menu.addAction(CreateAction(label, "Create a new window displaying branch events", lambda a=None,x=dbid: self.NewSelectedBranchView(x), self)) def TableMenu(self, tables, menu): table_menu = menu.addMenu("&Tables") for table in tables: - table_menu.addAction(CreateAction(table, "Create a new window containing a table view", lambda t=table: self.NewTableView(t), self)) + table_menu.addAction(CreateAction(table, "Create a new window containing a table view", lambda a=None,t=table: self.NewTableView(t), self)) def NewCallGraph(self): CallGraphWindow(self.glb, self)
@@ -3365,6 +3378,7 @@ def Main(): usage_str = "exported-sql-viewer.py [--pyside-version-1] <database name>\n" \ " or: exported-sql-viewer.py --help-only" ap = argparse.ArgumentParser(usage = usage_str, add_help = False) + ap.add_argument("--pyside-version-1", action='store_true') ap.add_argument("dbname", nargs="?") ap.add_argument("--help-only", action='store_true') args = ap.parse_args()
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 38/41 perf scripts python: export-to-sqlite.py: Add support for pyside2
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
pyside2 is the future for pyside support.
Note pyside use Qt4 whereas pyside2 uses Qt5.
--- tools/perf/scripts/python/export-to-sqlite.py | 44 ++++++++++++++++--- 1 file changed, 38 insertions(+), 6 deletions(-)
tools/perf/scripts/python/export-to-sqlite.py +38 -6
@@ -21,6 +21,26 @@ import datetime # provides LGPL-licensed Python bindings for Qt. You will also need the package # libqt4-sql-sqlite for Qt sqlite3 support. # +# Examples of installing pyside: +# +# ubuntu: +# +# $ sudo apt-get install python-pyside.qtsql libqt4-sql-psql +# +# Alternately, to use Python3 and/or pyside 2, one of the following: +# +# $ sudo apt-get install python3-pyside.qtsql libqt4-sql-psql +# $ sudo apt-get install python-pyside2.qtsql libqt5sql5-psql +# $ sudo apt-get install python3-pyside2.qtsql libqt5sql5-psql +# fedora: +# +# $ sudo yum install python-pyside +# +# Alternately, to use Python3 and/or pyside 2, one of the following: +# $ sudo yum install python3-pyside +# $ pip install --user PySide2 +# $ pip3 install --user PySide2 +# # An example of using this script with Intel PT: # # $ perf record -e intel_pt//u ls
@@ -49,7 +69,16 @@ import datetime # difference is the 'transaction' column of the 'samples' table which is # renamed 'transaction_' in sqlite because 'transaction' is a reserved word. -from PySide.QtSql import * +pyside_version_1 = True +if not "pyside-version-1" in sys.argv: + try: + from PySide2.QtSql import * + pyside_version_1 = False + except: + pass + +if pyside_version_1: + from PySide.QtSql import * sys.path.append(os.environ['PERF_EXEC_PATH'] + \ '/scripts/python/Perf-Trace-Util/lib/Perf/Trace')
@@ -69,11 +98,12 @@ def printdate(*args, **kw_args): print(datetime.datetime.today(), *args, sep=' ', **kw_args) def usage(): - printerr("Usage is: export-to-sqlite.py <database name> [<columns>] [<calls>] [<callchains>]"); - printerr("where: columns 'all' or 'branches'"); - printerr(" calls 'calls' => create calls and call_paths table"); - printerr(" callchains 'callchains' => create call_paths table"); - raise Exception("Too few arguments") + printerr("Usage is: export-to-sqlite.py <database name> [<columns>] [<calls>] [<callchains>] [<pyside-version-1>]"); + printerr("where: columns 'all' or 'branches'"); + printerr(" calls 'calls' => create calls and call_paths table"); + printerr(" callchains 'callchains' => create call_paths table"); + printerr(" pyside-version-1 'pyside-version-1' => use pyside version 1"); + raise Exception("Too few or bad arguments") if (len(sys.argv) < 2): usage()
@@ -95,6 +125,8 @@ for i in range(3,len(sys.argv)): perf_db_export_calls = True elif (sys.argv[i] == "callchains"): perf_db_export_callchains = True + elif (sys.argv[i] == "pyside-version-1"): + pass else: usage()
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 39/41 perf scripts python: export-to-postgresql.py: Add support for pyside2
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
pyside2 is the future for pyside support.
Note pyside use Qt4 whereas pyside2 uses Qt5.
--- .../scripts/python/export-to-postgresql.py | 43 +++++++++++++++---- 1 file changed, 34 insertions(+), 9 deletions(-)
tools/perf/scripts/python/export-to-postgresql.py +34 -9
@@ -27,18 +27,31 @@ import datetime # # fedora: # -# $ sudo yum install postgresql postgresql-server python-pyside qt-postgresql +# $ sudo yum install postgresql postgresql-server qt-postgresql # $ sudo su - postgres -c initdb # $ sudo service postgresql start # $ sudo su - postgres -# $ createuser <your user id here> +# $ createuser -s <your user id here> # Older versions may not support -s, in which case answer the prompt below: # Shall the new role be a superuser? (y/n) y +# $ sudo yum install python-pyside +# +# Alternately, to use Python3 and/or pyside 2, one of the following: +# $ sudo yum install python3-pyside +# $ pip install --user PySide2 +# $ pip3 install --user PySide2 # # ubuntu: # -# $ sudo apt-get install postgresql python-pyside.qtsql libqt4-sql-psql +# $ sudo apt-get install postgresql # $ sudo su - postgres # $ createuser -s <your user id here> +# $ sudo apt-get install python-pyside.qtsql libqt4-sql-psql +# +# Alternately, to use Python3 and/or pyside 2, one of the following: +# +# $ sudo apt-get install python3-pyside.qtsql libqt4-sql-psql +# $ sudo apt-get install python-pyside2.qtsql libqt5sql5-psql +# $ sudo apt-get install python3-pyside2.qtsql libqt5sql5-psql # # An example of using this script with Intel PT: #
@@ -199,7 +212,16 @@ import datetime # print "{0:>6} {1:>10} {2:>9} {3:<30} {4:>6} {5:<30}".format(query.value(0), query.value(1), query.value(2), query.value(3), query.value(4), query.value(5)) # call_path_id = query.value(6) -from PySide.QtSql import * +pyside_version_1 = True +if not "pyside-version-1" in sys.argv: + try: + from PySide2.QtSql import * + pyside_version_1 = False + except: + pass + +if pyside_version_1: + from PySide.QtSql import * if sys.version_info < (3, 0): def toserverstr(str):
@@ -255,11 +277,12 @@ def printdate(*args, **kw_args): print(datetime.datetime.today(), *args, sep=' ', **kw_args) def usage(): - printerr("Usage is: export-to-postgresql.py <database name> [<columns>] [<calls>] [<callchains>]") - printerr("where: columns 'all' or 'branches'") - printerr(" calls 'calls' => create calls and call_paths table") - printerr(" callchains 'callchains' => create call_paths table") - raise Exception("Too few arguments") + printerr("Usage is: export-to-postgresql.py <database name> [<columns>] [<calls>] [<callchains>] [<pyside-version-1>]"); + printerr("where: columns 'all' or 'branches'"); + printerr(" calls 'calls' => create calls and call_paths table"); + printerr(" callchains 'callchains' => create call_paths table"); + printerr(" pyside-version-1 'pyside-version-1' => use pyside version 1"); + raise Exception("Too few or bad arguments") if (len(sys.argv) < 2): usage()
@@ -281,6 +304,8 @@ for i in range(3,len(sys.argv)): perf_db_export_calls = True elif (sys.argv[i] == "callchains"): perf_db_export_callchains = True + elif (sys.argv[i] == "pyside-version-1"): + pass else: usage()
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 40/41 perf intel-pt: Improve sync_switch by processing PERF_RECORD_SWITCH* in events
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
sync_switch is a facility to synchronize decoding more closely with the point in the kernel when the context actually switched.
Improve it by processing "context switch in" events.
--- tools/perf/util/intel-pt.c | 40 +++++++++++++++++++++++++++++++++++++- 1 file changed, 39 insertions(+), 1 deletion(-)
tools/perf/util/intel-pt.c +39 -1
@@ -1914,6 +1914,44 @@ static int intel_pt_process_switch(struct intel_pt *pt,return machine__set_current_tid (pt->machine, cpu,-1 , tid); } +static int intel_pt_context_switch_in (struct intel_pt *pt, +struct perf_sample *sample) +{ +pid_t pid = sample->pid; +pid_t tid = sample->tid; +int cpu = sample->cpu; + +if (pt->sync_switch) { +struct intel_pt_queue *ptq; + + ptq =intel_pt_cpu_to_ptq (pt, cpu); +if (ptq && ptq->sync_switch) { + ptq->next_tid =-1 ; +switch (ptq->switch_state) { +case INTEL_PT_SS_NOT_TRACING : +case INTEL_PT_SS_UNKNOWN : +case INTEL_PT_SS_TRACING : +break ; +case INTEL_PT_SS_EXPECTING_SWITCH_EVENT : +case INTEL_PT_SS_EXPECTING_SWITCH_IP : + ptq->switch_state =INTEL_PT_SS_TRACING ; +break ; +default : +break ; + } + } + } + +/* +* If the current tid has not been updated yet, ensure it is now that +* a "switch in" event has occurred. +*/ +if (machine__get_current_tid (pt->machine, cpu) == tid) +return 0 ; + +return machine__set_current_tid (pt->machine, cpu, pid, tid); +} +static int intel_pt_context_switch (struct intel_pt *pt,union perf_event *event,struct perf_sample *sample) {
@@ -1925,7 +1963,7 @@ static int intel_pt_context_switch(struct intel_pt *pt, union perf_event *event,if (pt->have_sched_switch ==3 ) {if (!out) -return 0 ; +return intel_pt_context_switch_in (pt, sample);if (event->header.type !=PERF_RECORD_SWITCH_CPU_WIDE ) {pr_err ("Expecting CPU-wide context switch event\n" );return -EINVAL ;
Signature · 1 line
2.20.1
Arnaldo Carvalho de Melo
maintainerPATCH 41/41 perf intel-pt: Rationalize intel_pt_sync_switch()'s use of next_tid
In reply to Arnaldo Carvalho de MeloFrom: Adrian Hunter <[email protected]>
Returning 1 from intel_pt_sync_switch() causes the current tid to be set. That negates the need to keep next_tid anymore. Rationalize the code to that effect.
--- tools/perf/util/intel-pt.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
tools/perf/util/intel-pt.c +2 -2
@@ -1859,7 +1859,6 @@ static int intel_pt_sync_switch(struct intel_pt *pt, int cpu, pid_t tid,switch (ptq->switch_state) {case INTEL_PT_SS_NOT_TRACING : - ptq->next_tid =-1 ;break ;case INTEL_PT_SS_UNKNOWN :case INTEL_PT_SS_TRACING :
@@ -1879,13 +1878,14 @@ static int intel_pt_sync_switch(struct intel_pt *pt, int cpu, pid_t tid, ptq->switch_state =INTEL_PT_SS_TRACING ;break ;case INTEL_PT_SS_EXPECTING_SWITCH_IP : - ptq->next_tid = tid;intel_pt_log ("ERROR: cpu %d expecting switch ip\n" , cpu);break ;default :break ; } + ptq->next_tid =-1 ; +return 1 ; }
Signature · 1 line
2.20.1
Re: [PATCH 17/41] perf trace beauty clone: Handle CLONE_PIDFD
In reply to Arnaldo Carvalho de MeloQuoted 12 lines · Arnaldo Carvalho de Melo
From: Arnaldo Carvalho de Melo <[email protected]>
In addition to the older flags. This will allow something like this to be implemented in 'perf trace"
perf trace -e clone/PIDFD in flags/
I.e. ask for strace like tracing, system wide, looking for 'clone' syscalls that have the
CLONE_PIDFDbit set in the 'flags' arg.For now we'll just see PIDFD if it is set in the 'flags' arg.
Quoted 8 lines
Cc Christian Brauner <[email protected]>Cc Adrian Hunter <[email protected]>Cc Brendan Gregg <[email protected]>Cc Jiri Olsa <[email protected]>Cc Luis Cláudio Gonçalves <[email protected]>Cc Namhyung Kim <[email protected]>Signed-off-by Arnaldo Carvalho de Melo <[email protected]>
Quoted 19 lines
--- tools/perf/trace/beauty/clone.c | 1 + 1 file changed, 1 insertion(+)tools/perf/trace/beauty/clone.c +1
-0@@ -25,6 +25,7 @@ static size_t clone__scnprintf_flags(unsigned long flags, char *bf, size_t size,P_FLAG (FS );P_FLAG (FILES );P_FLAG (SIGHAND ); +P_FLAG (PIDFD );P_FLAG (PTRACE );P_FLAG (VFORK );P_FLAG (PARENT );Signature · 1 line
2.20.1
Quoted 183 lines · Arnaldo Carvalho de Melo
Hi Ingo,
Please consider pulling,
Best regards,
- Arnaldo
Test results at the end of this message, as usual, this time with the versions for the clang compilers used accross the various containers, to give a further view of the build test coverage for perf, libbpf, libtraceevent, etc.
Test results:
The following changes since commit
849e96f30068d4f6f8352715e02a10533a46deba:Merge tag 'perf-urgent-for-mingo-5.2-20190528' of
git://git.kernel.org/pub/scm/linux/kernel/git/acme/linuxinto perf/urgent (2019-05-28 23:16:22 +0200)are available in the Git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux.gittags/perf-core-for-mingo-5.3-20190529for you to fetch changes up to
14f1cfd4f7b4794e2f9d2ae214bcf049654b0b5c:perf intel-pt: Rationalize intel_pt_sync_switch()'s use of
next_tid(2019-05-28 18:37:45 -0300)----------------------------------------------------------------
perf/core improvements and fixes:BPF:
Jiri Olsa:
- Preserve eBPF maps when loading kcore.
- Fix up DSO name padding in 'perf script --call-trace', as BPF DSO names are much larger than what we used to have there.
- Add --show-bpf-events to 'perf script'.
perf trace:
Arnaldo Carvalho de Melo:
- Add string table generators and beautify arguments for the new fspick, fsmount, fsconfig, fsopen,
move_mountandopen_treesyscalls, as well as new values for arguments of clone andsync_file_rangesyscalls.perf version:
Arnaldo Carvalho de Melo:
- Append 12 git SHA chars to the version string.
Namespaces:
Namhyung Kim:
- Add missing --namespaces option to 'perf top', to generate and process namespace events, just like present for 'perf record'.
Intel PT:
Andrian Hunter:
- Fix itrace defaults for 'perf script', not using the '
use_browser' variable to figure out what options are better for 'script' and 'report'- Allow root fixing up buildid cache permissions in the
perf-with-kcore.shscript when sharing that cache with another user.- Improve
sync_switch, a facility used to synchronize decoding of HW traces more closely with the point in the kerne where a context switch took place, by processing thePERF_RECORD_CONTEXT_SWITCH"in" metadata records too.- Make the
exported-sql-viewer.pyGUI also support pyside2, which upgrades from qt4 used in pyside to qt5. Use the argparser module for more easily addition of new command line args.Signed-off-by Arnaldo Carvalho de Melo <[email protected]>----------------------------------------------------------------
Adrian Hunter (11):
perf-with-kcore.sh: Always allowfix_buildid_cache_permissions
perf intel-pt: Fix itrace defaults for perf script
perf auxtrace: Fix itrace defaults for perf script
perf intel-pt: Fix itrace defaults for perf script intel-pt documentation perf scripts python:exported-sql-viewer.py: Change python2 to python perf scripts python:exported-sql-viewer.py: Use argparse module for argument parsing perf scripts python:exported-sql-viewer.py: Add support for pyside2 perf scripts python:export-to-sqlite.py: Add support for pyside2
perf scripts python:export-to-postgresql.py: Add support for pyside2 perf intel-pt: Improvesync_switchby processing PERF_RECORD_SWITCH* in events perf intel-pt: Rationalize intel_pt_sync_switch()'s use ofnext_tidArnaldo Carvalho de Melo (17):
perfaugmented_raw_syscalls: Fix up comment
perf beauty: Add generator for 'move_mount' flags argument
perf trace: Beautify 'move_mount' arguments
perf beauty: Add generator for fspick's 'flags' arg values
perf trace: Beautify 'fspick' arguments
perf beauty: Add generator for fsconfig's 'cmd' arg values
perf trace: Beautify 'fsconfig' arguments
perf beauty: Add generator for fsmount's 'attr_flags' arg values
perf trace: Introducesyscall_arg__scnprintf_strarray_flags
perf trace: Beautify 'fsmount' arguments
perf trace beauty clone: HandleCLONE_PIDFD
perf beauty: Add generator for sync_file_range's 'flags' arg values
perf trace: Beautify 'sync_file_range' arguments
perf version: Append 12 git SHA chars to the version string
perf annotate TUI browser: Do not use member from variable within its own initialization perf python: Remove -fstack-protector-strong if clang doesn't have it
perf top: Lower message level for failure on synthesizing events for pre-existing BPF programsDonald Yandt (1):
perf machine: Return NULL instead of null-terminating/proc/versionarrayJiri Olsa (10):
perf machine: Keep zero in pgoff BPF map
perf tools: Preserve eBPF maps when loading kcore perf dso: Separate generic code indso__data_file_size()perf dso: Separate generic code indso_cache__readperf dso: Simplifydso_cache__readfunction
perf dso: Add BPF DSO read and size hooks
perf script: Pad DSO name for --call-trace
perf tests: Addmap_groups__merge_intest
perf script: Add --show-bpf-events to show eBPF related events perf script: Remove superfluous BPF event titlesNamhyung Kim (2):
perf top: Add --namespaces option
perf tools: Remove const from thread read accessorstools/include/linux/kernel.h | 1 + tools/lib/vsprintf.c | 19 ++++ tools/perf/Documentation/intel-pt.txt | 10 +- tools/perf/Documentation/perf-script.txt | 3 + tools/perf/Documentation/perf-top.txt | 5 + tools/perf/Makefile.perf | 44 +++++++- tools/perf/builtin-script.c | 43 ++++++++ tools/perf/builtin-top.c | 7 +- tools/perf/builtin-trace.c | 35 ++++++ tools/perf/examples/bpf/augmented_raw_syscalls.c | 15 ++- tools/perf/perf-with-kcore.sh | 5 - tools/perf/scripts/python/export-to-postgresql.py | 43 ++++++-- tools/perf/scripts/python/export-to-sqlite.py | 44 ++++++-- tools/perf/scripts/python/exported-sql-viewer.py | 51 ++++++--- tools/perf/tests/Build | 1 + tools/perf/tests/builtin-test.c | 4 + tools/perf/tests/map_groups.c | 120 +++++++++++++++++++++ tools/perf/tests/tests.h | 1 + tools/perf/trace/beauty/Build | 4 + tools/perf/trace/beauty/beauty.h | 15 +++ tools/perf/trace/beauty/clone.c | 1 + tools/perf/trace/beauty/fsconfig.sh | 17 +++ tools/perf/trace/beauty/fsmount.c | 34 ++++++ tools/perf/trace/beauty/fsmount.sh | 22 ++++ tools/perf/trace/beauty/fspick.c | 24 +++++ tools/perf/trace/beauty/fspick.sh | 17 +++ tools/perf/trace/beauty/move_mount.c | 24 +++++ tools/perf/trace/beauty/move_mount_flags.sh | 17 +++ tools/perf/trace/beauty/sync_file_range.c | 31 ++++++ tools/perf/trace/beauty/sync_file_range.sh | 17 +++ tools/perf/ui/browsers/annotate.c | 5 +- tools/perf/util/PERF-VERSION-GEN | 2 +- tools/perf/util/auxtrace.c | 3 +- tools/perf/util/dso.c | 125 +++++++++++++++------- tools/perf/util/event.c | 4 +- tools/perf/util/hist.c | 2 +- tools/perf/util/intel-pt.c | 47 +++++++- tools/perf/util/machine.c | 8 +- tools/perf/util/map.c | 6 ++ tools/perf/util/map_groups.h | 2 + tools/perf/util/setup.py | 2 + tools/perf/util/symbol.c | 97 ++++++++++++++++- tools/perf/util/symbol_conf.h | 1 + tools/perf/util/thread.c | 12 +-- tools/perf/util/thread.h | 4 +- 45 files changed, 888 insertions(+), 106 deletions(-) create mode 100644 tools/perf/tests/map_groups.c create mode 100755 tools/perf/trace/beauty/fsconfig.sh
Quoted 8 lines
create mode 100644 tools/perf/trace/beauty/fsmount.c create mode 100755 tools/perf/trace/beauty/fsmount.sh create mode 100644 tools/perf/trace/beauty/fspick.c create mode 100755 tools/perf/trace/beauty/fspick.sh create mode 100644 tools/perf/trace/beauty/move_mount.c create mode 100755 tools/perf/trace/beauty/move_mount_flags.sh create mode 100644 tools/perf/trace/beauty/sync_file_range.c create mode 100755 tools/perf/trace/beauty/sync_file_range.sh
Pulled, thanks a lot Arnaldo!
Ingo