arm64/perf: Enable branch stack sampling
Subsystems (3)
v2 cover arm64/perf: Enable branch stack sampling
This series enables perf branch stack sampling support on arm64 platform via a new arch feature called Branch Record Buffer Extension (BRBE). All relevant register definitions could be accessed here.
https://developer.arm.com/documentation/ddi0601/2021-12/AArch64-Registers
This series applies on v5.18-rc1 after the BRBE related perf ABI changes series (V5) that was posted earlier.
https://lore.kernel.org/all/[email protected]/
Following issues remain inconclusive
- Jame's concerns regarding permission inadequacy related to perfmon_capable()
- Jame's concerns regarding using perf_event_paranoid along with perfmon_capable()
- Rob's concerns regarding the series structure, arm_pmu callbacks based framework
Changes in RFC V2:
- Added branch_sample_priv() while consolidating other branch sample filter helpers
- Changed all SYS_BRBXXXN_EL1 register definition encodings per Marc
- Changed the BRBE driver as per proposed BRBE related perf ABI changes (V5)
- Added documentation for struct arm_pmu changes, updated commit message
- Updated commit message for BRBE detection infrastructure patch
- PERF_SAMPLE_BRANCH_KERNEL gets checked during arm event init (outside the driver)
- Branch privilege state capture mechanism has now moved inside the driver
Changes in RFC V1:
https://lore.kernel.org/all/[email protected]/
Anshuman Khandual (8):
perf: Consolidate branch sample filter helpers
arm64/perf: Add register definitions for BRBE
arm64/perf: Update struct arm_pmu for BRBE
arm64/perf: Update struct pmu_hw_events for BRBE driver/perf/arm_pmu_platform: Add support for BRBE attributes detection arm64/perf: Drive BRBE from perf event states
arm64/perf: Add BRBE driver
arm64/perf: Enable branch stack sampling
arch/arm64/include/asm/sysreg.h | 222 +++++++++++++++++ arch/arm64/kernel/perf_event.c | 48 ++++ drivers/perf/Kconfig | 11 + drivers/perf/Makefile | 1 + drivers/perf/arm_pmu.c | 72 +++++- drivers/perf/arm_pmu_brbe.c | 425 ++++++++++++++++++++++++++++++++ drivers/perf/arm_pmu_brbe.h | 259 +++++++++++++++++++ drivers/perf/arm_pmu_platform.c | 34 +++ include/linux/perf/arm_pmu.h | 63 +++++ include/linux/perf_event.h | 24 ++ kernel/events/core.c | 9 +- 11 files changed, 1158 insertions(+), 10 deletions(-) create mode 100644 drivers/perf/arm_pmu_brbe.c create mode 100644 drivers/perf/arm_pmu_brbe.h
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
RFC v2 1/8 perf: Consolidate branch sample filter helpers
Besides the branch type filtering requests, 'event.attr.branch_sample_type' also contains various flags indicating which additional information should be captured, along with the base branch record. These flags help configure the underlying hardware, and capture the branch records appropriately when required e.g after PMU interrupt. But first, this moves an existing helper perf_sample_save_hw_index() into the header before adding some more helpers for other branch sample filter flags.
--- include/linux/perf_event.h | 24 ++++++++++++++++++++++++ kernel/events/core.c | 9 ++------- 2 files changed, 26 insertions(+), 7 deletions(-)
include/linux/perf_event.h +24 -0
@@ -1660,4 +1660,28 @@ typedef int (perf_snapshot_branch_stack_t)(struct perf_branch_entry *entries, unsigned int cnt);DECLARE_STATIC_CALL (perf_snapshot_branch_stack, perf_snapshot_branch_stack_t); +static inline bool branch_sample_no_flags (const struct perf_event *event) +{ +return event->attr.branch_sample_type &PERF_SAMPLE_BRANCH_NO_FLAGS ; +} + +static inline bool branch_sample_no_cycles (const struct perf_event *event) +{ +return event->attr.branch_sample_type &PERF_SAMPLE_BRANCH_NO_CYCLES ; +} + +static inline bool branch_sample_type (const struct perf_event *event) +{ +return event->attr.branch_sample_type &PERF_SAMPLE_BRANCH_TYPE_SAVE ; +} + +static inline bool branch_sample_hw_index (const struct perf_event *event) +{ +return event->attr.branch_sample_type &PERF_SAMPLE_BRANCH_HW_INDEX ; +} + +static inline bool branch_sample_priv (const struct perf_event *event) +{ +return event->attr.branch_sample_type &PERF_SAMPLE_BRANCH_PRIV_SAVE ; +}#endif /* _LINUX_PERF_EVENT_H */
kernel/events/core.c +2 -7
@@ -7058,11 +7058,6 @@ static void perf_output_read(struct perf_output_handle *handle,perf_output_read_one (handle, event, enabled, running); } -static inline bool perf_sample_save_hw_index (struct perf_event *event) -{ -return event->attr.branch_sample_type &PERF_SAMPLE_BRANCH_HW_INDEX ; -} - void perf_output_sample(struct perf_output_handle *handle, struct perf_event_header *header, struct perf_sample_data *data,
@@ -7151,7 +7146,7 @@ void perf_output_sample(struct perf_output_handle *handle, *sizeof (struct perf_branch_entry );perf_output_put (handle, data->br_stack->nr); -if (perf_sample_save_hw_index (event)) +if (branch_sample_hw_index (event))perf_output_put (handle, data->br_stack->hw_idx);perf_output_copy (handle, data->br_stack->entries, size); }else {
@@ -7445,7 +7440,7 @@ void perf_prepare_sample(struct perf_event_header *header,if (sample_type &PERF_SAMPLE_BRANCH_STACK ) {int size =sizeof (u64);/* nr */ if (data->br_stack) { -if (perf_sample_save_hw_index (event)) +if (branch_sample_hw_index (event)) size +=sizeof (u64); size += data->br_stack->nr
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
kernel test robot
build botRe: [RFC V2 1/8] perf: Consolidate branch sample filter helpers
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in https://git-scm.com/docs/git-format-patch]
Hi Anshuman,
[FYI, it's a private test report for your RFC patch.]
[auto build test ERROR on arm64/for-next/core]
[also build test ERROR on linus/master linux/master v5.18-rc2] [cannot apply to tip/perf/core tip/master next-20220412]
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch]
url: https://github.com/intel-lab-lkp/linux/commits/Anshuman-Khandual/arm64-perf-Enable-branch-stack-sampling/20220412-204141 base: https://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-next/core config: s390-buildonly-randconfig-r002-20220412 (https://download.01.org/0day-ci/archive/20220413/[email protected]/config) compiler: clang version 15.0.0 (https://github.com/llvm/llvm-project fe2478d44e4f7f191c43fef629ac7a23d0251e72)
reproduce (this is a W=1 build):
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin/make.cross
# install s390 cross compiling tool for clang build
# apt-get install binutils-s390x-linux-gnu
# https://github.com/intel-lab-lkp/linux/commit/6d93333c8ddf355a33ed0f51718603406412afbb
git remote add linux-review https://github.com/intel-lab-lkp/linux
git fetch --no-tags linux-review Anshuman-Khandual/arm64-perf-Enable-branch-stack-sampling/20220412-204141 git checkout 6d93333c8ddf355a33ed0f51718603406412afbb
# save the config file to linux build tree
mkdir build_dir
COMPILER_INSTALL_PATH=$HOME/0day COMPILER=clang make.cross W=1 O=build_dir ARCH=s390 SHELL=/bin/bash
If you fix the issue, kindly add following tag as appropriate
All error/warnings (new ones prefixed by >>):
In file included from fs/notify/inotify/inotify_user.c:26:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
>> include/linux/perf_event.h:1665:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_FLAGS;
~~~~~ ^
include/linux/perf_event.h:1670:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_CYCLES;
~~~~~ ^
include/linux/perf_event.h:1675:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_TYPE_SAVE;
~~~~~ ^
include/linux/perf_event.h:1680:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_HW_INDEX;
~~~~~ ^
include/linux/perf_event.h:1685:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
~~~~~ ^
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^ 6 errors generated.
--
In file included from drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c:29:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
>> include/linux/perf_event.h:1665:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_FLAGS;
~~~~~ ^
include/linux/perf_event.h:1670:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_CYCLES;
~~~~~ ^
include/linux/perf_event.h:1675:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_TYPE_SAVE;
~~~~~ ^
include/linux/perf_event.h:1680:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_HW_INDEX;
~~~~~ ^
include/linux/perf_event.h:1685:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
~~~~~ ^
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^
In file included from drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c:32:
In file included from drivers/gpu/drm/amd/amdgpu/../amdgpu/amdgpu.h:52:
In file included from include/linux/pci.h:39:
In file included from include/linux/io.h:13:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:464:31: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __raw_readb(PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:477:61: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __le16_to_cpu((__le16 __force)__raw_readw(PCI_IOBASE + addr));
~~~~~~~~~~ ^
include/uapi/linux/byteorder/big_endian.h:37:59: note: expanded from macro '__le16_to_cpu'
#define __le16_to_cpu(x) __swab16((__force __u16)(__le16)(x))
^
include/uapi/linux/swab.h:102:54: note: expanded from macro '__swab16'
#define __swab16(x) (__u16)__builtin_bswap16((__u16)(x))
^
In file included from drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c:32:
In file included from drivers/gpu/drm/amd/amdgpu/../amdgpu/amdgpu.h:52:
In file included from include/linux/pci.h:39:
In file included from include/linux/io.h:13:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:490:61: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __le32_to_cpu((__le32 __force)__raw_readl(PCI_IOBASE + addr));
~~~~~~~~~~ ^
include/uapi/linux/byteorder/big_endian.h:35:59: note: expanded from macro '__le32_to_cpu'
#define __le32_to_cpu(x) __swab32((__force __u32)(__le32)(x))
^
include/uapi/linux/swab.h:115:54: note: expanded from macro '__swab32'
#define __swab32(x) (__u32)__builtin_bswap32((__u32)(x))
^
In file included from drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c:32:
In file included from drivers/gpu/drm/amd/amdgpu/../amdgpu/amdgpu.h:52:
In file included from include/linux/pci.h:39:
In file included from include/linux/io.h:13:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:501:33: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writeb(value, PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:511:59: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writew((u16 __force)cpu_to_le16(value), PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:521:59: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writel((u32 __force)cpu_to_le32(value), PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:609:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsb(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:617:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsw(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:625:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsl(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:634:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesb(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:643:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesw(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:652:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesl(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^ 12 warnings and 6 errors generated.
--
In file included from kernel/sched/core.c:13:
In file included from kernel/sched/sched.h:17:
In file included from include/linux/sched/isolation.h:6:
In file included from include/linux/tick.h:8:
In file included from include/linux/clockchips.h:14:
In file included from include/linux/clocksource.h:22:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:464:31: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __raw_readb(PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:477:61: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __le16_to_cpu((__le16 __force)__raw_readw(PCI_IOBASE + addr));
~~~~~~~~~~ ^
include/uapi/linux/byteorder/big_endian.h:37:59: note: expanded from macro '__le16_to_cpu'
#define __le16_to_cpu(x) __swab16((__force __u16)(__le16)(x))
^
include/uapi/linux/swab.h:102:54: note: expanded from macro '__swab16'
#define __swab16(x) (__u16)__builtin_bswap16((__u16)(x))
^
In file included from kernel/sched/core.c:13:
In file included from kernel/sched/sched.h:17:
In file included from include/linux/sched/isolation.h:6:
In file included from include/linux/tick.h:8:
In file included from include/linux/clockchips.h:14:
In file included from include/linux/clocksource.h:22:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:490:61: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __le32_to_cpu((__le32 __force)__raw_readl(PCI_IOBASE + addr));
~~~~~~~~~~ ^
include/uapi/linux/byteorder/big_endian.h:35:59: note: expanded from macro '__le32_to_cpu'
#define __le32_to_cpu(x) __swab32((__force __u32)(__le32)(x))
^
include/uapi/linux/swab.h:115:54: note: expanded from macro '__swab32'
#define __swab32(x) (__u32)__builtin_bswap32((__u32)(x))
^
In file included from kernel/sched/core.c:13:
In file included from kernel/sched/sched.h:17:
In file included from include/linux/sched/isolation.h:6:
In file included from include/linux/tick.h:8:
In file included from include/linux/clockchips.h:14:
In file included from include/linux/clocksource.h:22:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:501:33: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writeb(value, PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:511:59: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writew((u16 __force)cpu_to_le16(value), PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:521:59: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writel((u32 __force)cpu_to_le32(value), PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:609:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsb(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:617:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsw(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:625:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsl(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:634:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesb(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:643:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesw(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:652:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesl(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
In file included from kernel/sched/core.c:13:
In file included from kernel/sched/sched.h:66:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
>> include/linux/perf_event.h:1665:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_FLAGS;
~~~~~ ^
include/linux/perf_event.h:1670:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_CYCLES;
~~~~~ ^
include/linux/perf_event.h:1675:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_TYPE_SAVE;
~~~~~ ^
include/linux/perf_event.h:1680:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_HW_INDEX;
~~~~~ ^
include/linux/perf_event.h:1685:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
~~~~~ ^
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^
kernel/sched/core.c:3453:6: warning: no previous prototype for function 'sched_set_stop_task' [-Wmissing-prototypes]
void sched_set_stop_task(int cpu, struct task_struct *stop)
^ kernel/sched/core.c:3453:1: note: declare 'static' if the function is not intended to be used outside of this translation unit void sched_set_stop_task(int cpu, struct task_struct *stop)
^
static
13 warnings and 6 errors generated.
--
In file included from kernel/sched/loadavg.c:9:
In file included from kernel/sched/sched.h:17:
In file included from include/linux/sched/isolation.h:6:
In file included from include/linux/tick.h:8:
In file included from include/linux/clockchips.h:14:
In file included from include/linux/clocksource.h:22:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:464:31: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __raw_readb(PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:477:61: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __le16_to_cpu((__le16 __force)__raw_readw(PCI_IOBASE + addr));
~~~~~~~~~~ ^
include/uapi/linux/byteorder/big_endian.h:37:59: note: expanded from macro '__le16_to_cpu'
#define __le16_to_cpu(x) __swab16((__force __u16)(__le16)(x))
^
include/uapi/linux/swab.h:102:54: note: expanded from macro '__swab16'
#define __swab16(x) (__u16)__builtin_bswap16((__u16)(x))
^
In file included from kernel/sched/loadavg.c:9:
In file included from kernel/sched/sched.h:17:
In file included from include/linux/sched/isolation.h:6:
In file included from include/linux/tick.h:8:
In file included from include/linux/clockchips.h:14:
In file included from include/linux/clocksource.h:22:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:490:61: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
val = __le32_to_cpu((__le32 __force)__raw_readl(PCI_IOBASE + addr));
~~~~~~~~~~ ^
include/uapi/linux/byteorder/big_endian.h:35:59: note: expanded from macro '__le32_to_cpu'
#define __le32_to_cpu(x) __swab32((__force __u32)(__le32)(x))
^
include/uapi/linux/swab.h:115:54: note: expanded from macro '__swab32'
#define __swab32(x) (__u32)__builtin_bswap32((__u32)(x))
^
In file included from kernel/sched/loadavg.c:9:
In file included from kernel/sched/sched.h:17:
In file included from include/linux/sched/isolation.h:6:
In file included from include/linux/tick.h:8:
In file included from include/linux/clockchips.h:14:
In file included from include/linux/clocksource.h:22:
In file included from arch/s390/include/asm/io.h:75:
include/asm-generic/io.h:501:33: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writeb(value, PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:511:59: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writew((u16 __force)cpu_to_le16(value), PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:521:59: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
__raw_writel((u32 __force)cpu_to_le32(value), PCI_IOBASE + addr);
~~~~~~~~~~ ^
include/asm-generic/io.h:609:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsb(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:617:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsw(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:625:20: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
readsl(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:634:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesb(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:643:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesw(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
include/asm-generic/io.h:652:21: warning: performing pointer arithmetic on a null pointer has undefined behavior [-Wnull-pointer-arithmetic]
writesl(PCI_IOBASE + addr, buffer, count);
~~~~~~~~~~ ^
In file included from kernel/sched/loadavg.c:9:
In file included from kernel/sched/sched.h:66:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
>> include/linux/perf_event.h:1665:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_FLAGS;
~~~~~ ^
include/linux/perf_event.h:1670:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_CYCLES;
~~~~~ ^
include/linux/perf_event.h:1675:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_TYPE_SAVE;
~~~~~ ^
include/linux/perf_event.h:1680:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_HW_INDEX;
~~~~~ ^
include/linux/perf_event.h:1685:16: error: no member named 'attr' in 'struct perf_event'
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
~~~~~ ^
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^ 12 warnings and 6 errors generated.
..
vim +1665 include/linux/perf_event.h
1662
1663 static inline bool branch_sample_no_flags(const struct perf_event *event)
1664 {
> 1665 return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_FLAGS;
1666 }
1667
1668 static inline bool branch_sample_no_cycles(const struct perf_event *event)
1669 {
1670 return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_NO_CYCLES;
1671 }
1672
1673 static inline bool branch_sample_type(const struct perf_event *event)
1674 {
> 1675 return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_TYPE_SAVE;
1676 }
1677
1678 static inline bool branch_sample_hw_index(const struct perf_event *event)
1679 {
1680 return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_HW_INDEX;
1681 }
1682
1683 static inline bool branch_sample_priv(const struct perf_event *event)
1684 {
> 1685 return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;Signature · 2 lines
0-DAY CI Kernel Test Service https://01.org/lkp
kernel test robot
build botRe: [RFC V2 1/8] perf: Consolidate branch sample filter helpers
In reply to Anshuman Khandual[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in https://git-scm.com/docs/git-format-patch]
Hi Anshuman,
[FYI, it's a private test report for your RFC patch.]
[auto build test ERROR on arm64/for-next/core]
[also build test ERROR on linus/master linux/master v5.18-rc2] [cannot apply to tip/perf/core tip/master next-20220412]
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch]
url: https://github.com/intel-lab-lkp/linux/commits/Anshuman-Khandual/arm64-perf-Enable-branch-stack-sampling/20220412-204141 base: https://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-next/core config: i386-randconfig-a003-20220411 (https://download.01.org/0day-ci/archive/20220413/[email protected]/config) compiler: clang version 15.0.0 (https://github.com/llvm/llvm-project fe2478d44e4f7f191c43fef629ac7a23d0251e72)
reproduce (this is a W=1 build):
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin/make.cross
# https://github.com/intel-lab-lkp/linux/commit/6d93333c8ddf355a33ed0f51718603406412afbb
git remote add linux-review https://github.com/intel-lab-lkp/linux
git fetch --no-tags linux-review Anshuman-Khandual/arm64-perf-Enable-branch-stack-sampling/20220412-204141 git checkout 6d93333c8ddf355a33ed0f51718603406412afbb
# save the config file to linux build tree
mkdir build_dir
COMPILER_INSTALL_PATH=$HOME/0day COMPILER=clang make.cross W=1 O=build_dir ARCH=i386 SHELL=/bin/bash arch/x86/ fs//
If you fix the issue, kindly add following tag as appropriate
All errors (new ones prefixed by >>):
In file included from arch/x86/kernel/cpu/mce/core.c:50:
In file included from arch/x86/include/asm/traps.h:9:
In file included from arch/x86/include/asm/idtentry.h:9:
In file included from include/linux/entry-common.h:7:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^ 1 error generated.
--
In file included from arch/x86/entry/common.c:13:
In file included from include/linux/entry-common.h:7:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^
arch/x86/entry/common.c:119:24: warning: no previous prototype for function 'do_int80_syscall_32' [-Wmissing-prototypes]
__visible noinstr void do_int80_syscall_32(struct pt_regs *regs)
^
arch/x86/entry/common.c:119:19: note: declare 'static' if the function is not intended to be used outside of this translation unit
__visible noinstr void do_int80_syscall_32(struct pt_regs *regs)
^
static
arch/x86/entry/common.c:186:24: warning: no previous prototype for function 'do_fast_syscall_32' [-Wmissing-prototypes]
__visible noinstr long do_fast_syscall_32(struct pt_regs *regs)
^
arch/x86/entry/common.c:186:19: note: declare 'static' if the function is not intended to be used outside of this translation unit
__visible noinstr long do_fast_syscall_32(struct pt_regs *regs)
^
static
arch/x86/entry/common.c:238:24: warning: no previous prototype for function 'do_SYSENTER_32' [-Wmissing-prototypes]
__visible noinstr long do_SYSENTER_32(struct pt_regs *regs)
^
arch/x86/entry/common.c:238:19: note: declare 'static' if the function is not intended to be used outside of this translation unit
__visible noinstr long do_SYSENTER_32(struct pt_regs *regs)
^
static 3 warnings and 1 error generated.
--
In file included from arch/x86/kernel/doublefault_32.c:11:
In file included from arch/x86/include/asm/traps.h:9:
In file included from arch/x86/include/asm/idtentry.h:9:
In file included from include/linux/entry-common.h:7:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^
arch/x86/kernel/doublefault_32.c:23:36: warning: no previous prototype for function 'doublefault_shim' [-Wmissing-prototypes]
asmlinkage noinstr void __noreturn doublefault_shim(void)
^
arch/x86/kernel/doublefault_32.c:23:20: note: declare 'static' if the function is not intended to be used outside of this translation unit
asmlinkage noinstr void __noreturn doublefault_shim(void)
^
static
arch/x86/kernel/doublefault_32.c:114:6: warning: no previous prototype for function 'doublefault_init_cpu_tss' [-Wmissing-prototypes]
void doublefault_init_cpu_tss(void)
^ arch/x86/kernel/doublefault_32.c:114:1: note: declare 'static' if the function is not intended to be used outside of this translation unit void doublefault_init_cpu_tss(void)
^
static
2 warnings and 1 error generated.
--
In file included from arch/x86/kernel/kprobes/core.c:36:
>> include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^
arch/x86/kernel/kprobes/core.c:1081:23: warning: no previous prototype for function 'trampoline_handler' [-Wmissing-prototypes]
__used __visible void trampoline_handler(struct pt_regs *regs)
^
arch/x86/kernel/kprobes/core.c:1081:18: note: declare 'static' if the function is not intended to be used outside of this translation unit
__used __visible void trampoline_handler(struct pt_regs *regs)
^
static 1 warning and 1 error generated.
vim +1685 include/linux/perf_event.h
1682
1683 static inline bool branch_sample_priv(const struct perf_event *event)
1684 {
> 1685 return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
Signature · 2 lines
0-DAY CI Kernel Test Service https://01.org/lkp
kernel test robot
build botRe: [RFC V2 1/8] perf: Consolidate branch sample filter helpers
In reply to Anshuman Khandual[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in https://git-scm.com/docs/git-format-patch]
Hi Anshuman,
[FYI, it's a private test report for your RFC patch.]
[auto build test WARNING on arm64/for-next/core]
[also build test WARNING on linus/master linux/master v5.18-rc2] [cannot apply to tip/perf/core tip/master next-20220412]
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch]
url: https://github.com/intel-lab-lkp/linux/commits/Anshuman-Khandual/arm64-perf-Enable-branch-stack-sampling/20220412-204141 base: https://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-next/core config: i386-randconfig-a001-20220411 (https://download.01.org/0day-ci/archive/20220413/[email protected]/config) compiler: clang version 15.0.0 (https://github.com/llvm/llvm-project fe2478d44e4f7f191c43fef629ac7a23d0251e72)
reproduce (this is a W=1 build):
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin/make.cross
# https://github.com/intel-lab-lkp/linux/commit/6d93333c8ddf355a33ed0f51718603406412afbb
git remote add linux-review https://github.com/intel-lab-lkp/linux
git fetch --no-tags linux-review Anshuman-Khandual/arm64-perf-Enable-branch-stack-sampling/20220412-204141 git checkout 6d93333c8ddf355a33ed0f51718603406412afbb
# save the config file to linux build tree
mkdir build_dir
COMPILER_INSTALL_PATH=$HOME/0day COMPILER=clang make.cross W=1 O=build_dir ARCH=i386 SHELL=/bin/bash
If you fix the issue, kindly add following tag as appropriate
All warnings (new ones prefixed by >>):
In file included from ipc/msg.c:35:
In file included from include/linux/syscalls.h:88:
In file included from include/trace/syscall.h:7:
In file included from include/linux/trace_events.h:10:
include/linux/perf_event.h:1685:42: error: use of undeclared identifier 'PERF_SAMPLE_BRANCH_PRIV_SAVE'; did you mean 'PERF_SAMPLE_BRANCH_TYPE_SAVE'?
return event->attr.branch_sample_type & PERF_SAMPLE_BRANCH_PRIV_SAVE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
PERF_SAMPLE_BRANCH_TYPE_SAVE
include/uapi/linux/perf_event.h:231:2: note: 'PERF_SAMPLE_BRANCH_TYPE_SAVE' declared here
PERF_SAMPLE_BRANCH_TYPE_SAVE =
^
>> ipc/msg.c:496:20: warning: implicit conversion from 'int' to 'unsigned short' changes value from 32768000 to 0 [-Wconstant-conversion]
msginfo->msgseg = MSGSEG;
~ ^~~~~~
include/uapi/linux/msg.h:87:38: note: expanded from macro 'MSGSEG'
#define MSGSEG (__MSGSEG <= 0xffff ? __MSGSEG : 0xffff)
^~~~~~~~
include/uapi/linux/msg.h:86:36: note: expanded from macro '__MSGSEG'
#define __MSGSEG ((MSGPOOL * 1024) / MSGSSZ) /* max no. of segments */
~~~~~~~~~~~~~~~~~^~~~~~~~1 warning and 1 error generated.
vim +496 ipc/msg.c
a0d092fc2df845 Pierre Peiffer 2008-04-29 475
156d9ed1260ee5 Al Viro 2017-07-09 476 static int msgctl_info(struct ipc_namespace *ns, int msqid,
156d9ed1260ee5 Al Viro 2017-07-09 477 int cmd, struct msginfo *msginfo)
a0d092fc2df845 Pierre Peiffer 2008-04-29 478 {
2cafed30f150f7 Davidlohr Bueso 2013-07-08 479 int err;
27c331a1746142 Manfred Spraul 2018-08-21 480 int max_idx;
5a06a363ef4844 Ingo Molnar 2006-07-30 481
5a06a363ef4844 Ingo Molnar 2006-07-30 482 /*
5a06a363ef4844 Ingo Molnar 2006-07-30 483 * We must not return kernel stack data.
^1da177e4c3f41 Linus Torvalds 2005-04-16 484 * due to padding, it's not enough
^1da177e4c3f41 Linus Torvalds 2005-04-16 485 * to set all member fields.
^1da177e4c3f41 Linus Torvalds 2005-04-16 486 */
^1da177e4c3f41 Linus Torvalds 2005-04-16 487 err = security_msg_queue_msgctl(NULL, cmd);
^1da177e4c3f41 Linus Torvalds 2005-04-16 488 if (err)
^1da177e4c3f41 Linus Torvalds 2005-04-16 489 return err;
^1da177e4c3f41 Linus Torvalds 2005-04-16 490
156d9ed1260ee5 Al Viro 2017-07-09 491 memset(msginfo, 0, sizeof(*msginfo));
156d9ed1260ee5 Al Viro 2017-07-09 492 msginfo->msgmni = ns->msg_ctlmni;
156d9ed1260ee5 Al Viro 2017-07-09 493 msginfo->msgmax = ns->msg_ctlmax;
156d9ed1260ee5 Al Viro 2017-07-09 494 msginfo->msgmnb = ns->msg_ctlmnb;
156d9ed1260ee5 Al Viro 2017-07-09 495 msginfo->msgssz = MSGSSZ;
156d9ed1260ee5 Al Viro 2017-07-09 @496 msginfo->msgseg = MSGSEG;
d9a605e40b1376 Davidlohr Bueso 2013-09-11 497 down_read(&msg_ids(ns).rwsem);
^1da177e4c3f41 Linus Torvalds 2005-04-16 498 if (cmd == MSG_INFO) {
156d9ed1260ee5 Al Viro 2017-07-09 499 msginfo->msgpool = msg_ids(ns).in_use;
156d9ed1260ee5 Al Viro 2017-07-09 500 msginfo->msgmap = atomic_read(&ns->msg_hdrs);
156d9ed1260ee5 Al Viro 2017-07-09 501 msginfo->msgtql = atomic_read(&ns->msg_bytes);
^1da177e4c3f41 Linus Torvalds 2005-04-16 502 } else {
156d9ed1260ee5 Al Viro 2017-07-09 503 msginfo->msgmap = MSGMAP;
156d9ed1260ee5 Al Viro 2017-07-09 504 msginfo->msgpool = MSGPOOL;
156d9ed1260ee5 Al Viro 2017-07-09 505 msginfo->msgtql = MSGTQL;
^1da177e4c3f41 Linus Torvalds 2005-04-16 506 }
27c331a1746142 Manfred Spraul 2018-08-21 507 max_idx = ipc_get_maxidx(&msg_ids(ns));
d9a605e40b1376 Davidlohr Bueso 2013-09-11 508 up_read(&msg_ids(ns).rwsem);
27c331a1746142 Manfred Spraul 2018-08-21 509 return (max_idx < 0) ? 0 : max_idx;
^1da177e4c3f41 Linus Torvalds 2005-04-16 510 }2cafed30f150f7 Davidlohr Bueso 2013-07-08 511
Signature · 2 lines
0-DAY CI Kernel Test Service https://01.org/lkp
Re: [RFC V2 1/8] perf: Consolidate branch sample filter helpers
In reply to Anshuman KhandualQuoted 8 lines · Anshuman Khandual
Besides the branch type filtering requests, 'event.attr.branch_sample_type' also contains various flags indicating which additional information should be captured, along with the base branch record. These flags help configure the underlying hardware, and capture the branch records appropriately when required e.g after PMU interrupt. But first, this moves an existing helper
perf_sample_save_hw_index()into the header before adding some more helpers for other branch sample filter flags.
Quoted 6 lines
Cc Peter Zijlstra <[email protected]>Cc Ingo Molnar <[email protected]>Cc Arnaldo Carvalho de Melo <[email protected]>Signed-off-by Anshuman Khandual <[email protected]>
RFC v2 2/8 arm64/perf: Add register definitions for BRBE
In reply to Anshuman KhandualThis adds BRBE related register definitions and various other related field macros there in. These will be used subsequently in a BRBE driver which is being added later on.
--- arch/arm64/include/asm/sysreg.h | 222 ++++++++++++++++++++++++++++++++ 1 file changed, 222 insertions(+)
arch/arm64/include/asm/sysreg.h +222 -0
@@ -149,6 +149,224 @@#define SYS_DBGDTRTX_EL0 sys_reg(2, 3, 0, 5, 0)#define SYS_DBGVCR32_EL2 sys_reg(2, 4, 0, 7, 0) +/* +* BRBINF<N>_EL1 Encoding: [2, 1, 8, CRm, op2] +* +* derived as <CRm> = c{N<3:0>} <op2> = (N<4>x4 + 0) +*/ +#define __SYS_BRBINFO (n) sys_reg(2, 1, 8, ((n) & 0xf), (((n) & 0x10)) >> 2) + +#define SYS_BRBINF0_EL1 __SYS_BRBINFO(0) +#define SYS_BRBINF1_EL1 __SYS_BRBINFO(1) +#define SYS_BRBINF2_EL1 __SYS_BRBINFO(2) +#define SYS_BRBINF3_EL1 __SYS_BRBINFO(3) +#define SYS_BRBINF4_EL1 __SYS_BRBINFO(4) +#define SYS_BRBINF5_EL1 __SYS_BRBINFO(5) +#define SYS_BRBINF6_EL1 __SYS_BRBINFO(6) +#define SYS_BRBINF7_EL1 __SYS_BRBINFO(7) +#define SYS_BRBINF8_EL1 __SYS_BRBINFO(8) +#define SYS_BRBINF9_EL1 __SYS_BRBINFO(9) +#define SYS_BRBINF10_EL1 __SYS_BRBINFO(10) +#define SYS_BRBINF11_EL1 __SYS_BRBINFO(11) +#define SYS_BRBINF12_EL1 __SYS_BRBINFO(12) +#define SYS_BRBINF13_EL1 __SYS_BRBINFO(13) +#define SYS_BRBINF14_EL1 __SYS_BRBINFO(14) +#define SYS_BRBINF15_EL1 __SYS_BRBINFO(15) +#define SYS_BRBINF16_EL1 __SYS_BRBINFO(16) +#define SYS_BRBINF17_EL1 __SYS_BRBINFO(17) +#define SYS_BRBINF18_EL1 __SYS_BRBINFO(18) +#define SYS_BRBINF19_EL1 __SYS_BRBINFO(19) +#define SYS_BRBINF20_EL1 __SYS_BRBINFO(20) +#define SYS_BRBINF21_EL1 __SYS_BRBINFO(21) +#define SYS_BRBINF22_EL1 __SYS_BRBINFO(22) +#define SYS_BRBINF23_EL1 __SYS_BRBINFO(23) +#define SYS_BRBINF24_EL1 __SYS_BRBINFO(24) +#define SYS_BRBINF25_EL1 __SYS_BRBINFO(25) +#define SYS_BRBINF26_EL1 __SYS_BRBINFO(26) +#define SYS_BRBINF27_EL1 __SYS_BRBINFO(27) +#define SYS_BRBINF28_EL1 __SYS_BRBINFO(28) +#define SYS_BRBINF29_EL1 __SYS_BRBINFO(29) +#define SYS_BRBINF30_EL1 __SYS_BRBINFO(30) +#define SYS_BRBINF31_EL1 __SYS_BRBINFO(31) + +/* +* BRBSRC<N>_EL1 Encoding: [2, 1, 8, CRm, op2] +* +* derived as <CRm> = c{N<3:0>} <op2> = (N<4>x4 + 1) +*/ +#define __SYS_BRBSRC (n) sys_reg(2, 1, 8, ((n) & 0xf), ((((n) & 0x10)) >> 2 + 1)) + +#define SYS_BRBSRC0_EL1 __SYS_BRBSRC(0) +#define SYS_BRBSRC1_EL1 __SYS_BRBSRC(1) +#define SYS_BRBSRC2_EL1 __SYS_BRBSRC(2) +#define SYS_BRBSRC3_EL1 __SYS_BRBSRC(3) +#define SYS_BRBSRC4_EL1 __SYS_BRBSRC(4) +#define SYS_BRBSRC5_EL1 __SYS_BRBSRC(5) +#define SYS_BRBSRC6_EL1 __SYS_BRBSRC(6) +#define SYS_BRBSRC7_EL1 __SYS_BRBSRC(7) +#define SYS_BRBSRC8_EL1 __SYS_BRBSRC(8) +#define SYS_BRBSRC9_EL1 __SYS_BRBSRC(9) +#define SYS_BRBSRC10_EL1 __SYS_BRBSRC(10) +#define SYS_BRBSRC11_EL1 __SYS_BRBSRC(11) +#define SYS_BRBSRC12_EL1 __SYS_BRBSRC(12) +#define SYS_BRBSRC13_EL1 __SYS_BRBSRC(13) +#define SYS_BRBSRC14_EL1 __SYS_BRBSRC(14) +#define SYS_BRBSRC15_EL1 __SYS_BRBSRC(15) +#define SYS_BRBSRC16_EL1 __SYS_BRBSRC(16) +#define SYS_BRBSRC17_EL1 __SYS_BRBSRC(17) +#define SYS_BRBSRC18_EL1 __SYS_BRBSRC(18) +#define SYS_BRBSRC19_EL1 __SYS_BRBSRC(19) +#define SYS_BRBSRC20_EL1 __SYS_BRBSRC(20) +#define SYS_BRBSRC21_EL1 __SYS_BRBSRC(21) +#define SYS_BRBSRC22_EL1 __SYS_BRBSRC(22) +#define SYS_BRBSRC23_EL1 __SYS_BRBSRC(23) +#define SYS_BRBSRC24_EL1 __SYS_BRBSRC(24) +#define SYS_BRBSRC25_EL1 __SYS_BRBSRC(25) +#define SYS_BRBSRC26_EL1 __SYS_BRBSRC(26) +#define SYS_BRBSRC27_EL1 __SYS_BRBSRC(27) +#define SYS_BRBSRC28_EL1 __SYS_BRBSRC(28) +#define SYS_BRBSRC29_EL1 __SYS_BRBSRC(29) +#define SYS_BRBSRC30_EL1 __SYS_BRBSRC(30) +#define SYS_BRBSRC31_EL1 __SYS_BRBSRC(31) + +/* +* BRBTGT<N>_EL1 Encoding: [2, 1, 8, CRm, op2] +* +* derived as <CRm> = c{N<3:0>} <op2> = (N<4>x4 + 2) +*/ +#define __SYS_BRBTGT (n) sys_reg(2, 1, 8, ((n) & 0xf), ((((n) & 0x10)) >> 2 + 2)) + +#define SYS_BRBTGT0_EL1 __SYS_BRBTGT(0) +#define SYS_BRBTGT1_EL1 __SYS_BRBTGT(1) +#define SYS_BRBTGT2_EL1 __SYS_BRBTGT(2) +#define SYS_BRBTGT3_EL1 __SYS_BRBTGT(3) +#define SYS_BRBTGT4_EL1 __SYS_BRBTGT(4) +#define SYS_BRBTGT5_EL1 __SYS_BRBTGT(5) +#define SYS_BRBTGT6_EL1 __SYS_BRBTGT(6) +#define SYS_BRBTGT7_EL1 __SYS_BRBTGT(7) +#define SYS_BRBTGT8_EL1 __SYS_BRBTGT(8) +#define SYS_BRBTGT9_EL1 __SYS_BRBTGT(9) +#define SYS_BRBTGT10_EL1 __SYS_BRBTGT(10) +#define SYS_BRBTGT11_EL1 __SYS_BRBTGT(11) +#define SYS_BRBTGT12_EL1 __SYS_BRBTGT(12) +#define SYS_BRBTGT13_EL1 __SYS_BRBTGT(13) +#define SYS_BRBTGT14_EL1 __SYS_BRBTGT(14) +#define SYS_BRBTGT15_EL1 __SYS_BRBTGT(15) +#define SYS_BRBTGT16_EL1 __SYS_BRBTGT(16) +#define SYS_BRBTGT17_EL1 __SYS_BRBTGT(17) +#define SYS_BRBTGT18_EL1 __SYS_BRBTGT(18) +#define SYS_BRBTGT19_EL1 __SYS_BRBTGT(19) +#define SYS_BRBTGT20_EL1 __SYS_BRBTGT(20) +#define SYS_BRBTGT21_EL1 __SYS_BRBTGT(21) +#define SYS_BRBTGT22_EL1 __SYS_BRBTGT(22) +#define SYS_BRBTGT23_EL1 __SYS_BRBTGT(23) +#define SYS_BRBTGT24_EL1 __SYS_BRBTGT(24) +#define SYS_BRBTGT25_EL1 __SYS_BRBTGT(25) +#define SYS_BRBTGT26_EL1 __SYS_BRBTGT(26) +#define SYS_BRBTGT27_EL1 __SYS_BRBTGT(27) +#define SYS_BRBTGT28_EL1 __SYS_BRBTGT(28) +#define SYS_BRBTGT29_EL1 __SYS_BRBTGT(29) +#define SYS_BRBTGT30_EL1 __SYS_BRBTGT(30) +#define SYS_BRBTGT31_EL1 __SYS_BRBTGT(31) + +#define SYS_BRBIDR0_EL1 sys_reg(2, 1, 9, 2, 0) +#define SYS_BRBCR_EL1 sys_reg(2, 1, 9, 0, 0) +#define SYS_BRBFCR_EL1 sys_reg(2, 1, 9, 0, 1) +#define SYS_BRBTS_EL1 sys_reg(2, 1, 9, 0, 2) +#define SYS_BRBINFINJ_EL1 sys_reg(2, 1, 9, 1, 0) +#define SYS_BRBSRCINJ_EL1 sys_reg(2, 1, 9, 1, 1) +#define SYS_BRBTGTINJ_EL1 sys_reg(2, 1, 9, 1, 2) + +#define BRBIDR0_CC_SHIFT 12 +#define BRBIDR0_CC_MASK GENMASK(3, 0) +#define BRBIDR0_FORMAT_SHIFT 8 +#define BRBIDR0_FORMAT_MASK GENMASK(3, 0) +#define BRBIDR0_NUMREC_SHIFT 0 +#define BRBIDR0_NUMREC_MASK GENMASK(7, 0) + +#define BRBIDR0_CC_20_BIT 0x5 +#define BRBIDR0_FORMAT_0 0x0 + +#define BRBIDR0_NUMREC_8 0x08 +#define BRBIDR0_NUMREC_16 0x10 +#define BRBIDR0_NUMREC_32 0x20 +#define BRBIDR0_NUMREC_64 0x40 + +#define BRBINF_VALID_SHIFT 0 +#define BRBINF_VALID_MASK GENMASK(1, 0) +#define BRBINF_MPRED (1UL << 5) +#define BRBINF_EL_SHIFT 6 +#define BRBINF_EL_MASK GENMASK(1, 0) +#define BRBINF_TYPE_SHIFT 8 +#define BRBINF_TYPE_MASK GENMASK(5, 0) +#define BRBINF_TX (1UL << 16) +#define BRBINF_LASTFAILED (1UL << 17) +#define BRBINF_CC_SHIFT 32 +#define BRBINF_CC_MASK GENMASK(13, 0) +#define BRBINF_CCU (1UL << 46) + +#define BRBINF_EL_EL0 0x0 +#define BRBINF_EL_EL1 0x1 +#define BRBINF_EL_EL2 0x2 + +#define BRBINF_VALID_INVALID 0x0 +#define BRBINF_VALID_TARGET 0x1 +#define BRBINF_VALID_SOURCE 0x2 +#define BRBINF_VALID_ALL 0x3 + +#define BRBINF_TYPE_UNCOND_DIR 0x0 +#define BRBINF_TYPE_INDIR 0x1 +#define BRBINF_TYPE_DIR_LINK 0x2 +#define BRBINF_TYPE_INDIR_LINK 0x3 +#define BRBINF_TYPE_RET_SUB 0x5 +#define BRBINF_TYPE_RET_EXCPT 0x7 +#define BRBINF_TYPE_COND_DIR 0x8 +#define BRBINF_TYPE_DEBUG_HALT 0x21 +#define BRBINF_TYPE_CALL 0x22 +#define BRBINF_TYPE_TRAP 0x23 +#define BRBINF_TYPE_SERROR 0x24 +#define BRBINF_TYPE_INST_DEBUG 0x26 +#define BRBINF_TYPE_DATA_DEBUG 0x27 +#define BRBINF_TYPE_ALGN_FAULT 0x2A +#define BRBINF_TYPE_INST_FAULT 0x2B +#define BRBINF_TYPE_DATA_FAULT 0x2C +#define BRBINF_TYPE_IRQ 0x2E +#define BRBINF_TYPE_FIQ 0x2F +#define BRBINF_TYPE_DEBUG_EXIT 0x39 + +#define BRBCR_E0BRE (1UL << 0) +#define BRBCR_E1BRE (1UL << 1) +#define BRBCR_CC (1UL << 3) +#define BRBCR_MPRED (1UL << 4) +#define BRBCR_FZP (1UL << 8) +#define BRBCR_ERTN (1UL << 22) +#define BRBCR_EXCEPTION (1UL << 23) +#define BRBCR_TS_MASK GENMASK(1, 0) +#define BRBCR_TS_SHIFT 5 + +#define BRBCR_TS_VIRTUAL 0x1 +#define BRBCR_TS_GST_PHYSICAL 0x2 +#define BRBCR_TS_PHYSICAL 0x3 + +#define BRBFCR_LASTFAILED (1UL << 6) +#define BRBFCR_PAUSED (1UL << 7) +#define BRBFCR_ENL (1UL << 16) +#define BRBFCR_DIRECT (1UL << 17) +#define BRBFCR_INDIRECT (1UL << 18) +#define BRBFCR_RTN (1UL << 19) +#define BRBFCR_INDCALL (1UL << 20) +#define BRBFCR_DIRCALL (1UL << 21) +#define BRBFCR_CONDDIR (1UL << 22) +#define BRBFCR_BANK_MASK GENMASK(1, 0) +#define BRBFCR_BANK_SHIFT 28 + +#define BRBFCR_BANK_FIRST 0x0 +#define BRBFCR_BANK_SECOND 0x1 + +#define BRBFCR_BRANCH_ALL (BRBFCR_DIRECT | BRBFCR_INDIRECT | \ + BRBFCR_RTN | BRBFCR_INDCALL | \ + BRBFCR_DIRCALL | BRBFCR_CONDDIR) +#define SYS_MIDR_EL1 sys_reg(3, 0, 0, 0, 0)#define SYS_MPIDR_EL1 sys_reg(3, 0, 0, 0, 5)#define SYS_REVIDR_EL1 sys_reg(3, 0, 0, 0, 6)
@@ -959,6 +1177,7 @@#define ID_AA64MMFR2_CNP_SHIFT 0/* id_aa64dfr0 */ +#define ID_AA64DFR0_BRBE_SHIFT 52#define ID_AA64DFR0_MTPMU_SHIFT 48#define ID_AA64DFR0_TRBE_SHIFT 44#define ID_AA64DFR0_TRACE_FILT_SHIFT 40
@@ -981,6 +1200,9 @@#define ID_AA64DFR0_PMSVER_8_2 0x1#define ID_AA64DFR0_PMSVER_8_3 0x2 +#define ID_AA64DFR0_BRBE 0x1 +#define ID_AA64DFR0_BRBE_V1P1 0x2 +#define ID_DFR0_PERFMON_SHIFT 24#define ID_DFR0_PERFMON_8_0 0x3
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
RFC v2 3/8 arm64/perf: Update struct arm_pmu for BRBE
In reply to Anshuman KhandualAlthough BRBE is an armv8 speciifc HW feature, abstracting out its various function callbacks at the struct arm_pmu level is preferred, as it cleaner , easier to follow and maintain.
Besides some helpers i.e brbe_supported(), brbe_probe() and brbe_reset() might not fit seamlessly, when tried to be embedded via existing arm_pmu helpers in the armv8 implementation.
Update the struct arm_pmu to include all required helpers that will drive BRBE functionality for a given PMU implementation. These are the following.
- brbe_filter : Convert perf event filters into BRBE HW filters
- brbe_probe : Probe BRBE HW and capture its attributes
- brbe_enable : Enable BRBE HW with a given config
- brbe_disable : Disable BRBE HW
- brbe_read : Read BRBE buffer for captured branch records
- brbe_reset : Reset BRBE buffer
- brbe_supported: Whether BRBE is supported or not
A BRBE driver implementation needs to provide these functionalities.
--- arch/arm64/kernel/perf_event.c | 36 ++++++++++++++++++++++++++++++++++ include/linux/perf/arm_pmu.h | 21 ++++++++++++++++++++ 2 files changed, 57 insertions(+)
arch/arm64/kernel/perf_event.c +36 -0
@@ -1025,6 +1025,35 @@ static int armv8pmu_filter_match(struct perf_event *event)return evtype !=ARMV8_PMUV3_PERFCTR_CHAIN ; } +static void armv8pmu_brbe_filter (struct pmu_hw_events *hw_event,struct perf_event *event) +{ +} + +static void armv8pmu_brbe_enable (struct pmu_hw_events *hw_event) +{ +} + +static void armv8pmu_brbe_disable (struct pmu_hw_events *hw_event) +{ +} + +static void armv8pmu_brbe_read (struct pmu_hw_events *hw_event,struct perf_event *event) +{ +} + +static void armv8pmu_brbe_probe (struct pmu_hw_events *hw_event) +{ +} + +static void armv8pmu_brbe_reset (struct pmu_hw_events *hw_event) +{ +} + +static bool armv8pmu_brbe_supported (struct perf_event *event) +{ +return false; +} +static void armv8pmu_reset (void *info) {struct arm_pmu *cpu_pmu = (struct arm_pmu *)info;
@@ -1257,6 +1286,13 @@ static int armv8_pmu_init(struct arm_pmu *cpu_pmu, char *name, cpu_pmu->pmu.event_idx = armv8pmu_user_event_idx; + cpu_pmu->brbe_filter = armv8pmu_brbe_filter; + cpu_pmu->brbe_enable = armv8pmu_brbe_enable; + cpu_pmu->brbe_disable = armv8pmu_brbe_disable; + cpu_pmu->brbe_read = armv8pmu_brbe_read; + cpu_pmu->brbe_probe = armv8pmu_brbe_probe; + cpu_pmu->brbe_reset = armv8pmu_brbe_reset; + cpu_pmu->brbe_supported = armv8pmu_brbe_supported; cpu_pmu->name = name; cpu_pmu->map_event = map_event; cpu_pmu->attr_groups[ARMPMU_ATTR_GROUP_EVENTS] = events ?
include/linux/perf/arm_pmu.h +21 -0
@@ -100,6 +100,27 @@ struct arm_pmu {void (*reset)(void *);int (*map_event)(struct perf_event *event);int (*filter_match)(struct perf_event *event); + +/* Convert perf event filters into BRBE HW filters */ +void (*brbe_filter)(struct pmu_hw_events *hw_events,struct perf_event *event); + +/* Probe BRBE HW and capture its attributes */ +void (*brbe_probe)(struct pmu_hw_events *hw_events); + +/* Enable BRBE HW with a given config */ +void (*brbe_enable)(struct pmu_hw_events *hw_events); + +/* Disable BRBE HW */ +void (*brbe_disable)(struct pmu_hw_events *hw_events); + +/* Process BRBE buffer for captured branch records */ +void (*brbe_read)(struct pmu_hw_events *hw_events,struct perf_event *event); + +/* Reset BRBE buffer */ +void (*brbe_reset)(struct pmu_hw_events *hw_events); + +/* Check whether BRBE is supported */ +bool (*brbe_supported)(struct perf_event *event);int num_events;bool secure_access;/* 32-bit ARM only */ #define ARMV8_PMUV3_MAX_COMMON_EVENTS 0x40
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
RFC v2 4/8 arm64/perf: Update struct pmu_hw_events for BRBE
In reply to Anshuman KhandualA single perf event instance BRBE related contexts and data will be tracked in struct pmu_hw_events. Hence update the structure to accommodate required details related to BRBE.
--- include/linux/perf/arm_pmu.h | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+)
include/linux/perf/arm_pmu.h +22 -0
@@ -43,6 +43,11 @@ }, \ } +/* +* Maximum branch records in BRBE +*/ +#define BRBE_MAX_ENTRIES 64 +/* The events for a given PMU register set. */ struct pmu_hw_events {/*
@@ -69,6 +74,23 @@ struct pmu_hw_events {struct arm_pmu *percpu_pmu;int irq; + +/* Detected BRBE attributes */ +bool v1p1; +int brbe_cc; +int brbe_nr; + +/* Evaluated BRBE configuration */ +u64 brbfcr; +u64 brbcr; + +/* Tracked BRBE context */ +unsigned int brbe_users; +void *brbe_context; + +/* Captured BRBE buffer - copied as is into perf_sample_data */ +struct perf_branch_stack brbe_stack; +struct perf_branch_entry brbe_entries[BRBE_MAX_ENTRIES ]; };enum armpmu_attr_groups {
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
RFC v2 5/8 driver/perf/arm_pmu_platform: Add support for BRBE attributes detection
In reply to Anshuman KhandualThis adds arm pmu infrastrure to probe BRBE implementation's attributes via driver exported callbacks later. The actual BRBE feature detection will be added by the driver itself.
CPU specific BRBE entries, cycle count, format support gets detected during PMU init. This information gets saved in per-cpu struct pmu_hw_events which later helps in operating BRBE during a perf event context.
--- drivers/perf/arm_pmu_platform.c | 34 +++++++++++++++++++++++++++++++++ 1 file changed, 34 insertions(+)
drivers/perf/arm_pmu_platform.c +34 -0
@@ -172,6 +172,36 @@ static int armpmu_request_irqs(struct arm_pmu *armpmu)return err; } +static void arm_brbe_probe_cpu (void *info) +{ +struct pmu_hw_events *hw_events; +struct arm_pmu *armpmu = info; + +/* +* Return from here, if BRBE driver has not been +* implemented for this PMU. This helps prevent +* kernel crash later when brbe_probe() will be +* called on the PMU. +*/ +if (!armpmu->brbe_probe) +return ; + + hw_events =per_cpu_ptr (armpmu->hw_events,smp_processor_id ()); + armpmu->brbe_probe (hw_events); +} + +static int armpmu_request_brbe (struct arm_pmu *armpmu) +{ +int cpu, err =0 ; + +for_each_cpu (cpu, &armpmu->supported_cpus) { + err =smp_call_function_single (cpu, arm_brbe_probe_cpu, armpmu,1 ); +if (err) +return err; + } +return err; +} +static void armpmu_free_irqs (struct arm_pmu *armpmu) {int cpu;
@@ -229,6 +259,10 @@ int arm_pmu_device_probe(struct platform_device *pdev,if (ret) goto out_free_irqs; + ret =armpmu_request_brbe (pmu); +if (ret) + goto out_free_irqs; + ret =armpmu_register (pmu);if (ret) {dev_err (dev,"failed to register PMU devices!\n" );
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
RFC v2 6/8 arm64/perf: Drive BRBE from perf event states
In reply to Anshuman KhandualBranch stack sampling rides along the normal perf event and all the branch records get captured during the PMU interrupt. This just changes perf event handling on the arm64 platform to accommodate required BRBE operations that will enable branch stack sampling support.
--- arch/arm64/kernel/perf_event.c | 6 +++++ drivers/perf/arm_pmu.c | 40 ++++++++++++++++++++++++++++++++++ 2 files changed, 46 insertions(+)
arch/arm64/kernel/perf_event.c +6 -0
@@ -874,6 +874,12 @@ static irqreturn_t armv8pmu_handle_irq(struct arm_pmu *cpu_pmu)if (!armpmu_event_set_period (event))continue ; +if (has_branch_stack (event)) { + cpu_pmu->brbe_read (cpuc, event); + data.br_stack = &cpuc->brbe_stack; + cpu_pmu->brbe_reset (cpuc); + } +/* * Perf event overflow will queue the processing of the event as * an irq_work which will be taken care of in the handling of
drivers/perf/arm_pmu.c +40 -0
@@ -271,12 +271,22 @@ armpmu_stop(struct perf_event *event, int flags) {struct arm_pmu *armpmu =to_arm_pmu (event->pmu);struct hw_perf_event *hwc = &event->hw; +struct pmu_hw_events *hw_events =this_cpu_ptr (armpmu->hw_events);/* * ARM pmu always has to update the counter, so ignore * PERF_EF_UPDATE, see comments in armpmu_start(). */ if (!(hwc->state &PERF_HES_STOPPED )) { +if (has_branch_stack (event)) { +WARN_ON_ONCE (!hw_events->brbe_users); + hw_events->brbe_users--; +if (!hw_events->brbe_users) { + hw_events->brbe_context =NULL ; + armpmu->brbe_disable (hw_events); + } + } + armpmu->disable (event);armpmu_event_update (event); hwc->state |=PERF_HES_STOPPED |PERF_HES_UPTODATE ;
@@ -287,6 +297,7 @@ static void armpmu_start(struct perf_event *event, int flags) {struct arm_pmu *armpmu =to_arm_pmu (event->pmu);struct hw_perf_event *hwc = &event->hw; +struct pmu_hw_events *hw_events =this_cpu_ptr (armpmu->hw_events);/* * ARM pmu always has to reprogram the period, so ignore
@@ -304,6 +315,14 @@ static void armpmu_start(struct perf_event *event, int flags)* happened since disabling. */ armpmu_event_set_period (event); +if (has_branch_stack (event)) { +if (event->ctx->task && hw_events->brbe_context != event->ctx) { + armpmu->brbe_reset (hw_events); + hw_events->brbe_context = event->ctx; + } + armpmu->brbe_enable (hw_events); + hw_events->brbe_users++; + } armpmu->enable (event); }
@@ -349,6 +368,10 @@ armpmu_add(struct perf_event *event, int flags) hw_events->events[idx] = event; hwc->state =PERF_HES_STOPPED |PERF_HES_UPTODATE ; + +if (has_branch_stack (event)) + armpmu->brbe_filter (hw_events, event); +if (flags &PERF_EF_START )armpmu_start (event,PERF_EF_RELOAD );
@@ -440,6 +463,7 @@ __hw_perf_event_init(struct perf_event *event) {struct arm_pmu *armpmu =to_arm_pmu (event->pmu);struct hw_perf_event *hwc = &event->hw; +struct pmu_hw_events *hw_events =this_cpu_ptr (armpmu->hw_events);int mapping; hwc->flags =0 ;
@@ -494,6 +518,9 @@ __hw_perf_event_init(struct perf_event *event)return -EINVAL ; } +if (has_branch_stack (event)) + armpmu->brbe_filter (hw_events, event); +return 0 ; }
@@ -522,6 +549,18 @@ static int armpmu_event_init(struct perf_event *event)return __hw_perf_event_init (event); } +static void armpmu_sched_task (struct perf_event_context *ctx,bool sched_in) +{ +struct arm_pmu *armpmu =to_arm_pmu (ctx->pmu); +struct pmu_hw_events *hw_events =this_cpu_ptr (armpmu->hw_events); + +if (!hw_events->brbe_users) +return ; + +if (sched_in) + armpmu->brbe_reset (hw_events); +} +static void armpmu_enable (struct pmu *pmu) {struct arm_pmu *armpmu =to_arm_pmu (pmu);
@@ -879,6 +918,7 @@ static struct arm_pmu *__armpmu_alloc(gfp_t flags) } pmu->pmu = (struct pmu ) { + .sched_task = armpmu_sched_task, .pmu_enable = armpmu_enable, .pmu_disable = armpmu_disable, .event_init = armpmu_event_init,
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
RFC v2 7/8 arm64/perf: Add BRBE driver
In reply to Anshuman KhandualThis adds a BRBE driver which implements all the required helper functions for struct arm_pmu. Following functions are defined by this driver which will configure, enable, capture, reset and disable BRBE buffer HW as and when requested via perf branch stack sampling framework.
- arm64_pmu_brbe_filter()
- arm64_pmu_brbe_enable()
- arm64_pmu_brbe_disable()
- arm64_pmu_brbe_read()
- arm64_pmu_brbe_probe()
- arm64_pmu_brbe_reset()
- arm64_pmu_brbe_supported()
--- arch/arm64/kernel/perf_event.c | 8 +- drivers/perf/Kconfig | 11 + drivers/perf/Makefile | 1 + drivers/perf/arm_pmu_brbe.c | 425 +++++++++++++++++++++++++++++++++ drivers/perf/arm_pmu_brbe.h | 259 ++++++++++++++++++++ include/linux/perf/arm_pmu.h | 20 ++ 6 files changed, 723 insertions(+), 1 deletion(-) create mode 100644 drivers/perf/arm_pmu_brbe.c create mode 100644 drivers/perf/arm_pmu_brbe.h
arch/arm64/kernel/perf_event.c +7 -1
@@ -1033,31 +1033,37 @@ static int armv8pmu_filter_match(struct perf_event *event)static void armv8pmu_brbe_filter (struct pmu_hw_events *hw_event,struct perf_event *event) { +arm64_pmu_brbe_filter (hw_event, event); }static void armv8pmu_brbe_enable (struct pmu_hw_events *hw_event) { +arm64_pmu_brbe_enable (hw_event); }static void armv8pmu_brbe_disable (struct pmu_hw_events *hw_event) { +arm64_pmu_brbe_disable (hw_event); }static void armv8pmu_brbe_read (struct pmu_hw_events *hw_event,struct perf_event *event) { +arm64_pmu_brbe_read (hw_event, event); }static void armv8pmu_brbe_probe (struct pmu_hw_events *hw_event) { +arm64_pmu_brbe_probe (hw_event); }static void armv8pmu_brbe_reset (struct pmu_hw_events *hw_event) { +arm64_pmu_brbe_reset (hw_event); }static bool armv8pmu_brbe_supported (struct perf_event *event) { -return false; +return arm64_pmu_brbe_supported (event); }static void armv8pmu_reset (void *info)
drivers/perf/Kconfig +11 -0
@@ -183,6 +183,17 @@ config APPLE_M1_CPU_PMU Provides support for the non-architectural CPU PMUs present on the Apple M1 SoCs and derivatives. +config ARM_BRBE_PMU + tristate "Enable support for Branch Record Buffer Extension (BRBE)" + depends on ARM64 && ARM_PMU + default y + help + Enable perf support for Branch Record Buffer Extension (BRBE) which + records all branches taken in an execution path. This supports some + branch types and privilege based filtering. It captured additional + relevant information such as cycle count, misprediction and branch + type, branch privilege level etc. + source "drivers/perf/hisilicon/Kconfig" config MARVELL_CN10K_DDR_PMU
drivers/perf/Makefile +1 -0
@@ -20,3 +20,4 @@ obj-$(CONFIG_ARM_DMC620_PMU) += arm_dmc620_pmu.o obj-$(CONFIG_MARVELL_CN10K_TAD_PMU) += marvell_cn10k_tad_pmu.o obj-$(CONFIG_MARVELL_CN10K_DDR_PMU) += marvell_cn10k_ddr_pmu.o obj-$(CONFIG_APPLE_M1_CPU_PMU) += apple_m1_cpu_pmu.o +obj-$(CONFIG_ARM_BRBE_PMU) += arm_pmu_brbe.o
drivers/perf/arm_pmu_brbe.c new file +425 -0
425 lines not on this page · raw message
drivers/perf/arm_pmu_brbe.h new file +259 -0
259 lines not on this page · raw message
include/linux/perf/arm_pmu.h +20 -0
@@ -162,6 +162,26 @@ struct arm_pmu {unsigned long acpi_cpuid; }; +#ifdef CONFIG_ARM_BRBE_PMU +void arm64_pmu_brbe_filter (struct pmu_hw_events *hw_events,struct perf_event *event); +void arm64_pmu_brbe_read (struct pmu_hw_events *cpuc,struct perf_event *event); +void arm64_pmu_brbe_disable (struct pmu_hw_events *cpuc); +void arm64_pmu_brbe_enable (struct pmu_hw_events *cpuc); +void arm64_pmu_brbe_probe (struct pmu_hw_events *cpuc); +void arm64_pmu_brbe_reset (struct pmu_hw_events *cpuc); +bool arm64_pmu_brbe_supported (struct perf_event *event); +#else +static inline void arm64_pmu_brbe_filter (struct pmu_hw_events *hw_events,struct perf_event *event) +{ +} +static inline void arm64_pmu_brbe_read (struct pmu_hw_events *cpuc,struct perf_event *event) { } +static inline void arm64_pmu_brbe_disable (struct pmu_hw_events *cpuc) { } +static inline void arm64_pmu_brbe_enable (struct pmu_hw_events *cpuc) { } +static inline void arm64_pmu_brbe_probe (struct pmu_hw_events *cpuc) { } +static inline void arm64_pmu_brbe_reset (struct pmu_hw_events *cpuc) { } +static inline bool arm64_pmu_brbe_supported (struct perf_event *event) {return false; } +#endif +#define to_arm_pmu (p) (container_of(p, struct arm_pmu, pmu))u64 armpmu_event_update (struct perf_event *event);
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
RFC v2 8/8 arm64/perf: Enable branch stack sampling
In reply to Anshuman KhandualNow that all the required pieces are already in place, just enable the perf branch stack sampling support on arm64 platform, by removing the gate which blocks it in armpmu_event_init().
--- drivers/perf/arm_pmu.c | 32 +++++++++++++++++++++++++++++--- 1 file changed, 29 insertions(+), 3 deletions(-)
drivers/perf/arm_pmu.c +29 -3
@@ -539,9 +539,35 @@ static int armpmu_event_init(struct perf_event *event) !cpumask_test_cpu(event->cpu, &armpmu->supported_cpus))return -ENOENT ; -/* does not support taken branch sampling */ -if (has_branch_stack (event)) -return -EOPNOTSUPP ; +if (has_branch_stack (event)) { +/* +* BRBE support is absent. Select CONFIG_ARM_BRBE_PMU +* in the config, before branch stack sampling events +* can be requested. +*/ +if (!IS_ENABLED (CONFIG_ARM_BRBE_PMU )) { +pr_warn_once ("BRBE is disabled, select CONFIG_ARM_BRBE_PMU\n" ); +return -EOPNOTSUPP ; + } + +if (event->attr.branch_sample_type &PERF_SAMPLE_BRANCH_KERNEL ) { +if (!perfmon_capable ()) { +pr_warn_once ("does not have permission for kernel branch filter\n" ); +return -EPERM ; + } + } + +/* +* Branch stack sampling event can not be supported in +* case either the required driver itself is absent or +* BRBE buffer, is not supported. Besides checking for +* the callback prevents a crash in case it's absent. +*/ +if (!armpmu->brbe_supported || !armpmu->brbe_supported (event)) { +pr_warn_once ("BRBE is not supported\n" ); +return -EOPNOTSUPP ; + } + }if (armpmu->map_event (event) == -ENOENT )return -ENOENT ;
Signature · 7 lines
2.25.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel