perf trace: Fix support for the new BPF feature in clang 12
v2 cover perf trace: Fix support for the new BPF feature in clang 12
Changes in v2:
- Resolved a clang-16 build error pointed out by Namhyung Kim <[email protected]>
The new augmentation feature in perf trace, along with the protocol change (from payload to payload->value), breaks the clang 12 build.
perf trace actually builds for any clang version newer than clang 16. However, as pointed out by Namhyung Kim <[email protected]> and Ian Rogers <[email protected]>, clang 16, which was released in 2023, is still too new for most users. Additionally, as James Clark <[email protected]> noted, some commonly used distributions do not yet support clang 16. Therefore, breaking BPF features between clang 12 and clang 15 is not a good approach.
This patch series rewrites the BPF program in a way that allows it to pass the BPF verifier, even when the BPF bytecode is generated by older versions of clang.
However, I have only tested it till clang 14, as older versions are not supported by my distribution.
Howard Chu (2):
perf build: Change the clang check back to 12.0.1 perf trace: Rewrite BPF code to pass the verifier
tools/perf/Makefile.config | 4 +- .../bpf_skel/augmented_raw_syscalls.bpf.c | 122 ++++++++++-------- 2 files changed, 69 insertions(+), 57 deletions(-)
Signature · 1 line
2.43.0
PATCH v2 1/2 perf build: Change the clang check back to 12.0.1
This serves as a revert for this patch:
https://lore.kernel.org/linux-perf-users/ZuGL9ROeTV2uXoSp@x1/
--- tools/perf/Makefile.config | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
tools/perf/Makefile.config +2 -2
@@ -701,8 +701,8 @@ ifeq ($(BUILD_BPF_SKEL),1) BUILD_BPF_SKEL := 0 else CLANG_VERSION := $(shell $(CLANG) --version | head -1 | sed 's/.*clang version \([[:digit:]]\+.[[:digit:]]\+.[[:digit:]]\+\).*/\1/g') - ifeq ($(call version-lt3,$(CLANG_VERSION),16.0.6),1) - $(warning Warning: Disabled BPF skeletons as at least $(CLANG) version 16.0.6 is reported to be a working setup with the current of BPF based perf features) + ifeq ($(call version-lt3,$(CLANG_VERSION),12.0.1),1) + $(warning Warning: Disabled BPF skeletons as reliable BTF generation needs at least $(CLANG) version 12.0.1) BUILD_BPF_SKEL := 0 endif endif
Signature · 1 line
2.43.0
PATCH v2 2/2 perf trace: Rewrite BPF code to pass the verifier
In reply to Howard ChuRewrite the code to add more memory bound checking in order to pass the BPF verifier, no logic is changed.
This rewrite is centered around two main ideas:
- Always use a variable instead of an expression in if block's condition, so BPF verifier keeps track of the correct register.
- Delay the check as late as possible, just before the BPF function call.
Things that can be done better still:
- Instead of allowing a theoretical maximum of a 6-argument augmentation payload, reduce the payload to a smaller fixed size.
--- .../bpf_skel/augmented_raw_syscalls.bpf.c | 122 ++++++++++-------- 1 file changed, 67 insertions(+), 55 deletions(-)
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +67 -55
@@ -157,9 +157,9 @@ static inline int augmented__output(void *ctx, struct augmented_args_payload *arreturn bpf_perf_event_output (ctx, &__augmented_syscalls__,BPF_F_CURRENT_CPU , args, len); } -static inline int augmented__beauty_output (void *ctx,void *data,int len) +static inline int augmented__beauty_output (void *ctx,struct beauty_payload_enter *args,int len) { -return bpf_perf_event_output (ctx, &__augmented_syscalls__,BPF_F_CURRENT_CPU , data, len); +return bpf_perf_event_output (ctx, &__augmented_syscalls__,BPF_F_CURRENT_CPU , args, len); } static inline
@@ -277,25 +277,31 @@ int sys_enter_rename(struct syscall_enter_args *args)struct augmented_args_payload *augmented_args =augmented_args_payload ();const void *oldpath_arg = (const void *)args->args[0 ], *newpath_arg = (const void *)args->args[1 ]; -unsigned int len =sizeof (augmented_args->args), oldpath_len, newpath_len; +unsigned int len =sizeof (augmented_args->args), oldpath_len, newpath_len, aligned_size;if (augmented_args ==NULL ) -return 1 ;/* Failure: don't filter */ + goto failure; len +=2 *sizeof (u64);// The overhead of size and err, just before the payload... oldpath_len =augmented_arg__read_str (&augmented_args->arg, oldpath_arg,sizeof (augmented_args->arg.value)); - augmented_args->arg.size =PERF_ALIGN (oldpath_len +1 ,sizeof (u64)); - len += augmented_args->arg.size; + aligned_size =PERF_ALIGN (oldpath_len +1 ,sizeof (u64)); + augmented_args->arg.size = aligned_size; + len += aligned_size; + +/* Every read from userspace is limited to value size */ +if (aligned_size >sizeof (augmented_args->arg.value)) + goto failure; -struct augmented_arg *arg2 = (void *)&augmented_args->arg.value + augmented_args->arg.size; +struct augmented_arg *arg2 = (void *)&augmented_args->arg.value + aligned_size; newpath_len =augmented_arg__read_str (arg2, newpath_arg,sizeof (augmented_args->arg.value)); arg2->size = newpath_len; - len += newpath_len;return augmented__output (args, augmented_args, len); +failure: +return 1 ;/* Failure: don't filter */ }SEC ("tp/syscalls/sys_enter_renameat2" )
@@ -304,25 +310,31 @@ int sys_enter_renameat2(struct syscall_enter_args *args)struct augmented_args_payload *augmented_args =augmented_args_payload ();const void *oldpath_arg = (const void *)args->args[1 ], *newpath_arg = (const void *)args->args[3 ]; -unsigned int len =sizeof (augmented_args->args), oldpath_len, newpath_len; +unsigned int len =sizeof (augmented_args->args), oldpath_len, newpath_len, aligned_size;if (augmented_args ==NULL ) -return 1 ;/* Failure: don't filter */ + goto failure; len +=2 *sizeof (u64);// The overhead of size and err, just before the payload... oldpath_len =augmented_arg__read_str (&augmented_args->arg, oldpath_arg,sizeof (augmented_args->arg.value)); - augmented_args->arg.size =PERF_ALIGN (oldpath_len +1 ,sizeof (u64)); - len += augmented_args->arg.size; + aligned_size =PERF_ALIGN (oldpath_len +1 ,sizeof (u64)); + augmented_args->arg.size = aligned_size; + len += aligned_size; -struct augmented_arg *arg2 = (void *)&augmented_args->arg.value + augmented_args->arg.size; +/* Every read from userspace is limited to value size */ +if (aligned_size >sizeof (augmented_args->arg.value)) + goto failure; + +struct augmented_arg *arg2 = (void *)&augmented_args->arg.value + aligned_size; newpath_len =augmented_arg__read_str (arg2, newpath_arg,sizeof (augmented_args->arg.value)); arg2->size = newpath_len; - len += newpath_len;return augmented__output (args, augmented_args, len); +failure: +return 1 ;/* Failure: don't filter */ }#define PERF_ATTR_SIZE_VER0 64/* sizeof first published struct */
@@ -422,12 +434,12 @@ static bool pid_filter__has(struct pids_filtered *pids, pid_t pid)static int augment_sys_enter (void *ctx,struct syscall_enter_args *args) { -bool augmented, do_output = false; -int zero =0 , size, aug_size, index, output =0 , - value_size =sizeof (struct augmented_arg ) - offsetof(struct augmented_arg , value); +bool do_augment = false; +int zero =0 , value_size =sizeof (struct augmented_arg ) -sizeof (u64);unsigned int nr, *beauty_map;struct beauty_payload_enter *payload; -void *arg, *payload_offset; +void *payload_offset, *value_offset; +u64 len =0 ;/* has to be u64, otherwise it won't pass the verifier */ /* fall back to do predefined tail call */ if (args ==NULL )
@@ -436,16 +448,18 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args)/* use syscall number to get beauty_map entry */ nr = (__u32 )args->syscall_nr; beauty_map =bpf_map_lookup_elem (&beauty_map_enter, &nr); +if (beauty_map ==NULL ) +return 1 ;/* set up payload for output */ payload =bpf_map_lookup_elem (&beauty_payload_enter_map, &zero); payload_offset = (void *)&payload->aug_args; - -if (beauty_map ==NULL || payload ==NULL ) +if (payload ==NULL )return 1 ;/* copy the sys_enter header, which has the syscall_nr */ __builtin_memcpy (&payload->args, args,sizeof (struct syscall_enter_args )); + len +=sizeof (struct syscall_enter_args );/* * Determine what type of argument and how many bytes to read from user space, using the
@@ -457,52 +471,50 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args)* buffer: -1 * (index of paired len) -> value of paired len (maximum: TRACE_AUG_MAX_BUF) */ for (int i =0 ; i <6 ; i++) { - arg = (void *)args->args[i]; - augmented = false; - size = beauty_map[i]; - aug_size = size;/* size of the augmented data read from user space */ +int augment_size = beauty_map[i]; +unsigned int augment_size_with_header; +void *addr = (void *)args->args[i]; +bool is_augmented = false; -if (size ==0 || arg ==NULL ) +if (augment_size ==0 || addr ==NULL )continue ; -if (size ==1 ) {/* string */ - aug_size =bpf_probe_read_user_str (((struct augmented_arg *)payload_offset)->value, value_size, arg); -/* minimum of 0 to pass the verifier */ -if (aug_size <0 ) - aug_size =0 ; - - augmented = true; - }else if (size >0 && size <= value_size) {/* struct */ -if (!bpf_probe_read_user (((struct augmented_arg *)payload_offset)->value, size, arg)) - augmented = true; - }else if (size <0 && size >=-6 ) {/* buffer */ - index = -(size +1 ); - aug_size = args->args[index]; - -if (aug_size >TRACE_AUG_MAX_BUF ) - aug_size =TRACE_AUG_MAX_BUF ; - -if (aug_size >0 ) { -if (!bpf_probe_read_user (((struct augmented_arg *)payload_offset)->value, aug_size, arg)) - augmented = true; - } + value_offset = ((struct augmented_arg *)payload_offset)->value; + +if (augment_size ==1 ) {/* string */ + augment_size =bpf_probe_read_user_str (value_offset, value_size, addr); + is_augmented = true; + }else if (augment_size >1 && augment_size <= value_size) {/* struct */ +if (!bpf_probe_read_user (value_offset, value_size, addr)) + is_augmented = true; + }else if (augment_size <0 && augment_size >=-6 ) {/* buffer */ +int index = -(augment_size +1 ); + + augment_size = args->args[index] >TRACE_AUG_MAX_BUF ?TRACE_AUG_MAX_BUF : args->args[index]; +if (!bpf_probe_read_user (value_offset, augment_size, addr)) + is_augmented = true; } -/* write data to payload */ -if (augmented) { -int written = offsetof(struct augmented_arg , value) + aug_size; +/* Augmented data size is limited to value size */ +if (augment_size > value_size) + augment_size = value_size; + +/* Explicitly define this variable to pass the verifier */ + augment_size_with_header =sizeof (u64) + augment_size; - ((struct augmented_arg *)payload_offset)->size = aug_size; - output += written; - payload_offset += written; - do_output = true; +/* Write data to payload */ +if (is_augmented && augment_size_with_header <=sizeof (struct augmented_arg )) { + ((struct augmented_arg *)payload_offset)->size = augment_size; + do_augment = true; + len += augment_size_with_header; + payload_offset += augment_size_with_header; } } -if (!do_output) +if (!do_augment || len >sizeof (struct beauty_payload_enter ))return 1 ; -return augmented__beauty_output (ctx, payload,sizeof (struct syscall_enter_args ) + output); +return augmented__beauty_output (ctx, payload, len); }SEC ("tp/raw_syscalls/sys_enter" )
Signature · 1 line
2.43.0
Quoted 22 lines · Howard Chu
Changes in v2:
- Resolved a clang-16 build error pointed out by Namhyung Kim <[email protected]>The new augmentation feature in perf trace, along with the protocol change (from payload to
payload->value), breaks the clang 12 build.perf trace actually builds for any clang version newer than clang 16. However, as pointed out by Namhyung Kim <[email protected]> and Ian Rogers <[email protected]>, clang 16, which was released in 2023, is still too new for most users. Additionally, as James Clark <[email protected]> noted, some commonly used distributions do not yet support clang 16. Therefore, breaking BPF features between clang 12 and clang 15 is not a good approach.
This patch series rewrites the BPF program in a way that allows it to pass the BPF verifier, even when the BPF bytecode is generated by older versions of clang.
However, I have only tested it till clang 14, as older versions are not supported by my distribution.
Quoted 8 lines
Howard Chu (2):
perf build: Change the clang check back to 12.0.1 perf trace: Rewrite BPF code to pass the verifiertools/perf/Makefile.config | 4 +- .../bpf_skel/augmented_raw_syscalls.bpf.c | 122 ++++++++++-------- 2 files changed, 69 insertions(+), 57 deletions(-)
Tested with clang 15:
$ sudo perf trace -e write --max-events=100 -- echo hello
0.000 ( 0.014 ms): echo/976249 write(fd: 1, buf: hello\10, count: 6)
=
Namhyung Kim
maintainerQuoted 19 lines · Howard Chu
Changes in v2:
- Resolved a clang-16 build error pointed out by Namhyung Kim <[email protected]>The new augmentation feature in perf trace, along with the protocol change (from payload to
payload->value), breaks the clang 12 build.perf trace actually builds for any clang version newer than clang 16. However, as pointed out by Namhyung Kim <[email protected]> and Ian Rogers <[email protected]>, clang 16, which was released in 2023, is still too new for most users. Additionally, as James Clark <[email protected]> noted, some commonly used distributions do not yet support clang 16. Therefore, breaking BPF features between clang 12 and clang 15 is not a good approach.
This patch series rewrites the BPF program in a way that allows it to pass the BPF verifier, even when the BPF bytecode is generated by older versions of clang.
Quoted 6 lines
However, I have only tested it till clang 14, as older versions are not supported by my distribution.
Howard Chu (2):
perf build: Change the clang check back to 12.0.1 perf trace: Rewrite BPF code to pass the verifier
Tested with clang 16. And I think it's better to change the order of the commits so it can fix the problem first and then check the version.
Thanks,
Namhyung
Quoted 8 lines
tools/perf/Makefile.config | 4 +- .../bpf_skel/augmented_raw_syscalls.bpf.c | 122 ++++++++++-------- 2 files changed, 69 insertions(+), 57 deletions(-)Signature · 1 line
2.43.0
Arnaldo Carvalho de Melo
maintainerQuoted 23 lines · Namhyung Kim
Quoted 21 lines · Howard Chu
Changes in v2:
- Resolved a clang-16 build error pointed out by Namhyung Kim <[email protected]>The new augmentation feature in perf trace, along with the protocol change (from payload to
payload->value), breaks the clang 12 build.perf trace actually builds for any clang version newer than clang 16. However, as pointed out by Namhyung Kim <[email protected]> and Ian Rogers <[email protected]>, clang 16, which was released in 2023, is still too new for most users. Additionally, as James Clark <[email protected]> noted, some commonly used distributions do not yet support clang 16. Therefore, breaking BPF features between clang 12 and clang 15 is not a good approach.
This patch series rewrites the BPF program in a way that allows it to pass the BPF verifier, even when the BPF bytecode is generated by older versions of clang.
However, I have only tested it till clang 14, as older versions are not supported by my distribution.
Quoted 6 lines
Quoted 3 lines
Howard Chu (2):
perf build: Change the clang check back to 12.0.1 perf trace: Rewrite BPF code to pass the verifierTested with clang 16. And I think it's better to change the order of the commits so it can fix the problem first and then check the version.
So, I tested it on a RHEL8 system and it gets built with clang 17 but then fails to load, the verifier complains about lack of bounds checking for the index of the syscall array, with or without this last patch from Howard.
I also simplified it to a more minimal version withour renaming variables, so that we see what exactly fixed the problem, its available at the perf-tools/tmp.perf-tools branch, I've talked about it with Howard over chat.
Song Liu reproduced the problem (unsure with what clang and kernel versions) and couldn't find a way to fix it using the usual tricks to coax clang to keep the bounds checking for the verifier to get satisfied.
More generally I'll use virtme-ng[1] to test with a wider range of kernels, not just clang versions.
- Arnaldo
Arnaldo Carvalho de Melo
maintainerQuoted 14 lines · Arnaldo Carvalho de Melo
Quoted 7 lines · Namhyung Kim
Quoted 3 lines · Howard Chu
Howard Chu (2):
perf build: Change the clang check back to 12.0.1 perf trace: Rewrite BPF code to pass the verifierTested with clang 16. And I think it's better to change the order of the commits so it can fix the problem first and then check the version.
So, I tested it on a RHEL8 system and it gets built with clang 17 but then fails to load, the verifier complains about lack of bounds checking for the index of the syscall array, with or without this last patch from Howard.
Quoted 4 lines
I also simplified it to a more minimal version withour renaming variables, so that we see what exactly fixed the problem, its available at the perf-tools/tmp.perf-tools branch, I've talked about it with Howard over chat.
Just to give more details, without the following patch:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +2 -1
@@ -485,7 +485,8 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args)if (!bpf_probe_read_user (((struct augmented_arg *)payload_offset)->value, size, arg)) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ - index = -(size +1 ); +//index = -(size + 1); + index =0 ; aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )
[acme@dell-per740-01 perf-tools]$
We end up with:
; } else if (size < 0 && size >= -6) { /* buffer */
111: (b7) r1 = -6
112: (2d) if r1 > r9 goto pc-22
R0=map_value(id=0,off=0,ks=4,vs=24688,imm=0) R1_w=inv-6 R2=invP40 R3=inv(id=0) R4=map_value(id=0,off=112,ks=4,vs=24688,imm=0) R6=map_value(id=0,off=20,ks=4,vs=24,imm=0) R7=map_value(id=0,off=56,ks=4,vs=8272,imm=0) R8=invP6 R9=inv(id=0,umin_value=18446744073709551610,var_off=(0xffffffff00000000; 0xffffffff)) R10=fp0 fp-8=mmmmmmmm fp-16=map_value fp-24=map_value fp-32=map_value fp-40=invP40 fp-48=ctx fp-56=map_value fp-64=inv1 fp-72=map_value fp-80=map_value
; index = -(size + 1);
113: (a7) r9 ^= -1
114: (67) r9 <<= 32
115: (77) r9 >>= 32
; aug_size = args->args[index];
116: (67) r9 <<= 3
117: (79) r1 = *(u64 *)(r10 -32)
118: (0f) r1 += r9last_idx 118 first_idx 111
regs=200 stack=0 before 117: (79) r1 = *(u64 *)(r10 -32)
regs=200 stack=0 before 116: (67) r9 <<= 3
regs=200 stack=0 before 115: (77) r9 >>= 32
regs=200 stack=0 before 114: (67) r9 <<= 32
regs=200 stack=0 before 113: (a7) r9 ^= -1
regs=200 stack=0 before 112: (2d) if r1 > r9 goto pc-22
regs=202 stack=0 before 111: (b7) r1 = -6
R0=map_value(id=0,off=0,ks=4,vs=24688,imm=0) R1=inv1 R2=invP40 R3=inv(id=0) R4=map_value(id=0,off=112,ks=4,vs=24688,imm=0) R6=map_value(id=0,off=20,ks=4,vs=24,imm=0) R7=map_value(id=0,off=56,ks=4,vs=8272,imm=0) R8=invP6 R9_r=invP(id=0,smin_value=-2147483648,smax_value=0) R10=fp0 fp-8=mmmmmmmm fp-16=map_value fp-24=map_value fp-32_r=map_value fp-40=invP40 fp-48=ctx fp-56=map_value fp-64=inv1 fp-72=map_value fp-80=map_value
parent didn't have regs=200 stack=0 markslast_idx 85 first_idx 85
regs=200 stack=0 before 85: (6d) if r1 s> r9 goto pc+25
R0_w=map_value(id=0,off=0,ks=4,vs=24688,imm=0) R1_rw=invP1 R2_w=invP40 R3_rw=inv(id=0) R4_w=map_value(id=0,off=112,ks=4,vs=24688,imm=0) R6_rw=map_value(id=0,off=20,ks=4,vs=24,imm=0) R7_rw=map_value(id=0,off=56,ks=4,vs=8272,imm=0) R8_rw=invP6 R9_rw=invP(id=0,smin_value=-2147483648,smax_value=4096) R10=fp0 fp-8=mmmmmmmm fp-16_rw=map_value fp-24_rw=map_value fp-32_r=map_value fp-40_rw=invP40 fp-48_r=ctx fp-56_r=map_value fp-64_rw=invP1 fp-72_r=map_value fp-80_r=map_value
parent already had regs=202 stack=0 marks
119: (79) r9 = *(u64 *)(r1 +16)
R0=map_value(id=0,off=0,ks=4,vs=24688,imm=0) R1_w=map_value(id=0,off=0,ks=4,vs=8272,umax_value=34359738360,var_off=(0x0; 0x7fffffff8),s32_max_value=2147483640,u32_max_value=-8) R2=invP40 R3=inv(id=0) R4=map_value(id=0,off=112,ks=4,vs=24688,imm=0) R6=map_value(id=0,off=20,ks=4,vs=24,imm=0) R7=map_value(id=0,off=56,ks=4,vs=8272,imm=0) R8=invP6 R9_w=invP(id=0,umax_value=34359738360,var_off=(0x0; 0x7fffffff8),s32_max_value=2147483640,u32_max_value=-8) R10=fp0 fp-8=mmmmmmmm fp-16=map_value fp-24=map_value fp-32=map_value fp-40=invP40 fp-48=ctx fp-56=map_value fp-64=inv1 fp-72=map_value fp-80=map_value
R1 unbounded memory access, make sure to bounds check any such access
processed 549 insns (limit 1000000) max_states_per_insn 3 total_states 27 peak_states 27 mark_read 16
With it (which is not a fix, I'm just using it to narrow down what calculation the compiler is generating code the verifier in that kernel dislikes):
[root@dell-per740-01 ~]# ~acme/bin/perf trace -e *sleep* sleep 1.234567890
0.000 (1234.696 ms): sleep/3852601 nanosleep(rqtp: { .tv_sec: 1, .tv_nsec: 234567890 }) = 0[root@dell-per740-01 ~]#
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1 -0
@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
- Arnaldo
Quoted 11 lines
Song Liu reproduced the problem (unsure with what clang and kernel versions) and couldn't find a way to fix it using the usual tricks to coax clang to keep the bounds checking for the verifier to get satisfied.
More generally I'll use virtme-ng[1] to test with a wider range of kernels, not just clang versions.
- Arnaldo
Arnaldo Carvalho de Melo
maintainerQuoted 20 lines · Arnaldo Carvalho de Melo
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1
-0@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )
Quoted 2 lines
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
It works with this one-liner + the simplified patch from Howard and also on this other system (RHEL9), as well as with Fedora 40, it would be nice if someone could test with clang 16 and report back the version of the kernel tested as well as the distro name/release, that way I can try to get my hands on such as system and test there as well.
Its all at:
https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
This is the current set of patches that when further tested will go to Linus for v6.12:
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..ff14baa7a290bf42 (HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf trace augmented_raw_syscalls: Add more checks to pass the verifier 46180bec048aad85 perf trace augmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers 45d1aadac64869a2 perf build: Change the clang check back to 12.0.14e21679eb81b5f0d perf trace: The return from 'write' isn't a pid2d2314d4b09b5ed9 tools headers UAPI: Sync linux/const.h with the kernel headers
⬢[acme@toolbox perf-tools]$
[root@nine ~]# uname -a
Linux nine 5.14.0-427.31.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Aug 9 14:06:03 EDT 2024 x86_64 x86_64 x86_64 GNU/Linux [root@nine ~]# perf trace -e *sleep* sleep 1.234567890
0.000 (1234.742 ms): sleep/80014 clock_nanosleep(rqtp: 0x7ffc55b11240, rmtp: 0x7ffc55b11230) = 0
[root@nine ~]# clang --version
clang version 17.0.6 (Red Hat, Inc. 17.0.6-5.el9)
Target: x86_64-redhat-linux-gnu
Thread model: posix
InstalledDir: /usr/bin
[root@nine ~]#
- Arnaldo
Quoted 25 lines · Arnaldo Carvalho de Melo
Quoted 20 lines · Arnaldo Carvalho de Melo
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1
-0@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )
Quoted 8 lines
Quoted 2 lines
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
It works with this one-liner + the simplified patch from Howard and also on this other system (RHEL9), as well as with Fedora 40, it would be nice if someone could test with clang 16 and report back the version of the kernel tested as well as the distro name/release, that way I can try to get my hands on such as system and test there as well.
I am testing this one-liner with clang 18.1.8 and an older kernel (it is our version of 5.12 kernel, but the BPF verifier there should be similar to recent kernels). verifier still fails the program. IIUC, the compiler is smart enough to just remove the one-liner completely.
Thanks,
Song
A message that is not in the archive (sent off-list or not yet received): CA+JHD905Xtbb2OYqm3mGbh3C1dKOd-avnC=01=uJfTVEnmA1zQ@mail.gmail.com
Quoted 5 lines · Arnaldo Carvalho de Melo
Maybe a compiler barrier somewhere around those index operations?
Indeed, something like the following helped.
Song
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +2 -0
@@ -477,6 +477,8 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); +barrier_var (index); + index &=7 ; aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )
Namhyung Kim
maintainerHi Arnaldo,
Quoted 34 lines · Arnaldo Carvalho de Melo
Quoted 20 lines · Arnaldo Carvalho de Melo
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1
-0@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )Quoted 2 lines
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
It works with this one-liner + the simplified patch from Howard and also on this other system (RHEL9), as well as with Fedora 40, it would be nice if someone could test with clang 16 and report back the version of the kernel tested as well as the distro name/release, that way I can try to get my hands on such as system and test there as well.
Its all at:
https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
Quoted 7 lines
This is the current set of patches that when further tested will go to Linus for v6.12:
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..
ff14baa7a290bf42(HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf traceaugmented_raw_syscalls: Add more checks to pass the verifier46180bec048aad85perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers45d1aadac64869a2perf build: Change the clang check back to 12.0.1
Wouldn't it be better to have this change after fixing the verifier issues in the later commits?
Quoted 3 lines
4e21679eb81b5f0dperf trace: The return from 'write' isn't a pid2d2314d4b09b5ed9tools headers UAPI: Synclinux/const.hwith the kernel headers ⬢[acme@toolbox perf-tools]$
I guess you also need the syscalltbl fix from Jiri Slaby.
https://lore.kernel.org/linux-perf-users/[email protected]/
Thanks,
Namhyung
Quoted 13 lines
[root@nine ~]# uname -a
Linux nine 5.14.0-427.31.1.el9_4.x86_64 #1 SMPPREEMPT_DYNAMICFri Aug 9 14:06:03 EDT 2024x86_64x86_64x86_64GNU/Linux [root@nine ~]# perf trace -e *sleep* sleep 1.2345678900.000 (1234.742 ms): sleep/80014 clock_nanosleep(rqtp: 0x7ffc55b11240, rmtp: 0x7ffc55b11230) = 0[root@nine ~]# clang --version
clang version 17.0.6 (Red Hat, Inc. 17.0.6-5.el9)
Target: x86_64-redhat-linux-gnu
Thread model: posix
InstalledDir:/usr/bin
[root@nine ~]#- Arnaldo
Arnaldo Carvalho de Melo
maintainerQuoted 40 lines · Namhyung Kim
Hi Arnaldo,
Quoted 37 lines · Arnaldo Carvalho de Melo
Quoted 20 lines · Arnaldo Carvalho de Melo
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1
-0@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )Quoted 2 lines
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
It works with this one-liner + the simplified patch from Howard and also on this other system (RHEL9), as well as with Fedora 40, it would be nice if someone could test with clang 16 and report back the version of the kernel tested as well as the distro name/release, that way I can try to get my hands on such as system and test there as well.
Its all at:
https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
This is the current set of patches that when further tested will go to Linus for v6.12:
Quoted 7 lines
Quoted 4 lines
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..
ff14baa7a290bf42(HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf traceaugmented_raw_syscalls: Add more checks to pass the verifier46180bec048aad85perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers45d1aadac64869a2perf build: Change the clang check back to 12.0.1Wouldn't it be better to have this change after fixing the verifier issues in the later commits?
I'm still testing it, this is a one-liner, so I think that the order in which the patches are applied isn't important. Also Howard's patch (the simplified one) doesn't clash with it.
Quoted 7 lines
Quoted 3 lines
4e21679eb81b5f0dperf trace: The return from 'write' isn't a pid2d2314d4b09b5ed9tools headers UAPI: Synclinux/const.hwith the kernel headers ⬢[acme@toolbox perf-tools]$I guess you also need the syscalltbl fix from Jiri Slaby.
Right, he provided a report about the patch I sent solving the case, I have to check if he replied to my question about perf trace actually _working_ on a 32-bit arch system.
I also want to test it, I'm trying to get hold of such a system.
- Arnaldo
Namhyung Kim
maintainerHi Arnaldo,
Quoted 46 lines · Arnaldo Carvalho de Melo
Quoted 45 lines · Namhyung Kim
Hi Arnaldo,
Quoted 41 lines · Arnaldo Carvalho de Melo
Quoted 20 lines · Arnaldo Carvalho de Melo
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1
-0@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )Quoted 2 lines
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
It works with this one-liner + the simplified patch from Howard and also on this other system (RHEL9), as well as with Fedora 40, it would be nice if someone could test with clang 16 and report back the version of the kernel tested as well as the distro name/release, that way I can try to get my hands on such as system and test there as well.
Its all at:
https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
This is the current set of patches that when further tested will go to Linus for v6.12:
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..
ff14baa7a290bf42(HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf traceaugmented_raw_syscalls: Add more checks to pass the verifier46180bec048aad85perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers45d1aadac64869a2perf build: Change the clang check back to 12.0.1
Quoted 6 lines
Quoted 2 lines
Wouldn't it be better to have this change after fixing the verifier issues in the later commits?
I'm still testing it, this is a one-liner, so I think that the order in which the patches are applied isn't important. Also Howard's patch (the simplified one) doesn't clash with it.
I'm afraid if it'd break git bisect by allowing old clang versions before the fix.
Thanks,
Namhyung
Quoted 16 lines
Quoted 8 lines
Quoted 4 lines
4e21679eb81b5f0dperf trace: The return from 'write' isn't a pid2d2314d4b09b5ed9tools headers UAPI: Synclinux/const.hwith the kernel headers ⬢[acme@toolbox perf-tools]$I guess you also need the syscalltbl fix from Jiri Slaby.
Right, he provided a report about the patch I sent solving the case, I have to check if he replied to my question about perf trace actually _working_ on a 32-bit arch system.
I also want to test it, I'm trying to get hold of such a system.
- Arnaldo
Arnaldo Carvalho de Melo
maintainerQuoted 52 lines · Namhyung Kim
Hi Arnaldo,
Quoted 49 lines · Arnaldo Carvalho de Melo
Quoted 47 lines · Namhyung Kim
Hi Arnaldo,
Quoted 34 lines · Arnaldo Carvalho de Melo
Quoted 20 lines · Arnaldo Carvalho de Melo
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1
-0@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )Quoted 2 lines
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
It works with this one-liner + the simplified patch from Howard and also on this other system (RHEL9), as well as with Fedora 40, it would be nice if someone could test with clang 16 and report back the version of the kernel tested as well as the distro name/release, that way I can try to get my hands on such as system and test there as well.
Its all at:
https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
Quoted 7 lines
This is the current set of patches that when further tested will go to Linus for v6.12:
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..
ff14baa7a290bf42(HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf traceaugmented_raw_syscalls: Add more checks to pass the verifier46180bec048aad85perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers45d1aadac64869a2perf build: Change the clang check back to 12.0.1Wouldn't it be better to have this change after fixing the verifier issues in the later commits?
Quoted 6 lines
Quoted 3 lines
I'm still testing it, this is a one-liner, so I think that the order in which the patches are applied isn't important. Also Howard's patch (the simplified one) doesn't clash with it.
I'm afraid if it'd break git bisect by allowing old clang versions before the fix.
I can reorder the patches if you think it is interesting, but from the extended set of tests I'm performing on different kernel and clang version and in x86_64 and arm 64-bit, 32-bit and various distros, I'm not sure bisection is an option for BPF programs at this stage 8-)
There, did it now it looks like this:
⬢ [acme@toolbox perf-tools]$ git log --oneline torvalds/master..5d3a1b9ca3b1a059 (HEAD -> perf-tools) perf trace arm32: Fix iteration of syscall ids in syscalltbl->entries 34d2358a24fb5963 perf trace augmented_raw_syscalls: Add more checks to pass the verifier cdb84c31bd2813de perf trace augmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers e5c1811c590c4312 perf build: Change the clang check back to 12.0.139c6a356201ebbd7 perf trace: The return from 'write' isn't a pidab8aaab874c4aa37 tools headers UAPI: Sync linux/const.h with the kernel headers
⬢ [acme@toolbox perf-tools]$
Is that what you meant?
Thanks,
- Arnaldo
Namhyung Kim
maintainerQuoted 57 lines · Arnaldo Carvalho de Melo
Quoted 56 lines · Namhyung Kim
Hi Arnaldo,
Quoted 52 lines · Arnaldo Carvalho de Melo
Quoted 40 lines · Namhyung Kim
Hi Arnaldo,
Quoted 37 lines · Arnaldo Carvalho de Melo
Quoted 20 lines · Arnaldo Carvalho de Melo
So I'm trying adding extra bounds checking, marking the index as volatile, adding compiler barriers, etc, all the fun with the verifier, but got distracted with other stuff, coming back to this now.
Ok, the following seems to do the trick:
[acme@dell-per740-01 perf-tools]$ git diff
tools/perf/util/bpf_skel/augmented_raw_syscalls.bpf.c +1
-0@@ -486,6 +486,7 @@ static int augment_sys_enter(void *ctx, struct syscall_enter_args *args) augmented = true; }else if (size <0 && size >=-6 ) {/* buffer */ index = -(size +1 ); + index &=7 ;// To satisfy the bounds checking with the verifier in some kernels aug_size = args->args[index];if (aug_size >TRACE_AUG_MAX_BUF )Quoted 2 lines
I'll now test it without Howard's patch to see if it fixes the RHEL8 + clang 17 case.
It works with this one-liner + the simplified patch from Howard and also on this other system (RHEL9), as well as with Fedora 40, it would be nice if someone could test with clang 16 and report back the version of the kernel tested as well as the distro name/release, that way I can try to get my hands on such as system and test there as well.
Its all at:
https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
This is the current set of patches that when further tested will go to Linus for v6.12:
Quoted 7 lines
Quoted 4 lines
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..
ff14baa7a290bf42(HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf traceaugmented_raw_syscalls: Add more checks to pass the verifier46180bec048aad85perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers45d1aadac64869a2perf build: Change the clang check back to 12.0.1Wouldn't it be better to have this change after fixing the verifier issues in the later commits?
I'm still testing it, this is a one-liner, so I think that the order in which the patches are applied isn't important. Also Howard's patch (the simplified one) doesn't clash with it.
Quoted 7 lines
Quoted 2 lines
I'm afraid if it'd break git bisect by allowing old clang versions before the fix.
I can reorder the patches if you think it is interesting, but from the extended set of tests I'm performing on different kernel and clang version and in
x86_64and arm 64-bit, 32-bit and various distros, I'm not sure bisection is an option for BPF programs at this stage 8-)
Maybe. But at least we can try our best. :)
Quoted 12 lines
There, did it now it looks like this:
⬢ [acme@toolbox perf-tools]$ git log --oneline torvalds/master..
5d3a1b9ca3b1a059(HEAD -> perf-tools) perf trace arm32: Fix iteration of syscall ids insyscalltbl->entries34d2358a24fb5963perf traceaugmented_raw_syscalls: Add more checks to pass the verifiercdb84c31bd2813deperf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifierse5c1811c590c4312perf build: Change the clang check back to 12.0.139c6a356201ebbd7perf trace: The return from 'write' isn't a pidab8aaab874c4aa37tools headers UAPI: Synclinux/const.hwith the kernel headers
⬢ [acme@toolbox perf-tools]$
Quoted 1 line
Is that what you meant?
Nope, I'd like to have e5c1811c590c4312 after the verifier fixes:
34d2358a24fb5963 perf trace augmented_raw_syscalls: Add more checks to pass the verifier cdb84c31bd2813de perf trace augmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers
Thanks,
Namhyung
Arnaldo Carvalho de Melo
maintainerQuoted 28 lines · Namhyung Kim
Quoted 26 lines · Arnaldo Carvalho de Melo
Quoted 25 lines · Namhyung Kim
Quoted 15 lines · Arnaldo Carvalho de Melo
Quoted 13 lines · Namhyung Kim
Quoted 12 lines · Arnaldo Carvalho de Melo
On Tue, Oct 15, 2024 at 04:58:56PM -0300, Arnaldo Carvalho de Melo wrote:
Its all at:https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
This is the current set of patches that when further tested will go to Linus for v6.12:
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..
ff14baa7a290bf42(HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf traceaugmented_raw_syscalls: Add more checks to pass the verifier46180bec048aad85perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers45d1aadac64869a2perf build: Change the clang check back to 12.0.1Quoted 6 lines
Quoted 2 lines
Wouldn't it be better to have this change after fixing the verifier issues in the later commits?
I'm still testing it, this is a one-liner, so I think that the order in which the patches are applied isn't important. Also Howard's patch (the simplified one) doesn't clash with it.
I'm afraid if it'd break git bisect by allowing old clang versions before the fix.
Quoted 6 lines
Quoted 4 lines
I can reorder the patches if you think it is interesting, but from the extended set of tests I'm performing on different kernel and clang version and in
x86_64and arm 64-bit, 32-bit and various distros, I'm not sure bisection is an option for BPF programs at this stage 8-)Maybe. But at least we can try our best. :)
That rhel8 verifier case was with clang 17 even, but whatever, see below :-)
Quoted 11 lines
Quoted 10 lines
There, did it now it looks like this:
⬢ [acme@toolbox perf-tools]$ git log --oneline torvalds/master..
5d3a1b9ca3b1a059(HEAD -> perf-tools) perf trace arm32: Fix iteration of syscall ids insyscalltbl->entries34d2358a24fb5963perf traceaugmented_raw_syscalls: Add more checks to pass the verifiercdb84c31bd2813deperf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifierse5c1811c590c4312perf build: Change the clang check back to 12.0.139c6a356201ebbd7perf trace: The return from 'write' isn't a pidab8aaab874c4aa37tools headers UAPI: Synclinux/const.hwith the kernel headers
⬢ [acme@toolbox perf-tools]$
Quoted 6 lines
Quoted 1 line
Is that what you meant?
Nope, I'd like to have
e5c1811c590c4312after the verifier fixes:
34d2358a24fb5963perf traceaugmented_raw_syscalls: Add more checks to pass the verifiercdb84c31bd2813deperf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers
Done:
⬢ [acme@toolbox perf-tools]$ git log --oneline torvalds/master..d822ca29a4fc5278 (HEAD -> perf-tools) tools headers UAPI: Sync kvm headers with the kernel sources 5d35634ecc2d2c39 perf trace: Fix non-listed archs in the syscalltbl routines7fbff3c0e085745b perf build: Change the clang check back to 12.0.1395d38419f1853de perf trace augmented_raw_syscalls: Add more checks to pass the verifier ecabac70ff919580 perf trace augmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers 39c6a356201ebbd7 perf trace: The return from 'write' isn't a pidab8aaab874c4aa37 tools headers UAPI: Sync linux/const.h with the kernel headers
⬢ [acme@toolbox perf-tools]$
- Arnaldo
Namhyung Kim
maintainerQuoted 59 lines · Arnaldo Carvalho de Melo
Quoted 28 lines · Namhyung Kim
Quoted 26 lines · Arnaldo Carvalho de Melo
Quoted 25 lines · Namhyung Kim
Quoted 15 lines · Arnaldo Carvalho de Melo
Quoted 13 lines · Namhyung Kim
Quoted 12 lines · Arnaldo Carvalho de Melo
On Tue, Oct 15, 2024 at 04:58:56PM -0300, Arnaldo Carvalho de Melo wrote:
Its all at:https://git.kernel.org/pub/scm/linux/kernel/git/perf/perf-tools.git tmp.perf-tools
This is the current set of patches that when further tested will go to Linus for v6.12:
⬢[acme@toolbox perf-tools]$ git log --oneline torvalds/master..
ff14baa7a290bf42(HEAD -> perf-tools, x1/perf-tools, perf-tools/tmp.perf-tools) perf traceaugmented_raw_syscalls: Add more checks to pass the verifier46180bec048aad85perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers45d1aadac64869a2perf build: Change the clang check back to 12.0.1Quoted 6 lines
Quoted 2 lines
Wouldn't it be better to have this change after fixing the verifier issues in the later commits?
I'm still testing it, this is a one-liner, so I think that the order in which the patches are applied isn't important. Also Howard's patch (the simplified one) doesn't clash with it.
I'm afraid if it'd break git bisect by allowing old clang versions before the fix.
Quoted 6 lines
Quoted 4 lines
I can reorder the patches if you think it is interesting, but from the extended set of tests I'm performing on different kernel and clang version and in
x86_64and arm 64-bit, 32-bit and various distros, I'm not sure bisection is an option for BPF programs at this stage 8-)Maybe. But at least we can try our best. :)
That rhel8 verifier case was with clang 17 even, but whatever, see below :-)
Quoted 11 lines
Quoted 10 lines
There, did it now it looks like this:
⬢ [acme@toolbox perf-tools]$ git log --oneline torvalds/master..
5d3a1b9ca3b1a059(HEAD -> perf-tools) perf trace arm32: Fix iteration of syscall ids insyscalltbl->entries34d2358a24fb5963perf traceaugmented_raw_syscalls: Add more checks to pass the verifiercdb84c31bd2813deperf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifierse5c1811c590c4312perf build: Change the clang check back to 12.0.139c6a356201ebbd7perf trace: The return from 'write' isn't a pidab8aaab874c4aa37tools headers UAPI: Synclinux/const.hwith the kernel headers
⬢ [acme@toolbox perf-tools]$Quoted 6 lines
Quoted 1 line
Is that what you meant?
Nope, I'd like to have
e5c1811c590c4312after the verifier fixes:
34d2358a24fb5963perf traceaugmented_raw_syscalls: Add more checks to pass the verifiercdb84c31bd2813deperf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiersDone:
Quoted 9 lines
⬢ [acme@toolbox perf-tools]$ git log --oneline torvalds/master..
d822ca29a4fc5278(HEAD -> perf-tools) tools headers UAPI: Sync kvm headers with the kernel sources5d35634ecc2d2c39perf trace: Fix non-listed archs in the syscalltbl routines7fbff3c0e085745bperf build: Change the clang check back to 12.0.1395d38419f1853deperf traceaugmented_raw_syscalls: Add more checks to pass the verifierecabac70ff919580perf traceaugmented_raw_syscalls: Add extra array index bounds checking to satisfy some BPF verifiers39c6a356201ebbd7perf trace: The return from 'write' isn't a pidab8aaab874c4aa37tools headers UAPI: Synclinux/const.hwith the kernel headers
⬢ [acme@toolbox perf-tools]$
Thanks!
Namhyung