perf tools amd ibs: Fixes + future enhancements
cover perf tools amd ibs: Fixes + future enhancements
o Drop perf unit test that assumes IBS don't have hardware-assisted privilege filter. This is now supported.
o Starting with Zen4, the validity of several IBS fields changes. Add the required dependency checks when decoding IBS MSRs.
o Future CPUs extend IBS OP with Streaming-Store and Remote-Socket indicators for load/store instructions. Add decoding support for these new bits.
Patches are prepared on perf-tools-next/perf-tools-next (571d29baa07e).
Kernel patches:
https://lore.kernel.org/r/[email protected]
Ravi Bangoria (6):
perf tool ibs: Sync AMD IBS header file
perf test ibs: Remove obsolete privilege test
perf amd ibs: Suppress bogus TlbRefillLat and DCPhysAd on Zen4+ perf amd ibs: Make Fetch status bits dependent on PhyAddrValid for
newer platforms
perf amd ibs: Decode Remote-Socket flag in IBS OP raw dump perf amd ibs: Decode Streaming-store flag in IBS OP raw dump
tools/arch/x86/include/asm/amd/ibs.h | 4 +- tools/perf/tests/shell/amd-ibs-swfilt.sh | 7 -- tools/perf/util/amd-sample-raw.c | 87 ++++++++++++++++++++++-- 3 files changed, 83 insertions(+), 15 deletions(-)
Signature · 1 line
2.43.0
PATCH 1/6 perf tool ibs: Sync AMD IBS header file
IBS_OP_DATA2 register will have two more fields: strm_st and rmt_socket in future AMD CPUs. Kernel header file is already updated. Add those fields in tools copy as well.
--- tools/arch/x86/include/asm/amd/ibs.h | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
tools/arch/x86/include/asm/amd/ibs.h +3 -1
@@ -99,7 +99,9 @@ union ibs_op_data2 { rmt_node:1, /* 4: destination node */ cache_hit_st:1, /* 5: cache hit state */ data_src_hi:2, /* 6-7: data source high */ - reserved1:56; /* 8-63: reserved */ + strm_st:1, /* 8: streaming store */ + rmt_socket:1, /* 9: remote socket */ + reserved1:54; /* 10-63: reserved */ }; };
Signature · 1 line
2.43.0
Arnaldo Carvalho de Melo
maintainerRe: [PATCH 1/6] perf tool ibs: Sync AMD IBS header file
Quoted 3 lines · Ravi Bangoria
IBS_OP_DATA2register will have two more fields:strm_standrmt_socketin future AMD CPUs. Kernel header file is already updated. Add those fields in tools copy as well.
Was this already merged in the kernel?
- Arnaldo
Quoted 23 lines
Signed-off-by Ravi Bangoria <[email protected]>--- tools/arch/x86/include/asm/amd/ibs.h | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)tools/arch/x86/include/asm/amd/ibs.h +3
-1@@ -99,7 +99,9 @@ union ibs_op_data2 { rmt_node:1, /* 4: destination node */ cache_hit_st:1, /* 5: cache hit state */ data_src_hi:2, /* 6-7: data source high */ - reserved1:56; /* 8-63: reserved */ + strm_st:1, /* 8: streaming store */ + rmt_socket:1, /* 9: remote socket */ + reserved1:54; /* 10-63: reserved */ }; };Signature · 1 line
2.43.0
Re: [PATCH 1/6] perf tool ibs: Sync AMD IBS header file
Hi Arnaldo,
Quoted 6 lines · Arnaldo Carvalho de Melo
Quoted 3 lines · Ravi Bangoria
IBS_OP_DATA2register will have two more fields:strm_standrmt_socketin future AMD CPUs. Kernel header file is already updated. Add those fields in tools copy as well.Was this already merged in the kernel?
Apologies for any confusion. By "Kernel header file is already updated", I meant kernel copy has been updated by following patches. But kernel patches are still under review.
https://lore.kernel.org/r/[email protected]
https://lore.kernel.org/r/[email protected]
Thanks,
Ravi
PATCH 2/6 perf test ibs: Remove obsolete privilege test
In reply to Ravi BangoriaOlder IBS implementations lacked a hardware privilege filter, so the kernel enabled swfilt=1. Newer AMD CPUs will provide privilege filtering via the RIP[63] bit, making swfilt redundant. Remove the perf unit test that assumes IBS has no hardware-assisted privilege filter.
swfilt is ignored by kernel on platforms that support RIP[63] bit filter i.e. all amd-ibs-swfilt.sh tests will test hardware assisted privilege filter.
Without the patch:
# ./perf test -vv 75 test child forked, pid 26029 check availability of IBS swfilt run perf record with modifier and swfilt [FAIL] IBS PMU should not accept exclude_kernel 75: AMD IBS software filtering : FAILED!
With the patch:
# ./perf test -vv 75 check availability of IBS swfilt run perf record with modifier and swfilt [ perf record: Woken up 3 times to write data ] [ perf record: Captured and wrote 0.000 MB /dev/null ] [ perf record: Woken up 3 times to write data ] [ perf record: Captured and wrote 0.000 MB /dev/null ] [ perf record: Woken up 3 times to write data ] [ perf record: Captured and wrote 0.000 MB /dev/null ] [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.000 MB /dev/null ] check number of samples with swfilt [ perf record: Woken up 5 times to write data ] [ perf record: Captured and wrote 0.040 MB - ] [ perf record: Woken up 3 times to write data ] [ perf record: Captured and wrote 0.054 MB - ] 75: AMD IBS software filtering : Ok
--- tools/perf/tests/shell/amd-ibs-swfilt.sh | 7 ------- 1 file changed, 7 deletions(-)
tools/perf/tests/shell/amd-ibs-swfilt.sh +0 -7
@@ -22,13 +22,6 @@ fi echo "run perf record with modifier and swfilt" err=0 -# setting any modifiers should fail -perf record -B -e ibs_op//u -o /dev/null true 2> /dev/null -if [ $? -eq 0 ]; then - echo "[FAIL] IBS PMU should not accept exclude_kernel" - exit 1 -fi - # setting it with swfilt should be fine perf record -B -e ibs_op/swfilt/u -o /dev/null true if [ $? -ne 0 ]; then
Signature · 1 line
2.43.0
PATCH 3/6 perf amd ibs: Suppress bogus TlbRefillLat and DCPhysAd on Zen4+
In reply to Ravi BangoriaOn Zen4 (and future) CPUs, IBS_OP_DATA3[TlbRefillLat] is valid only if IBS_OP_DATA3[DcPhyAddrValid] is set. Similarly, IBS_DC_PHYSADDR is valid if IBS_OP_DATA3[DcLinAddrValid] is _also_ set. Add these checks while decoding IBS MSRs.
When IBS is triggered by an unprivileged user, the kernel now zeroes PhysAddr before storing raw IBS register values in the perf sample. The perf tool, however, still outputs these zero physical addresses, which serves no purpose. So avoid printing zero physical addresses.
Instead of explicit family/model checks use the !zen4_ibs_extensions as a proxy flag to cover Zen 3 and earlier revisions.
--- tools/perf/util/amd-sample-raw.c | 17 ++++++++++++++--- 1 file changed, 14 insertions(+), 3 deletions(-)
tools/perf/util/amd-sample-raw.c +14 -3
@@ -172,6 +172,7 @@ static void pr_ibs_op_data3(union ibs_op_data3 reg)char dc_l1_l2tlb_miss_str[sizeof (" DcL1TlbMiss _ DcL2TlbMiss _" )] ="" ;char dc_l1tlb_hit_str[sizeof (" DcL1TlbHit2M _ DcL1TlbHit1G _" )] ="" ;char op_mem_width_str[sizeof (" OpMemWidth _____ bytes" )] ="" ; +char tlb_refill_lat_str[sizeof (" TlbRefillLat _____" )] ="" ;char dc_l2tlb_hit_2m_str[sizeof (" DcL2TlbHit2M _" )] ="" ;char dc_l2tlb_hit_1g_str[sizeof (" DcL2TlbHit1G _" )] ="" ;char dc_page_size_str[sizeof (" DcPageSize ____" )] ="" ;
@@ -214,17 +215,23 @@ static void pr_ibs_op_data3(union ibs_op_data3 reg) " DcL2TlbHit1G %d", reg.dc_l2_tlb_hit_1g); } +/* Use !zen4_ibs_extensions as a proxy for Zen3 and earlier */ +if (!zen4_ibs_extensions || reg.dc_phy_addr_valid) { +snprintf (tlb_refill_lat_str,sizeof (tlb_refill_lat_str), +" TlbRefillLat %5d" , reg.tlb_refill_lat); + } +printf ("ibs_op_data3:\t%016llx LdOp %d StOp %d%s%s%s DcMiss %d DcMisAcc %d " "DcWcMemAcc %d DcUcMemAcc %d DcLockedOp %d DcMissNoMabAlloc %d " "DcLinAddrValid %d DcPhyAddrValid %d%s%s SwPf %d%s%s " -"DcMissLat %5d TlbRefillLat %5d\n" , +"DcMissLat %5d%s\n" , reg.val, reg.ld_op, reg.st_op, dc_l1_l2tlb_miss_str, dtlb_pgsize_cap ? dc_page_size_str : dc_l1tlb_hit_str, dc_l2tlb_hit_2m_str, reg.dc_miss, reg.dc_mis_acc, reg.dc_wc_mem_acc, reg.dc_uc_mem_acc, reg.dc_locked_op, reg.dc_miss_no_mab_alloc, reg.dc_lin_addr_valid, reg.dc_phy_addr_valid, dc_l2tlb_hit_1g_str, l2_miss_str, reg.sw_pf, op_mem_width_str, op_dc_miss_open_mem_reqs_str, - reg.dc_miss_lat, reg.tlb_refill_lat); + reg.dc_miss_lat, tlb_refill_lat_str); }/*
@@ -253,8 +260,12 @@ static void amd_dump_ibs_op(struct perf_sample *sample)pr_ibs_op_data3 (*op_data3);if (op_data3->dc_lin_addr_valid)printf ("IbsDCLinAd:\t%016llx\n" , *(rip +4 )); -if (op_data3->dc_phy_addr_valid) + +/* Use !zen4_ibs_extensions as a proxy for Zen3 and earlier */ +if (op_data3->dc_phy_addr_valid && *(rip +5 ) && + (!zen4_ibs_extensions || op_data3->dc_lin_addr_valid)) {printf ("IbsDCPhysAd:\t%016llx\n" , *(rip +5 )); + }if (op_data->op_brn_ret && *(rip +6 ))printf ("IbsBrTarget:\t%016llx\n" , *(rip +6 )); }
Signature · 1 line
2.43.0
PATCH 4/6 perf amd ibs: Make Fetch status bits dependent on PhyAddrValid for newer platforms
In reply to Ravi BangoriaOn future CPU SOCs, all IBS_FETCH_CTL status fields are valid only if IBS_FETCH_CTL[IbsPhyAddrValid] is set. Ditto for IBS_FETCH_CTL_EXT. Add these checks while decoding IBS MSRs.
Unfortunately, there is no CPUID bit to indicate the change. Fallback to Family/Model check.
--- tools/perf/util/amd-sample-raw.c | 42 ++++++++++++++++++++++++++++++-- 1 file changed, 40 insertions(+), 2 deletions(-)
tools/perf/util/amd-sample-raw.c +40 -2
@@ -22,6 +22,29 @@ static bool zen4_ibs_extensions;static bool ldlat_cap;static bool dtlb_pgsize_cap; +/* +* Status fields of IBS_FETCH_CTL and IBS_FETCH_CTL_EXT are valid only if +* IBS_FETCH_CTL[PhyAddrValid] is set. +*/ +static int fetch_ctl_depends_on_phy_addr_valid (void ) +{ +static int depends =-1 ;/* -1: Don't know, 1: Yes, 0: No */ + +if (depends !=-1 ) +return depends; + + depends =0 ; +if (cpu_family >0x1a || + (cpu_family ==0x1a && ( + (cpu_model >=0x50 && cpu_model <=0x5f ) || + (cpu_model >=0x80 && cpu_model <=0xaf ) || + (cpu_model >=0xc0 && cpu_model <=0xcf )))) { + depends =1 ; + } + +return depends; +} +static void pr_ibs_fetch_ctl (union ibs_fetch_ctl reg) {const char *const ic_miss_strs[] = {
@@ -43,6 +66,18 @@ static void pr_ibs_fetch_ctl(union ibs_fetch_ctl reg)const char *ic_miss_str =NULL ;const char *l1tlb_pgsz_str =NULL ;char l3_miss_str[sizeof (" L3MissOnly _ FetchOcMiss _ FetchL3Miss _" )] ="" ; +char l3_miss_only_str[sizeof (" L3MissOnly _" )] ="" ; + +if (fetch_ctl_depends_on_phy_addr_valid () && !reg.phy_addr_valid) { +snprintf (l3_miss_only_str,sizeof (l3_miss_only_str), +" L3MissOnly %d" , reg.l3_miss_only); + +printf ("ibs_fetch_ctl:\t%016llx MaxCnt %7d Cnt %7d En %d Val %d Comp %d " +"PhyAddrValid 0 RandEn %d%s\n" , reg.val, reg.fetch_maxcnt <<4 , + reg.fetch_cnt <<4 , reg.fetch_en, reg.fetch_val, reg.fetch_comp, + reg.rand_en, l3_miss_only_str); +return ; + }if (cpu_family ==0x19 && cpu_model <0x10 ) {/*
@@ -72,8 +107,11 @@ static void pr_ibs_fetch_ctl(union ibs_fetch_ctl reg) l3_miss_str); } -static void pr_ic_ibs_extd_ctl (union ic_ibs_extd_ctl reg) +static void pr_ic_ibs_extd_ctl (union ibs_fetch_ctl fetch_ctl,union ic_ibs_extd_ctl reg) { +if (fetch_ctl_depends_on_phy_addr_valid () && !fetch_ctl.phy_addr_valid) +return ; +printf ("ic_ibs_ext_ctl:\t%016llx IbsItlbRefillLat %3d\n" , reg.val, reg.itlb_refill_lat); }
@@ -285,7 +323,7 @@ static void amd_dump_ibs_fetch(struct perf_sample *sample)printf ("IbsFetchLinAd:\t%016llx\n" , *addr++);if (fetch_ctl->phy_addr_valid)printf ("IbsFetchPhysAd:\t%016llx\n" , *addr); -pr_ic_ibs_extd_ctl (*extd_ctl); +pr_ic_ibs_extd_ctl (*fetch_ctl, *extd_ctl); }/*
Signature · 1 line
2.43.0
PATCH 5/6 perf amd ibs: Decode Remote-Socket flag in IBS OP raw dump
In reply to Ravi BangoriaNewer AMD CPUs can mark a data source as coming from a remote socket. When the PMU advertises this feature, interpret IBS_OP_DATA2[9] bit as the Remote-Socket indicator and show it in the raw dump output.
--- tools/perf/util/amd-sample-raw.c | 18 ++++++++++++++++-- 1 file changed, 16 insertions(+), 2 deletions(-)
tools/perf/util/amd-sample-raw.c +16 -2
@@ -21,6 +21,7 @@ static u32 cpu_family, cpu_model, ibs_fetch_type, ibs_op_type;static bool zen4_ibs_extensions;static bool ldlat_cap;static bool dtlb_pgsize_cap; +static bool rmtsocket_cap;/* * Status fields of IBS_FETCH_CTL and IBS_FETCH_CTL_EXT are valid only if
@@ -164,8 +165,13 @@ static void pr_ibs_op_data2_extended(union ibs_op_data2 reg)/* 13 to 31 are reserved. Avoid printing them. */ };int data_src = (reg.data_src_hi <<3 ) | reg.data_src_lo; +char rmtsocket[sizeof ("RmtSocket _ " )] ="" ; - printf("ibs_op_data2:\t%016llx %sRmtNode %d%s\n", reg.val, +if (rmtsocket_cap) +snprintf (rmtsocket,sizeof (rmtsocket),"RmtSocket %d " , reg.rmt_socket); + + printf("ibs_op_data2:\t%016llx %s%sRmtNode %d%s\n", reg.val, + rmtsocket, (data_src == 1 || data_src == 2 || data_src == 5) ? (reg.cache_hit_st ? "CacheHitSt 1=O-State " : "CacheHitSt 0=M-state ") : "", reg.rmt_node,
@@ -184,8 +190,13 @@ static void pr_ibs_op_data2_default(union ibs_op_data2 reg)" DataSrc 6=(reserved)" , " DataSrc 7=Other" }; +char rmtsocket[sizeof ("RmtSocket _ " )] ="" ; + +if (rmtsocket_cap) +snprintf (rmtsocket,sizeof (rmtsocket),"RmtSocket %d " , reg.rmt_socket); -printf ("ibs_op_data2:\t%016llx %sRmtNode %d%s\n" , reg.val, +printf ("ibs_op_data2:\t%016llx %s%sRmtNode %d%s\n" , reg.val, + rmtsocket, reg.data_src_lo ==2 ? (reg.cache_hit_st ?"CacheHitSt 1=O-State " :"CacheHitSt 0=M-state " ) :"" , reg.rmt_node, data_src_str[reg.data_src_lo]);
@@ -429,6 +440,9 @@ bool evlist__has_amd_ibs(struct evlist *evlist)if (perf_env__find_pmu_cap (env,"ibs_op" ,"dtlb_pgsize" )) dtlb_pgsize_cap =1 ; +if (perf_env__find_pmu_cap (env,"ibs_op" ,"rmtsocket" )) + rmtsocket_cap =1 ; +if (ibs_fetch_type || ibs_op_type) {if (!cpu_family)parse_cpuid (env);
Signature · 1 line
2.43.0
PATCH 6/6 perf amd ibs: Decode Streaming-store flag in IBS OP raw dump
In reply to Ravi BangoriaNewer AMD CPUs can tag IBS samples that originate from streaming- store instruction. When the PMU advertises this feature, interpret IBS_OP_DATA2[8] bit as the streaming store indicator and show it in the raw dump output.
--- tools/perf/util/amd-sample-raw.c | 18 ++++++++++++++---- 1 file changed, 14 insertions(+), 4 deletions(-)
tools/perf/util/amd-sample-raw.c +14 -4
@@ -22,6 +22,7 @@ static bool zen4_ibs_extensions;static bool ldlat_cap;static bool dtlb_pgsize_cap;static bool rmtsocket_cap; +static bool strmst_cap;/* * Status fields of IBS_FETCH_CTL and IBS_FETCH_CTL_EXT are valid only if
@@ -166,12 +167,15 @@ static void pr_ibs_op_data2_extended(union ibs_op_data2 reg) };int data_src = (reg.data_src_hi <<3 ) | reg.data_src_lo;char rmtsocket[sizeof ("RmtSocket _ " )] ="" ; +char strmst[sizeof ("StrmSt _ " )] ="" ;if (rmtsocket_cap)snprintf (rmtsocket,sizeof (rmtsocket),"RmtSocket %d " , reg.rmt_socket); +if (strmst_cap) +snprintf (strmst,sizeof (strmst),"StrmSt %d " , reg.strm_st); - printf("ibs_op_data2:\t%016llx %s%sRmtNode %d%s\n", reg.val, - rmtsocket, + printf("ibs_op_data2:\t%016llx %s%s%sRmtNode %d%s\n", reg.val, + rmtsocket, strmst, (data_src == 1 || data_src == 2 || data_src == 5) ? (reg.cache_hit_st ? "CacheHitSt 1=O-State " : "CacheHitSt 0=M-state ") : "", reg.rmt_node,
@@ -191,12 +195,15 @@ static void pr_ibs_op_data2_default(union ibs_op_data2 reg) " DataSrc 7=Other" };char rmtsocket[sizeof ("RmtSocket _ " )] ="" ; +char strmst[sizeof ("StrmSt _ " )] ="" ;if (rmtsocket_cap)snprintf (rmtsocket,sizeof (rmtsocket),"RmtSocket %d " , reg.rmt_socket); +if (strmst_cap) +snprintf (strmst,sizeof (strmst),"StrmSt %d " , reg.strm_st); -printf ("ibs_op_data2:\t%016llx %s%sRmtNode %d%s\n" , reg.val, - rmtsocket, +printf ("ibs_op_data2:\t%016llx %s%s%sRmtNode %d%s\n" , reg.val, + rmtsocket, strmst, reg.data_src_lo ==2 ? (reg.cache_hit_st ?"CacheHitSt 1=O-State " :"CacheHitSt 0=M-state " ) :"" , reg.rmt_node, data_src_str[reg.data_src_lo]);
@@ -443,6 +450,9 @@ bool evlist__has_amd_ibs(struct evlist *evlist)if (perf_env__find_pmu_cap (env,"ibs_op" ,"rmtsocket" )) rmtsocket_cap =1 ; +if (perf_env__find_pmu_cap (env,"ibs_op" ,"strmst" )) + strmst_cap =1 ; +if (ibs_fetch_type || ibs_op_type) {if (!cpu_family)parse_cpuid (env);
Signature · 1 line
2.43.0