perf :: intel hybrid events (fwd)
Forwarding the questions to perf-users...
Also, I have found out that mem-stores:p event does not work on Intel Alderlake:
# perf record -e mem-stores -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.024 MB perf.data (64 samples) ]
While with precise, it records nothing:
# perf record -e mem-stores:p -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.021 MB perf.data ]
This makes the perf-mem and perf-c2c commands less useful.
Again, is this how it is supposed to work or do I miss some fixes? Or does upstream also miss some fixes?
Thanks.
Michael
---------- Forwarded message ----------
Date: Tue, 12 Apr 2022 22:59:11
From: Michael Petlan <[email protected]>
To: [email protected]
Subject: perf :: intel hybrid events
Hello Jin Yao,
I have a few questions/ideas about hybrid events on Alderlake...
1) L1-{d,i}cache-load{,-misse}s supported partially
Interestingly enough, perf offers the following events in the hwcache set:
L1-dcache-load-misses
L1-dcache-loads
L1-icache-load-misses
L1-icache-loads
Of course, each expands to its cpu_core and cpu_atom version, as following:
# perf stat -e L1-icache-load-misses
^C
Performance counter stats for 'system wide':
146,566 cpu_core/L1-icache-load-misses/
164,971 cpu_atom/L1-icache-load-misses/On my Alderlake testing box with RHEL-9 I see the following support pattern:
| cpu_core | cpu_atom | L1-dcache-load-misses | OK | N/A | L1-dcache-loads | OK | OK | L1-icache-load-misses | OK | OK | L1-icache-loads | N/A | OK |
For dcache, loads are supported on both, while misses do not work on atom. That can be, atom is simpler, thus I can expect it missing some events...
For icache, misses are supported on both, while loads do not work on core. This looks weird, is that really the wanted behavior? Isn't there a bug in the drivers/event specifications?
2) You added --cputype switch to perf-stat via e69dc84282fb474cb87097c6c94 so one can restrict the expansion and keep only one cpu type used. Doesn't perf-record need the same?
3) While perf-stat defaults to "use whatever we can" approach when not every event is supported, puts "<not supported>" into the results, perf-record fails. This is bad for the cases like above, since it fails when one of the events aren't supported. That might make sense if the unsupported event was specified explicitly by the user, e.g. perf record -e AA -e BB -- ./load and perf fails "sorry, I don't support event BB".
However, what if the user just wants L1-dcache-load-misses and encounters perf-record failing just because the event is not supported on Atom?
Shouldn't this behavior be fixed by some --tolerant switch that would ignore the problems and record what is going on on the Core at least?
What are your ideas?
Thanks...
Michael
A message that is not in the archive (sent off-list or not yet received): CA+JHD92zy1iOkok57goXrhjOmri+fZXRhOoNGzwBW+t_a84etw@mail.gmail.com
Hi Michael,
Thanks for reporting the issues.
Quoted 13 lines
Forwarding the questions to perf-users...
Also, I have found out that mem-stores:p event does not work on Intel Alderlake:
# perf record -e mem-stores -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.024 MB perf.data (64 samples) ]While with precise, it records nothing:
Quoted 9 lines
# perf record -e mem-stores:p -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.021 MB perf.data ]This makes the perf-mem and perf-c2c commands less useful.
Again, is this how it is supposed to work or do I miss some fixes? Or does upstream also miss some fixes?
It looks like a perf tool bug.
Actually, we did the support for the perf mem record with patch 4a9086adc329 ("perf mem: Support record for hybrid platform"). It seems we need some extra work for mem-stores:p as well.
Quoted 9 lines
Thanks.
Michael---------- Forwarded message ----------
Date: Tue, 12 Apr 2022 22:59:11
From: Michael Petlan <[email protected] <mailto:[email protected]>>
To: [email protected] <mailto:[email protected]>
Subject: perf :: intel hybrid events
Quoted 4 lines
Hello Jin Yao,
I have a few questions/ideas about hybrid events on Alderlake...
Now, Zhengjun focus on the userspace perf tool enabling.
Zhengjun, could you please take a look all the issues?
Quoted 26 lines
1) L1-{d,i}cache-load{,-misse}s supported partially
Interestingly enough, perf offers the following events in the hwcache set:
L1-dcache-load-misses
L1-dcache-loads
L1-icache-load-misses
L1-icache-loadsOf course, each expands to its
cpu_coreandcpu_atomversion, as following:# perf stat -e L1-icache-load-misses ^C Performance counter stats for 'system wide': 146,566 cpu_core/L1-icache-load-misses/ 164,971 cpu_atom/L1-icache-load-misses/On my Alderlake testing box with RHEL-9 I see the following support pattern:
| cpu_core | cpu_atom | L1-dcache-load-misses | OK | N/A | L1-dcache-loads | OK | OK | L1-icache-load-misses | OK | OK | L1-icache-loads | N/A | OK |
Quoted 6 lines
For dcache, loads are supported on both, while misses do not work on atom. That can be, atom is simpler, thus I can expect it missing some events...
For icache, misses are supported on both, while loads do not work on core. This looks weird, is that really the wanted behavior? Isn't there a bug in the
drivers/eventspecifications?
That's expected. We don't have a proper event for the L1-icache-loads on big core and L1-dcache-load-misses on Atom. You can see the same behavior on the previous core platform SKL and atom platform GLP and TNT.
Quoted 5 lines
2) You added --cputype switch to perf-stat via
e69dc84282fb474cb87097c6c94so one can restrict the expansion and keep only one cpu type used. Doesn't perf-record need the same?
Yes, I agree.
Quoted 9 lines
3) While perf-stat defaults to "use whatever we can" approach when not every event is supported, puts "<not supported>" into the results, perf-record fails. This is bad for the cases like above, since it fails when one of the events aren't supported. That might make sense if the unsupported event was specified explicitly by the user, e.g.
perf record -e AA -e BB -- ./loadand perf fails "sorry, I don't support event BB".
Quoted 7 lines
However, what if the user just wants L1-dcache-load-misses and encounters perf-record failing just because the event is not supported on Atom?
Shouldn't this behavior be fixed by some --tolerant switch that would ignore the problems and record what is going on on the Core at least?
Yes, I agree. I think we should collect anything we can collect. For the unsupported event, a warning should be printed.
BTW: Besides the cache events, the topdown events also have some issues (perf stat --topdown and perf stat defaults) on the hybrid platforms. Zhengjun is working on it. Some Topdown related patches for the hybrid platforms will be posted soon.
Thanks,
Kan
Quoted 5 lines
What are your ideas?
Thanks...Michael
Quoted 42 lines · Kan
Hi Michael,
Thanks for reporting the issues.
Quoted 13 lines
Forwarding the questions to perf-users...
Also, I have found out that mem-stores:p event does not work on Intel Alderlake:
# perf record -e mem-stores -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.024 MB perf.data (64 samples) ]While with precise, it records nothing:
Quoted 9 lines
# perf record -e mem-stores:p -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.021 MB perf.data ]This makes the perf-mem and perf-c2c commands less useful.
Again, is this how it is supposed to work or do I miss some fixes? Or does upstream also miss some fixes?
It looks like a perf tool bug.
Actually, we did the support for the perf mem record with patch
4a9086adc329("perf mem: Support record for hybrid platform"). It seems we need some extra work for mem-stores:p as well.Quoted 9 lines
Thanks.
Michael---------- Forwarded message ----------
Date: Tue, 12 Apr 2022 22:59:11
From: Michael Petlan <[email protected] <mailto:[email protected]>>
To: [email protected] <mailto:[email protected]>
Subject: perf :: intel hybrid events
Quoted 9 lines
Quoted 4 lines
Hello Jin Yao,
I have a few questions/ideas about hybrid events on Alderlake...
Now, Zhengjun focus on the userspace perf tool enabling.
Zhengjun, could you please take a look all the issues?
Sure. I will fix the issues.
Quoted 73 lines
Quoted 26 lines
1) L1-{d,i}cache-load{,-misse}s supported partially
Interestingly enough, perf offers the following events in the hwcache set:
L1-dcache-load-misses
L1-dcache-loads
L1-icache-load-misses
L1-icache-loadsOf course, each expands to its
cpu_coreandcpu_atomversion, as following:# perf stat -e L1-icache-load-misses ^C Performance counter stats for 'system wide': 146,566 cpu_core/L1-icache-load-misses/ 164,971 cpu_atom/L1-icache-load-misses/On my Alderlake testing box with RHEL-9 I see the following support pattern:
| cpu_core | cpu_atom | L1-dcache-load-misses | OK | N/A | L1-dcache-loads | OK | OK | L1-icache-load-misses | OK | OK | L1-icache-loads | N/A | OK |Quoted 6 lines
For dcache, loads are supported on both, while misses do not work on atom. That can be, atom is simpler, thus I can expect it missing some events...
For icache, misses are supported on both, while loads do not work on core. This looks weird, is that really the wanted behavior? Isn't there a bug in the
drivers/eventspecifications?That's expected. We don't have a proper event for the L1-icache-loads on big core and L1-dcache-load-misses on Atom. You can see the same behavior on the previous core platform SKL and atom platform GLP and TNT.
Quoted 5 lines
2) You added --cputype switch to perf-stat via
e69dc84282fb474cb87097c6c94so one can restrict the expansion and keep only one cpu type used. Doesn't perf-record need the same?Yes, I agree.
Quoted 9 lines
3) While perf-stat defaults to "use whatever we can" approach when not every event is supported, puts "<not supported>" into the results, perf-record fails. This is bad for the cases like above, since it fails when one of the events aren't supported. That might make sense if the unsupported event was specified explicitly by the user, e.g.
perf record -e AA -e BB -- ./loadand perf fails "sorry, I don't support event BB".Quoted 7 lines
However, what if the user just wants L1-dcache-load-misses and encounters perf-record failing just because the event is not supported on Atom?
Shouldn't this behavior be fixed by some --tolerant switch that would ignore the problems and record what is going on on the Core at least?
Yes, I agree. I think we should collect anything we can collect. For the unsupported event, a warning should be printed.
BTW: Besides the cache events, the topdown events also have some issues (perf stat --topdown and perf stat defaults) on the hybrid platforms. Zhengjun is working on it. Some Topdown related patches for the hybrid platforms will be posted soon.
Thanks,
KanQuoted 5 lines
What are your ideas?
Thanks...Michael
Signature · 1 line
Zhengjun Xing
I tried the will-it-scale write1 workload, mem-stores:p works OK on ADL, it looks like the issue is related to the test workload.
will-it-scale: https://github.com/antonblanchard/will-it-scale.git
# perf record -e mem-stores:p -- ./runtest.py write1 tasks,processes,processes_idle,threads,threads_idle,linear 0,0,100,0,100,0 1,2346709,96.88,2257694,96.88,2346709 ^C[ perf record: Woken up 6 times to write data ] [ perf record: Captured and wrote 1.491 MB perf.data (31612 samples) ]
Quoted 91 lines · Michael Petlan
Forwarding the questions to perf-users...
Also, I have found out that mem-stores:p event does not work on Intel Alderlake:
# perf record -e mem-stores -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.024 MB perf.data (64 samples) ]While with precise, it records nothing:
# perf record -e mem-stores:p -- ./examples/dummy > /dev/null [ perf record: Woken up 1 times to write data ] [ perf record: Captured and wrote 0.021 MB perf.data ]This makes the perf-mem and perf-c2c commands less useful.
Again, is this how it is supposed to work or do I miss some fixes? Or does upstream also miss some fixes?
Thanks.
Michael---------- Forwarded message ----------
Date: Tue, 12 Apr 2022 22:59:11
From: Michael Petlan <[email protected]>
To: [email protected]
Subject: perf :: intel hybrid eventsHello Jin Yao,
I have a few questions/ideas about hybrid events on Alderlake...
1) L1-{d,i}cache-load{,-misse}s supported partially
Interestingly enough, perf offers the following events in the hwcache set:
L1-dcache-load-misses
L1-dcache-loads
L1-icache-load-misses
L1-icache-loadsOf course, each expands to its
cpu_coreandcpu_atomversion, as following:# perf stat -e L1-icache-load-misses ^C Performance counter stats for 'system wide': 146,566 cpu_core/L1-icache-load-misses/ 164,971 cpu_atom/L1-icache-load-misses/On my Alderlake testing box with RHEL-9 I see the following support pattern:
| cpu_core | cpu_atom | L1-dcache-load-misses | OK | N/A | L1-dcache-loads | OK | OK | L1-icache-load-misses | OK | OK | L1-icache-loads | N/A | OK |For dcache, loads are supported on both, while misses do not work on atom. That can be, atom is simpler, thus I can expect it missing some events...
For icache, misses are supported on both, while loads do not work on core. This looks weird, is that really the wanted behavior? Isn't there a bug in the
drivers/eventspecifications?2) You added --cputype switch to perf-stat via
e69dc84282fb474cb87097c6c94so one can restrict the expansion and keep only one cpu type used. Doesn't perf-record need the same?3) While perf-stat defaults to "use whatever we can" approach when not every event is supported, puts "<not supported>" into the results, perf-record fails. This is bad for the cases like above, since it fails when one of the events aren't supported. That might make sense if the unsupported event was specified explicitly by the user, e.g.
perf record -e AA -e BB -- ./loadand perf fails "sorry, I don't support event BB".However, what if the user just wants L1-dcache-load-misses and encounters perf-record failing just because the event is not supported on Atom?
Shouldn't this behavior be fixed by some --tolerant switch that would ignore the problems and record what is going on on the Core at least?
What are your ideas?
Thanks...Michael
Signature · 1 line
Zhengjun Xing