2.6.17.1 new perfmon code base, libpfm, pfmon available
In-Reply-To: <[email protected]>
Quoted 6 lines · Stephane Eranian
Quoted 3 lines
32-bit works great. Unfortunately, pfmon is far too limited for serious kernel monitoring AFAICT. E.g. you can't select edge counting instead of cycle counting. So you can count how many clock cycles were spent with interrupts
I put in an option to enable this mode, do pfmon --help. I think it's called edge-mask.
Silly me, I was reading the documentation, which doesn't cover this. :) It works:
$ pfmon --system-wide -0 -e interrupts_masked_cycles,interrupts_taken --edge-mask 0,1 -t 10 <session to end in 10 seconds> CPU0 16359 INTERRUPTS_MASKED_CYCLES CPU0 5006 INTERRUPTS_TAKEN
5006 hardware interrupts in 10 seconds, 16359 interrupt-disable events => the kernel disabled interrupts 11353 times for critical sections. To get useful results it looks like booting with idle=poll and disabling cpufreq is needed, though, since interrupts_masked_cycles (non-edge mode) counts even when the CPU is halted:
$ pfmon --system-wide -0 -e interrupts_masked_cycles,cpu_clk_unhalted -t 10 <session to end in 10 seconds> CPU0 352020255 INTERRUPTS_MASKED_CYCLES CPU0 65351172 CPU_CLK_UNHALTED
Quoted 10 lines
Quoted 5 lines
And is someone working on kernel profiling tools that use the perfmon2 infrastructure on i386? I'd like to see kernel-based profiling that lets you use something like the existing 'readprofile' to retrieve results. This would be a lot better than the current timer-based profiling.
You can do this on your athlon using pfmon already, you need to enable a different sampling module. Here is an example:
$ pfmon --smpl-module=inst-hist -ecpu_clk_unhalted -k --long-smpl-period0000 \ --resolve-addr --system-wide --session-timeout
That produces no output except for column headings. Thinking it was a problem with x86_64 32-bit support, I built a p6 version. I tried both short and long periods on both systems with the same result:
$ pfmon --smpl-module=inst-hist -ecpu_clk_unhalted -k --short-smpl-period0000 --resolve-addr --system-wide -t 10 only kernel symbols are resolved in system-wide mode <session to end in 10 seconds> # counts %self %cum code address # counts %self %cum code address
And here's what it took to get everything working on Pentium II (seems OK, not thoroughly tested:)
_
perfmon: add Pentium II support (family 6 model 3 only.)
arch/i386/perfmon/perfmon_p6.c +3 -0
@@ -76,6 +76,9 @@ static int pfm_p6_probe_pmu(void) }switch (cpu_data->x86_model) { +case 3 : +PFM_INFO ("Pentium II PMU detected" ); +break ; case 7 ... 11:PFM_INFO ("P6 core PMU detected" );break ;
_
libpfm: Add Pentium II support (family 6 model 3 only.)
lib/pfmlib_i386_p6.c +1 -0
@@ -136,6 +136,7 @@ pfm_i386_p6_detect(void)return PFMLIB_ERR_NOTSUPP ;switch (model) { +case 3 :/* Pentium II */ case 7 :/* Pentium III Katmai */ case 8 :/* Pentium III Coppermine */ case 9 :/* Mobile Pentium III */
_
pfmon: don't build gen_ia32 sample module if not configured.
pfmon/pfmon_smpl.c +2 -0
@@ -61,6 +61,8 @@ static pfmon_smpl_module_t *smpl_modules#endif #ifdef CONFIG_PFMON_I386_P6 &detailed_i386_p6_smpl_module, /* must be first for P6 */ +#endif +#ifdef CONFIG_PFMON_GEN_IA32 &detailed_gen_ia32_smpl_module,/* must be last for I386 */ #endif &inst_hist_smpl_module, /* works for any PMU model */
Signature · 2 lines
Chuck "You can't read a newspaper if you can't read." --George W. Bush
Chuck,
Quoted 7 lines · Chuck Ebbert
It works:
$ pfmon --system-wide -0 -e interrupts_masked_cycles,interrupts_taken --edge-mask 0,1 -t 10 <session to end in 10 seconds> CPU0 16359 INTERRUPTS_MASKED_CYCLES CPU0 5006 INTERRUPTS_TAKEN
Quoted 5 lines
5006 hardware interrupts in 10 seconds, 16359 interrupt-disable events => the kernel disabled interrupts 11353 times for critical sections. To get useful results it looks like booting with idle=poll and disabling cpufreq is needed, though, since
interrupts_masked_cycles(non-edge mode) counts even when the CPU is halted:
Yes, I think you need to be careful with the idle thread, some events may or may not count when going low-power. I think it is best to avoid going low-power for measurements. It is also useful for some measurements to exclude the idle task, i.e., to get useful kernel execution. For that you can use the --excl-idle option of pfmon.
Quoted 14 lines
$ pfmon --system-wide -0 -e interrupts_masked_cycles,cpu_clk_unhalted -t 10 <session to end in 10 seconds> CPU0 352020255 INTERRUPTS_MASKED_CYCLES CPU0 65351172 CPU_CLK_UNHALTEDQuoted 8 lines
Quoted 5 lines
And is someone working on kernel profiling tools that use the perfmon2 infrastructure on i386? I'd like to see kernel-based profiling that lets you use something like the existing 'readprofile' to retrieve results. This would be a lot better than the current timer-based profiling.
You can do this on your athlon using pfmon already, you need to enable a different sampling module. Here is an example:
Quoted 6 lines
Quoted 2 lines
$ pfmon --smpl-module=inst-hist -ecpu_clk_unhalted -k --long-smpl-period0000 \ --resolve-addr --system-wide --session-timeoutThat produces no output except for column headings. Thinking it was a problem with
x86_6432-bit support, I built a p6 version. I tried both short and long periods on both systems with the same result:
I think this is an issue with the NMI setup. I have looked at the code and found some problems. They wil be fixed in the next patch. I suspect that if you say nmi_watchdog=2 on the kernel cmdline, it will work.
I have added the following 3 patches.
Thanks.
Quoted 44 lines
perfmon: add Pentium II support (family 6 model 3 only.)
arch/i386/perfmon/perfmon_p6.c +3
-0@@ -76,6 +76,9 @@ static int pfm_p6_probe_pmu(void) }switch (cpu_data->x86_model) { +case 3 : +PFM_INFO ("Pentium II PMU detected" ); +break ; case 7 ... 11:PFM_INFO ("P6 core PMU detected" );break ;_
libpfm: Add Pentium II support (family 6 model 3 only.)
lib/pfmlib_i386_p6.c +1
-0@@ -136,6 +136,7 @@ pfm_i386_p6_detect(void)return PFMLIB_ERR_NOTSUPP ;switch (model) { +case 3 :/* Pentium II */ case 7 :/* Pentium III Katmai */ case 8 :/* Pentium III Coppermine */ case 9 :/* Mobile Pentium III */ _
pfmon: don't build
gen_ia32sample module if not configured.pfmon/pfmon_smpl.c +2
-0@@ -61,6 +61,8 @@ static pfmon_smpl_module_t *smpl_modules#endif #ifdef CONFIG_PFMON_I386_P6 &detailed_i386_p6_smpl_module, /* must be first for P6 */ +#endif +#ifdef CONFIG_PFMON_GEN_IA32 &detailed_gen_ia32_smpl_module,/* must be last for I386 */ #endif &inst_hist_smpl_module, /* works for any PMU model */
Signature · 1 line
-Stephane
On Tue, Jun 27, 2006 at 07:32:04AM -0700, Stephane Eranian wrote:
...
Quoted 9 lines
Quoted 5 lines
5006 hardware interrupts in 10 seconds, 16359 interrupt-disable events ==> the kernel disabled interrupts 11353 times for critical sections. To get useful results it looks like booting with idle=poll and disabling cpufreq is needed, though, since
interrupts_masked_cycles(non-edge mode) counts even when the CPU is halted:Yes, I think you need to be careful with the idle thread, some events may or may not count when going low-power. I think it is best to avoid going low-power for measurements.
Any benchmarking that involves IA64 idle thread is strongly reccomended to use "nohalt" option. It's about a 15-20% performance difference on some interrupt intensive benchmarks (e.g. netperf TCP_RR).
If someone has measured the delta for other architectures that go into a "low power" state in idle thread, I'd be grateful if they posted the results or mailed them to me.
thanks,
grant