Skip to contentSkip to conversation

2.6.17.1 new perfmon code base, libpfm, pfmon available

DISCUSSION Chuck Ebbert 3 participants 3 messages Jun 27, 2006 Library code

lore
Share & tools
lore
#0 lore raw

In-Reply-To: <[email protected]>

Quoted 6 lines · Stephane Eranian
Quoted 3 lines

32-bit works great. Unfortunately, pfmon is far too limited for serious kernel monitoring AFAICT. E.g. you can't select edge counting instead of cycle counting. So you can count how many clock cycles were spent with interrupts

I put in an option to enable this mode, do pfmon --help. I think it's called edge-mask.

Silly me, I was reading the documentation, which doesn't cover this. :) It works:

$ pfmon --system-wide -0 -e interrupts_masked_cycles,interrupts_taken --edge-mask 0,1 -t 10
<session to end in 10 seconds>
CPU0    16359 INTERRUPTS_MASKED_CYCLES
CPU0     5006 INTERRUPTS_TAKEN

5006 hardware interrupts in 10 seconds, 16359 interrupt-disable events => the kernel disabled interrupts 11353 times for critical sections. To get useful results it looks like booting with idle=poll and disabling cpufreq is needed, though, since interrupts_masked_cycles (non-edge mode) counts even when the CPU is halted:

$ pfmon --system-wide -0 -e interrupts_masked_cycles,cpu_clk_unhalted -t 10
<session to end in 10 seconds>
CPU0    352020255 INTERRUPTS_MASKED_CYCLES
CPU0     65351172 CPU_CLK_UNHALTED
Quoted 10 lines
Quoted 5 lines

And is someone working on kernel profiling tools that use the perfmon2 infrastructure on i386? I'd like to see kernel-based profiling that lets you use something like the existing 'readprofile' to retrieve results. This would be a lot better than the current timer-based profiling.

You can do this on your athlon using pfmon already, you need to enable a different sampling module. Here is an example:

$ pfmon --smpl-module=inst-hist -ecpu_clk_unhalted -k --long-smpl-period0000 \
     --resolve-addr --system-wide --session-timeout

That produces no output except for column headings. Thinking it was a problem with x86_64 32-bit support, I built a p6 version. I tried both short and long periods on both systems with the same result:

$ pfmon --smpl-module=inst-hist -ecpu_clk_unhalted -k --short-smpl-period0000 --resolve-addr --system-wide -t 10
only kernel symbols are resolved in system-wide mode
<session to end in 10 seconds>
# counts   %self    %cum code address
# counts   %self    %cum code address

And here's what it took to get everything working on Pentium II (seems OK, not thoroughly tested:)
_

perfmon: add Pentium II support (family 6 model 3 only.)

arch/i386/perfmon/perfmon_p6.c +3 -0
@@ -76,6 +76,9 @@ static int pfm_p6_probe_pmu(void)
 	}
 
 	switch(cpu_data->x86_model) {
+		case 3:
+			PFM_INFO("Pentium II PMU detected");
+			break;
 		case 7 ... 11:
 			PFM_INFO("P6 core PMU detected");
 			break;

_

libpfm: Add Pentium II support (family 6 model 3 only.)

lib/pfmlib_i386_p6.c +1 -0
@@ -136,6 +136,7 @@ pfm_i386_p6_detect(void)
 		return PFMLIB_ERR_NOTSUPP;
 
 	switch(model) {
+		case 3: /* Pentium II */
 		case 7: /* Pentium III Katmai */
 		case 8: /* Pentium III Coppermine */
 		case 9: /* Mobile Pentium III */

_

pfmon: don't build gen_ia32 sample module if not configured.

pfmon/pfmon_smpl.c +2 -0
@@ -61,6 +61,8 @@ static pfmon_smpl_module_t *smpl_modules
 #endif
 #ifdef CONFIG_PFMON_I386_P6
 	&detailed_i386_p6_smpl_module, /* must be first for P6 */
+#endif
+#ifdef CONFIG_PFMON_GEN_IA32
 	&detailed_gen_ia32_smpl_module, /* must be last for I386 */
 #endif
 	&inst_hist_smpl_module,		/* works for any PMU model */
Signature · 2 lines
Chuck
 "You can't read a newspaper if you can't read."  --George W. Bush
#1 lore raw

Chuck,

Quoted 7 lines · Chuck Ebbert

It works:

$ pfmon --system-wide -0 -e interrupts_masked_cycles,interrupts_taken --edge-mask 0,1 -t 10
<session to end in 10 seconds>
CPU0    16359 INTERRUPTS_MASKED_CYCLES
CPU0     5006 INTERRUPTS_TAKEN
Quoted 5 lines

5006 hardware interrupts in 10 seconds, 16359 interrupt-disable events => the kernel disabled interrupts 11353 times for critical sections. To get useful results it looks like booting with idle=poll and disabling cpufreq is needed, though, since interrupts_masked_cycles (non-edge mode) counts even when the CPU is halted:

Yes, I think you need to be careful with the idle thread, some events may or may not count when going low-power. I think it is best to avoid going low-power for measurements. It is also useful for some measurements to exclude the idle task, i.e., to get useful kernel execution. For that you can use the --excl-idle option of pfmon.

Quoted 14 lines
$ pfmon --system-wide -0 -e interrupts_masked_cycles,cpu_clk_unhalted -t 10
<session to end in 10 seconds>
CPU0    352020255 INTERRUPTS_MASKED_CYCLES
CPU0     65351172 CPU_CLK_UNHALTED
Quoted 8 lines
Quoted 5 lines

And is someone working on kernel profiling tools that use the perfmon2 infrastructure on i386? I'd like to see kernel-based profiling that lets you use something like the existing 'readprofile' to retrieve results. This would be a lot better than the current timer-based profiling.

You can do this on your athlon using pfmon already, you need to enable a different sampling module. Here is an example:

Quoted 6 lines
Quoted 2 lines
$ pfmon --smpl-module=inst-hist -ecpu_clk_unhalted -k --long-smpl-period0000 \
     --resolve-addr --system-wide --session-timeout

That produces no output except for column headings. Thinking it was a problem with x86_64 32-bit support, I built a p6 version. I tried both short and long periods on both systems with the same result:

I think this is an issue with the NMI setup. I have looked at the code and found some problems. They wil be fixed in the next patch. I suspect that if you say nmi_watchdog=2 on the kernel cmdline, it will work.

I have added the following 3 patches.
Thanks.

Quoted 44 lines

perfmon: add Pentium II support (family 6 model 3 only.)

arch/i386/perfmon/perfmon_p6.c +3 -0
@@ -76,6 +76,9 @@ static int pfm_p6_probe_pmu(void)
 	}
 
 	switch(cpu_data->x86_model) {
+		case 3:
+			PFM_INFO("Pentium II PMU detected");
+			break;
 		case 7 ... 11:
 			PFM_INFO("P6 core PMU detected");
 			break;

_

libpfm: Add Pentium II support (family 6 model 3 only.)

lib/pfmlib_i386_p6.c +1 -0
@@ -136,6 +136,7 @@ pfm_i386_p6_detect(void)
 		return PFMLIB_ERR_NOTSUPP;
 
 	switch(model) {
+		case 3: /* Pentium II */
 		case 7: /* Pentium III Katmai */
 		case 8: /* Pentium III Coppermine */
 		case 9: /* Mobile Pentium III */

_

pfmon: don't build gen_ia32 sample module if not configured.

pfmon/pfmon_smpl.c +2 -0
@@ -61,6 +61,8 @@ static pfmon_smpl_module_t *smpl_modules
 #endif
 #ifdef CONFIG_PFMON_I386_P6
 	&detailed_i386_p6_smpl_module, /* must be first for P6 */
+#endif
+#ifdef CONFIG_PFMON_GEN_IA32
 	&detailed_gen_ia32_smpl_module, /* must be last for I386 */
 #endif
 	&inst_hist_smpl_module,		/* works for any PMU model */
Signature · 1 line
-Stephane
#2 lore raw

On Tue, Jun 27, 2006 at 07:32:04AM -0700, Stephane Eranian wrote:
...

Quoted 9 lines
Quoted 5 lines

5006 hardware interrupts in 10 seconds, 16359 interrupt-disable events ==> the kernel disabled interrupts 11353 times for critical sections. To get useful results it looks like booting with idle=poll and disabling cpufreq is needed, though, since interrupts_masked_cycles (non-edge mode) counts even when the CPU is halted:

Yes, I think you need to be careful with the idle thread, some events may or may not count when going low-power. I think it is best to avoid going low-power for measurements.

Any benchmarking that involves IA64 idle thread is strongly reccomended to use "nohalt" option. It's about a 15-20% performance difference on some interrupt intensive benchmarks (e.g. netperf TCP_RR).

If someone has measured the delta for other architectures that go into a "low power" state in idle thread, I'd be grateful if they posted the results or mailed them to me.

thanks,
grant