scripts/kallsyms: filter symbols not in kernel address space
Subsystems (3)
PATCH 1/1 scripts/kallsyms: filter symbols not in kernel address space
This patch uses CONFIG_PAGE_OFFSET to filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in /proc/kallsyms.
For example, on ARM there are some symbols which are linked in relocatable code section, then perf can't parse symbols any more from /proc/kallsyms, and this patch fixes the problem.
--- scripts/kallsyms.c | 12 +++++++++++- scripts/link-vmlinux.sh | 2 ++ 2 files changed, 13 insertions(+), 1 deletion(-)
scripts/kallsyms.c +11 -1
@@ -55,6 +55,7 @@ static struct sym_entry *table;static unsigned int table_size, table_cnt;static int all_symbols =0 ;static char symbol_prefix_char ='\0' ; +static unsigned long long kernel_start_addr =0 ;int token_profit[0x10000 ];
@@ -65,7 +66,10 @@ unsigned char best_table_len[256];static void usage (void ) { -fprintf (stderr,"Usage: kallsyms [--all-symbols] [--symbol-prefix=<prefix char>] < in.map > out.S\n" ); +fprintf (stderr,"Usage: kallsyms [--all-symbols] " +"[--symbol-prefix=<prefix char>] " +"[--page-offset=<CONFIG_PAGE_OFFSET>] " +"< in.map > out.S\n" );exit (1 ); }
@@ -194,6 +198,9 @@ static int symbol_valid(struct sym_entry *s)int i;int offset =1 ; +if (s->addr < kernel_start_addr) +return 0 ; +/* skip prefix char */ if (symbol_prefix_char && *(s->sym +1 ) == symbol_prefix_char) offset++;
@@ -646,6 +653,9 @@ int main(int argc, char **argv)if ((*p =='"' && *(p+2 ) =='"' ) || (*p =='\'' && *(p+2 ) =='\'' )) p++; symbol_prefix_char = *p; + }else if (strncmp (argv[i],"--page-offset=" ,14 ) ==0 ) { +const char *p = &argv[i][14 ]; + kernel_start_addr =strtoull (p,NULL ,16 ); }else usage (); }
scripts/link-vmlinux.sh +2 -0
@@ -82,6 +82,8 @@ kallsyms() kallsymopt="${kallsymopt} --all-symbols" fi + kallsymopt="${kallsymopt} --page-offset=$CONFIG_PAGE_OFFSET" + local aflags="${KBUILD_AFLAGS} ${KBUILD_AFLAGS_KERNEL} \ ${NOSTDINC_FLAGS} ${LINUXINCLUDE} ${KBUILD_CPPFLAGS}"
Signature · 1 line
1.7.9.5
Quoted 9 lines · On Mon, 28 Oct 2013 23:48:59 +0800 Ming Lei <[email protected]> wrote:
This patch uses
CONFIG_PAGE_OFFSETto filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in/proc/kallsyms.For example, on ARM there are some symbols which are linked in relocatable code section, then perf can't parse symbols any more from
/proc/kallsyms, and this patch fixes the problem.
This is a non-back-compatible change and I'd like to see a much stronger assurance that it is safe to merge and will not break any existing application on the planet, please.
For a start, please describe with great precision what these excluded symbols are (examples would help) and explain why no application will conceivably have had any use for them.
Quoted 12 lines · Andrew Morton
Quoted 9 lines · On Mon, 28 Oct 2013 23:48:59 +0800 Ming Lei <[email protected]> wrote:
This patch uses
CONFIG_PAGE_OFFSETto filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in/proc/kallsyms.For example, on ARM there are some symbols which are linked in relocatable code section, then perf can't parse symbols any more from
/proc/kallsyms, and this patch fixes the problem.
Quoted 7 lines
This is a non-back-compatible change and I'd like to see a much stronger assurance that it is safe to merge and will not break any existing application on the planet, please.
For a start, please describe with great precision what these excluded symbols are (examples would help) and explain why no application will conceivably have had any use for them.
These symbols are used to build what is relocatable code; the code which ends up being placed in the machine vectors and the following page.
Rather than have to manually calculate them, I merged a patch which used the tools we have, namely the assembler and linker, to do the job for us. Unfortunately, these symbols have ended up in kallsyms, which various programs read, and having symbols down at the lower 8k is not what they expect.
What it means is we don't have to play these kinds of games in the assembler:
- .equ stubs_offset, __vectors_start + 0x1000 - __stubs_start
__vectors_start:
- W(b) vector_rst + stubs_offset - W(b) vector_und + stubs_offset - W(ldr) pc, .LCvswi + stubs_offset - W(b) vector_pabt + stubs_offset - W(b) vector_dabt + stubs_offset - W(b) vector_addrexcptn + stubs_offset - W(b) vector_irq + stubs_offset - W(b) vector_fiq + stubs_offset
where each vector_* symbol is located at an address greater than __stubs_start. Here's the obvious question: can you understand what's going on with all that?
Quoted 21 lines · On Thu, 31 Oct 2013 22:50:22 +0000 Russell King - ARM Linux…
Quoted 12 lines · Andrew Morton
Quoted 9 lines · On Mon, 28 Oct 2013 23:48:59 +0800 Ming Lei <[email protected]> wrote:
This patch uses
CONFIG_PAGE_OFFSETto filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in/proc/kallsyms.For example, on ARM there are some symbols which are linked in relocatable code section, then perf can't parse symbols any more from
/proc/kallsyms, and this patch fixes the problem.Quoted 7 lines
This is a non-back-compatible change and I'd like to see a much stronger assurance that it is safe to merge and will not break any existing application on the planet, please.
For a start, please describe with great precision what these excluded symbols are (examples would help) and explain why no application will conceivably have had any use for them.
Quoted 5 lines
These symbols are used to build what is relocatable code; the code which ends up being placed in the machine vectors and the following page.
Rather than have to manually calculate them, I merged a patch which used the tools we have, namely the assembler and linker, to do the job for us.
OK. Do you recall which patch that was? And is it the case that this patch excludes only the symbols which that patch accidentally added?
Quoted 18 lines
Unfortunately, these symbols have ended up in kallsyms, which various programs read, and having symbols down at the lower 8k is not what they expect.
What it means is we don't have to play these kinds of games in the assembler:
(quoted diff) +0
-9- .equ stubs_offset, __vectors_start + 0x1000 - __stubs_start __vectors_start: - W(b) vector_rst + stubs_offset - W(b) vector_und + stubs_offset - W(ldr) pc, .LCvswi + stubs_offset - W(b) vector_pabt + stubs_offset - W(b) vector_dabt + stubs_offset - W(b) vector_addrexcptn + stubs_offset - W(b) vector_irq + stubs_offset - W(b) vector_fiq + stubs_offset
Quoted 3 lines
where each vector_* symbol is located at an address greater than
__stubs_start. Here's the obvious question: can you understand what's going on with all that?
Nope ;)
Quoted 23 lines · Andrew Morton
Quoted 21 lines · On Thu, 31 Oct 2013 22:50:22 +0000 Russell King - ARM Linux…
Quoted 19 lines · Andrew Morton
Quoted 9 lines · On Mon, 28 Oct 2013 23:48:59 +0800 Ming Lei <[email protected]> wrote:
This patch uses
CONFIG_PAGE_OFFSETto filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in/proc/kallsyms.For example, on ARM there are some symbols which are linked in relocatable code section, then perf can't parse symbols any more from
/proc/kallsyms, and this patch fixes the problem.This is a non-back-compatible change and I'd like to see a much stronger assurance that it is safe to merge and will not break any existing application on the planet, please.
For a start, please describe with great precision what these excluded symbols are (examples would help) and explain why no application will conceivably have had any use for them.
Quoted 8 lines
Quoted 5 lines
These symbols are used to build what is relocatable code; the code which ends up being placed in the machine vectors and the following page.
Rather than have to manually calculate them, I merged a patch which used the tools we have, namely the assembler and linker, to do the job for us.
OK. Do you recall which patch that was? And is it the case that this patch excludes only the symbols which that patch accidentally added?
It's not a case of "accidentally added" - as we include all symbols in kallsyms which are marked as text/data etc, irrespective of whether they are local or global.
b9b32bf70f2fb made the change, backported to stable trees. e39e3f3ebfef depended on that change so that it could get at the correct offset to copy FIQ code.
Both commits are part of closing an information leak from the kernel as part of a security report back in July.
Hi Andrew,
Thanks for your comment.
Quoted 4 lines · Andrew Morton
For a start, please describe with great precision what these excluded symbols are (examples would help) and explain why no application will conceivably have had any use for them.
Looks Russell has given the example symbols already, and all these symbols should be only for generating code, and they won't be run by kernel since kernel can't run code which isn't in kernel virtual address space, so there is no reason for application to use these symbols.
Actually, there is already report on the problem, see below link:
http://www.gossamer-threads.com/lists/linux/kernel/1808193?page=last
Quoted 2 lines
OK. Do you recall which patch that was? And is it the case that this patch excludes only the symbols which that patch accidentally added?
This patch excludes all kernel symbols(non-module symbols) which aren't in kernel virtual address space, I think it is reasonable and correct.
Thanks,
Signature · 1 line
Ming Lei
PATCH 1/1 scripts/kallsyms: filter symbols not in kernel address space
From: Ming Lei <[email protected]>
This patch uses CONFIG_PAGE_OFFSET to filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in /proc/kallsyms.
For example, on ARM there are some symbols which may be linked in relocatable code section, then perf can't parse symbols any more from /proc/kallsyms, this patch fixes the problem (introduced b9b32bf70f2fb710b07c94e13afbc729afe221da)
---
Stephen, please run this on todays' linux-next, so I can push to Linus asap. Thanks...
scripts/kallsyms.c | 12 +++++++++++- scripts/link-vmlinux.sh | 2 ++ 2 files changed, 13 insertions(+), 1 deletion(-)
scripts/kallsyms.c +11 -1
@@ -55,6 +55,7 @@ static struct sym_entry *table;static unsigned int table_size, table_cnt;static int all_symbols =0 ;static char symbol_prefix_char ='\0' ; +static unsigned long long kernel_start_addr =0 ;int token_profit[0x10000 ];
@@ -65,7 +66,10 @@ unsigned char best_table_len[256];static void usage (void ) { -fprintf (stderr,"Usage: kallsyms [--all-symbols] [--symbol-prefix=<prefix char>] < in.map > out.S\n" ); +fprintf (stderr,"Usage: kallsyms [--all-symbols] " +"[--symbol-prefix=<prefix char>] " +"[--page-offset=<CONFIG_PAGE_OFFSET>] " +"< in.map > out.S\n" );exit (1 ); }
@@ -194,6 +198,9 @@ static int symbol_valid(struct sym_entry *s)int i;int offset =1 ; +if (s->addr < kernel_start_addr) +return 0 ; +/* skip prefix char */ if (symbol_prefix_char && *(s->sym +1 ) == symbol_prefix_char) offset++;
@@ -646,6 +653,9 @@ int main(int argc, char **argv)if ((*p =='"' && *(p+2 ) =='"' ) || (*p =='\'' && *(p+2 ) =='\'' )) p++; symbol_prefix_char = *p; + }else if (strncmp (argv[i],"--page-offset=" ,14 ) ==0 ) { +const char *p = &argv[i][14 ]; + kernel_start_addr =strtoull (p,NULL ,16 ); }else usage (); }
scripts/link-vmlinux.sh +2 -0
@@ -82,6 +82,8 @@ kallsyms() kallsymopt="${kallsymopt} --all-symbols" fi + kallsymopt="${kallsymopt} --page-offset=$CONFIG_PAGE_OFFSET" + local aflags="${KBUILD_AFLAGS} ${KBUILD_AFLAGS_KERNEL} \ ${NOSTDINC_FLAGS} ${LINUXINCLUDE} ${KBUILD_CPPFLAGS}"
Hi Rusty,
Quoted 3 lines · On Fri, 01 Nov 2013 13:06:27 +1030 Rusty Russell <[email protected]> wrote:
Stephen, please run this on todays' linux-next, so I can push to Linus asap. Thanks...
OK, I will apply this near the end of linux-next today.
Signature · 9 lines
Cheers, Stephen Rothwell sfr at canb.auug.org.au -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 836 bytes Desc: not available URL: <http://lists.infradead.org/pipermail/linux-arm-kernel/attachments/20131101/47f0e676/attachment.sig>
Quoted 10 lines · Ming Lei
This patch uses
CONFIG_PAGE_OFFSETto filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in/proc/kallsyms.For example, on ARM there are some symbols which are linked in relocatable code section, then perf can't parse symbols any more from
/proc/kallsyms, and this patch fixes the problem.
Quoted 5 lines
Cc Russell King <[email protected]>Cc linux-arm-kernel at lists.infradead.orgCc Michal Marek <[email protected]>Acked-by Rusty Russell <[email protected]>Signed-off-by Ming Lei <[email protected]>
Sorry for the late report, but I seem to have encountered a problem with this patch, now that it has made it into all stable kernels.
When linking an ARM nommu kernel, I get the output "No valid symbol." twice, from scripts/kallsyms. The problem evidently is that PAGE_OFFSET is still set to 0xC0000000 on ARM NOMMU builds but the kernel is linked to start at PLAT_PHYS_OFFSET instead, which may be elsehwere. For most platforms, this is defined in Kconfig these days, so we could get away with
arch/arm/Kconfig +1 -0
@@ -1592,6 +1592,7 @@ endchoice config PAGE_OFFSET hex + default PHYS_OFFSET if !MMU default 0x40000000 if VMSPLIT_1G default 0x80000000 if VMSPLIT_2G default 0xC0000000
but there are still a few ARM platforms that define their own PLAT_PHYS_OFFSET in memory.h, and it wouldn't help on non-ARM systems that might have the same problem.
Arnd
Hi Arnd,
Quoted 39 lines · Arnd Bergmann
Quoted 10 lines · Ming Lei
This patch uses
CONFIG_PAGE_OFFSETto filter symbols which are not in kernel address space because these symbols are generally for generating code purpose and can't be run at kernel mode, so we needn't keep them in/proc/kallsyms.For example, on ARM there are some symbols which are linked in relocatable code section, then perf can't parse symbols any more from
/proc/kallsyms, and this patch fixes the problem.Quoted 5 lines
Cc Russell King <[email protected]>Cc linux-arm-kernel at lists.infradead.orgCc Michal Marek <[email protected]>Acked-by Rusty Russell <[email protected]>Signed-off-by Ming Lei <[email protected]>Sorry for the late report, but I seem to have encountered a problem with this patch, now that it has made it into all stable kernels.
When linking an ARM nommu kernel, I get the output "No valid symbol." twice, from
scripts/kallsyms. The problem evidently is thatPAGE_OFFSETis still set to0xC0000000on ARM NOMMU builds but the kernel is linked to start atPLAT_PHYS_OFFSETinstead, which may be elsehwere. For most platforms, this is defined inKconfigthese days, so we could get away witharch/arm/Kconfig +1
-0@@ -1592,6 +1592,7 @@ endchoice config PAGE_OFFSET hex + default PHYS_OFFSET if !MMU default 0x40000000 if VMSPLIT_1G default 0x80000000 if VMSPLIT_2G default 0xC0000000
Quoted 3 lines
but there are still a few ARM platforms that define their own
PLAT_PHYS_OFFSETinmemory.h, and it wouldn't help on non-ARM systems that might have the same problem.
We had posted two patches to address the problem, see below link:
http://lists.scusting.com/index.php?t=msg&goto=1726509&S=Google
Thanks,
Signature · 1 line
Ming Lei
Quoted 6 lines · On Tuesday 07 January 2014 22:33:24 Ming Lei wrote:
Quoted 1 line · Arnd Bergmann
On Monday 28 October 2013, Ming Lei wrote:
We had posted two patches to address the problem, see below link:
http://lists.scusting.com/index.php?t=msg&goto=1726509&S=Google
The patch "scripts/link-vmlinux.sh: only filter kernel symbols for arm" has made it in now, which is good for all other architectures, but it makes no difference for nommu-arm, because CONFIG_PAGE_OFFSET is still set.
The second patch from Jonathan Austin has not been applied yet, as of today's linux-next, and it's exactly what I suggested. However it won't work on ARM platforms that define their own PLAT_PHYS_OFFSET:
ebsa110, ep93xx, exynos, footbridge, integrator, iop13xx, ks8695, omap1, realview, rpc, s5pv210 and sa1100. Fortunately these all have MMUs, so in practice it won't hurt, but it doesn't seem correct.
Arnd