objtool and cross compilation
v5 cover objtool and cross compilation
The patch series is resent with additional patch for the instruction decoder selftest, since it has been dropped from the tip/objtool/core due to instruction decoder selftest build failure.
Previous version can be found here:
https://lore.kernel.org/lkml/cover.thread-b2a547.your-ad-here.call-01601912612-ext-9766@work.hours/
rfc v4 - v5:
- original patch 1 has been merged. It has been replaced with the patch which moves instruction decoder selftests to tools headers usage. This effectively fixes x86 kernel cross-compilation with CONFIG_X86_DECODER_SELFTEST=y. And posttests are run successfully at least on s390 (with entire patch series applied).
- patch 2 has instruction decoder selftest fixup added.
- also includes patch 5 for objtool header include paths rework.
- patches 2-5 titles changed to those with which they were picked up into tip/objtool/core.
rfc v3 - rfc v4:
- patch 4: objtool: fix x86 orc generation on big endian cross compiles
- introduced "bswap_if_needed()" macro for multi-byte values conversion, which are read from / about to be written to a target native endianness ELF file.
- patch 2: x86/insn: instruction decoder and big endian cross compiles
- changed subject prefix from objtool to x86/insn
- reformated leXX_to_cpu macro make it easier to read
rfc v2 - rfc v3:
- reused __*_ENDIAN_BITFIELD and dropped unneeded byteswap if __KERNEL__ is defined following David's suggestions,
- re-splitted changes and made x86 instruction decoder a separate patch,
- extra patch to add -Wno-nested-externs build flag to enable BUILD_BUG() usage,
- added a safer and more readable leXX_to_cpu macro in x86 instruction decoder,
- simplified includes. Switched to using leXX_to_cpu/cpu_to_leXX in the objtool and x86 instruction decoder since <linux/kernel.h> is included in the objtool already.
rfc v1 - rfc v2:
- rebased onto tip/objtool/core
- reformatted couple of lines
Currently objtool seems to be the only tool from all the build tools needed for x86 build which breaks x86 cross compilation on big endian systems.
But besides x86 cross compilation, endianness awareness is also needed for big endian architectures objtool support in general.
We have working prototype of objtool support and orc unwinder for s390 made originally by Martin Schwidefsky. I'm trying to bring it in shape again and refactor to share more code with "generic" part.
But first things first. This patch series points to endianness problems which should be addressed. Recent "other architectures support" patches currently moved only some problematic parts into x86 arch specific folder. Besides that even though big endian stuff is only needed for the objtool arch/x86/lib/insn.c and arch/x86/include/asm/insn.h are shared across the kernel source and the tools, so changes are applied to both.
Martin Schwidefsky (2):
x86/insn: Support big endian cross-compiles
objtool: Fix reloc generation on big endian cross compiles
Vasily Gorbik (3):
x86/tools: Use tools headers for instruction decoder selftests
objtool: Fix x86 orc generation on big endian cross compiles
objtool: Rework header include paths
arch/x86/include/asm/insn.h | 33 ++++++
arch/x86/include/asm/orc_types.h | 10 ++
arch/x86/lib/insn.c | 101 ++++++++----------
arch/x86/tools/Makefile | 8 +-
arch/x86/tools/insn_sanity.c | 4 -
tools/arch/x86/include/asm/insn.h | 33 ++++++
tools/arch/x86/include/asm/orc_types.h | 10 ++
tools/arch/x86/lib/insn.c | 101 ++++++++----------
tools/objtool/.gitignore | 2 +-
tools/objtool/Makefile | 1 +
tools/objtool/arch/x86/decode.c | 8 +-
.../arch/x86/include/{ => arch}/cfi_regs.h | 0
.../x86/include/{arch_elf.h => arch/elf.h} | 0
.../arch/x86/include/arch/endianness.h | 9 ++
.../{arch_special.h => arch/special.h} | 0
tools/objtool/arch/x86/special.c | 4 +-
tools/objtool/builtin-check.c | 4 +-
tools/objtool/builtin-orc.c | 4 +-
tools/objtool/check.c | 19 ++--
tools/objtool/elf.c | 40 +++----
tools/objtool/{ => include/objtool}/arch.h | 4 +-
tools/objtool/{ => include/objtool}/builtin.h | 0
tools/objtool/{ => include/objtool}/cfi.h | 2 +-
tools/objtool/{ => include/objtool}/check.h | 4 +-
tools/objtool/{ => include/objtool}/elf.h | 0
tools/objtool/include/objtool/endianness.h | 38 +++++++
tools/objtool/{ => include/objtool}/objtool.h | 2 +-
tools/objtool/{ => include/objtool}/special.h | 4 +-
tools/objtool/{ => include/objtool}/warn.h | 2 +-
tools/objtool/objtool.c | 6 +-
tools/objtool/orc_dump.c | 9 +-
tools/objtool/orc_gen.c | 7 +-
tools/objtool/special.c | 14 +--
tools/objtool/weak.c | 2 +-
34 files changed, 306 insertions(+), 179 deletions(-)
rename tools/objtool/arch/x86/include/{ => arch}/cfi_regs.h (100%)
rename tools/objtool/arch/x86/include/{arch_elf.h => arch/elf.h} (100%)
create mode 100644 tools/objtool/arch/x86/include/arch/endianness.h
rename tools/objtool/arch/x86/include/{arch_special.h => arch/special.h} (100%)
rename tools/objtool/{ => include/objtool}/arch.h (96%)
rename tools/objtool/{ => include/objtool}/builtin.h (100%)
rename tools/objtool/{ => include/objtool}/cfi.h (96%)
rename tools/objtool/{ => include/objtool}/check.h (96%)
rename tools/objtool/{ => include/objtool}/elf.h (100%)
create mode 100644 tools/objtool/include/objtool/endianness.h
rename tools/objtool/{ => include/objtool}/objtool.h (96%)
rename tools/objtool/{ => include/objtool}/special.h (94%)
rename tools/objtool/{ => include/objtool}/warn.h (98%)Signature · 1 line
2.25.4
PATCH v5 1/5 x86/tools: Use tools headers for instruction decoder selftests
Currently x86 instruction decoder is used from:
- the kernel itself,
- from tools like objtool and perf,
- within x86 tools, i.e. instruction decoder selftests.
The first two cases are similar, because tools headers try to mimic kernel headers.
Instruction decoder selftests include some of the kernel headers directly, including uapi headers. This works until headers dependencies are kept to minimum and tools are not cross-compiled. Since the goal of the x86 instruction decoder selftests is not to verify uapi headers move it to using tools headers, like this is already done for vdso2c tool, mkpiggy and other tools in arch/x86/boot/.
--- arch/x86/tools/Makefile | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)
arch/x86/tools/Makefile +4 -4
@@ -29,14 +29,14 @@ posttest: $(obj)/insn_decoder_test vmlinux $(obj)/insn_sanity hostprogs += insn_decoder_test insn_sanity # -I needed for generated C source and C source which in the kernel tree. -HOSTCFLAGS_insn_decoder_test.o := -Wall -I$(objtree)/arch/x86/lib/ -I$(srctree)/arch/x86/include/uapi/ -I$(srctree)/arch/x86/include/ -I$(srctree)/arch/x86/lib/ -I$(srctree)/include/uapi/ +HOSTCFLAGS_insn_decoder_test.o := -Wall -I$(srctree)/tools/arch/x86/lib/ -I$(srctree)/tools/arch/x86/include/ -I$(objtree)/arch/x86/lib/ -HOSTCFLAGS_insn_sanity.o := -Wall -I$(objtree)/arch/x86/lib/ -I$(srctree)/arch/x86/include/ -I$(srctree)/arch/x86/lib/ -I$(srctree)/include/ +HOSTCFLAGS_insn_sanity.o := -Wall -I$(srctree)/tools/arch/x86/lib/ -I$(srctree)/tools/arch/x86/include/ -I$(objtree)/arch/x86/lib/ # Dependencies are also needed. -$(obj)/insn_decoder_test.o: $(srctree)/arch/x86/lib/insn.c $(srctree)/arch/x86/lib/inat.c $(srctree)/arch/x86/include/asm/inat_types.h $(srctree)/arch/x86/include/asm/inat.h $(srctree)/arch/x86/include/asm/insn.h $(objtree)/arch/x86/lib/inat-tables.c +$(obj)/insn_decoder_test.o: $(srctree)/tools/arch/x86/lib/insn.c $(srctree)/tools/arch/x86/lib/inat.c $(srctree)/tools/arch/x86/include/asm/inat_types.h $(srctree)/tools/arch/x86/include/asm/inat.h $(srctree)/tools/arch/x86/include/asm/insn.h $(objtree)/arch/x86/lib/inat-tables.c -$(obj)/insn_sanity.o: $(srctree)/arch/x86/lib/insn.c $(srctree)/arch/x86/lib/inat.c $(srctree)/arch/x86/include/asm/inat_types.h $(srctree)/arch/x86/include/asm/inat.h $(srctree)/arch/x86/include/asm/insn.h $(objtree)/arch/x86/lib/inat-tables.c +$(obj)/insn_sanity.o: $(srctree)/tools/arch/x86/lib/insn.c $(srctree)/tools/arch/x86/lib/inat.c $(srctree)/tools/arch/x86/include/asm/inat_types.h $(srctree)/tools/arch/x86/include/asm/inat.h $(srctree)/tools/arch/x86/include/asm/insn.h $(objtree)/arch/x86/lib/inat-tables.c HOST_EXTRACFLAGS += -I$(srctree)/tools/include hostprogs += relocs
Signature · 1 line
2.25.4
PATCH v5 2/5 x86/insn: Support big endian cross-compiles
In reply to Vasily GorbikFrom: Martin Schwidefsky <[email protected]>
x86 instruction decoder code is shared across the kernel source and the tools. Currently objtool seems to be the only tool from build tools needed which breaks x86 cross compilation on big endian systems. Make the x86 instruction decoder build host endianness agnostic to support x86 cross compilation and enable objtool to implement endianness awareness for big endian architectures support.
--- arch/x86/include/asm/insn.h | 33 ++++++++++ arch/x86/lib/insn.c | 101 ++++++++++++++---------------- arch/x86/tools/insn_sanity.c | 4 -- tools/arch/x86/include/asm/insn.h | 33 ++++++++++ tools/arch/x86/lib/insn.c | 101 ++++++++++++++---------------- 5 files changed, 160 insertions(+), 112 deletions(-)
arch/x86/include/asm/insn.h +33 -0
@@ -7,9 +7,12 @@* Copyright (C) IBM Corporation, 2009 */ +#include <asm/byteorder.h> /* insn_attr_t is defined in inat.h */ #include <asm/inat.h> +#if defined(__BYTE_ORDER) ? __BYTE_ORDER == __LITTLE_ENDIAN : defined(__LITTLE_ENDIAN) + struct insn_field { union { insn_value_t value;
@@ -20,6 +23,36 @@ struct insn_field {unsigned char nbytes; }; +static inline void insn_field_set (struct insn_field *p,insn_value_t v, +unsigned char n) +{ + p->value = v; + p->nbytes = n; +} + +#else + +struct insn_field { +insn_value_t value; +union { +insn_value_t little; +insn_byte_t bytes[4 ]; + }; +/* !0 if we've run insn_get_xxx() for this field */ +unsigned char got; +unsigned char nbytes; +}; + +static inline void insn_field_set (struct insn_field *p,insn_value_t v, +unsigned char n) +{ + p->value = v; + p->little =__cpu_to_le32 (v); + p->nbytes = n; +} + +#endif +struct insn {struct insn_field prefixes;/* * Prefixes
arch/x86/lib/insn.c +47 -54
220 lines not on this page · raw message
arch/x86/tools/insn_sanity.c +0 -4
@@ -14,10 +14,6 @@#include <sys/types.h> #include <sys/stat.h> #include <fcntl.h> - -#define unlikely (cond) (cond) -#define ARRAY_SIZE (a) (sizeof(a)/sizeof(a[0])) -#include <asm/insn.h> #include <inat.c> #include <insn.c>
tools/arch/x86/include/asm/insn.h +33 -0
@@ -7,9 +7,12 @@* Copyright (C) IBM Corporation, 2009 */ +#include <asm/byteorder.h> /* insn_attr_t is defined in inat.h */ #include "inat.h" +#if defined(__BYTE_ORDER) ? __BYTE_ORDER == __LITTLE_ENDIAN : defined(__LITTLE_ENDIAN) + struct insn_field { union { insn_value_t value;
@@ -20,6 +23,36 @@ struct insn_field {unsigned char nbytes; }; +static inline void insn_field_set (struct insn_field *p,insn_value_t v, +unsigned char n) +{ + p->value = v; + p->nbytes = n; +} + +#else + +struct insn_field { +insn_value_t value; +union { +insn_value_t little; +insn_byte_t bytes[4 ]; + }; +/* !0 if we've run insn_get_xxx() for this field */ +unsigned char got; +unsigned char nbytes; +}; + +static inline void insn_field_set (struct insn_field *p,insn_value_t v, +unsigned char n) +{ + p->value = v; + p->little =__cpu_to_le32 (v); + p->nbytes = n; +} + +#endif +struct insn {struct insn_field prefixes;/* * Prefixes
tools/arch/x86/lib/insn.c +47 -54
220 lines not on this page · raw message
Signature · 1 line
2.25.4
PATCH v5 3/5 objtool: Fix reloc generation on big endian cross compiles
In reply to Vasily GorbikFrom: Martin Schwidefsky <[email protected]>
Currently relocations generated in elf_rebuild_rel_reloc_section/ elf_rebuild_rela_reloc_section functions are broken if the objtool is built and run on big endian system. E.g. the following errors pop up during x86 cross compilation:
x86_64-9.1.0-ld: fs/efivarfs/inode.o: bad reloc symbol index (0x2000000 >=
0x22) for offset 0 in section `.orc_unwind_ip'
x86_64-9.1.0-ld: final link failed: bad value
To address that convert those functions to do things similar to elf_write_reloc(), reuse gelf_update_rel/gelf_update_rela libelf library functions.
--- tools/objtool/elf.c | 34 +++++++++++++++++++--------------- 1 file changed, 19 insertions(+), 15 deletions(-)
tools/objtool/elf.c +19 -15
@@ -829,25 +829,27 @@ static int elf_rebuild_rel_reloc_section(struct section *sec, int nr) {struct reloc *reloc;int idx =0 , size; -GElf_Rel *relocs; +void *buf;/* Allocate a buffer for relocations */ - size = nr *sizeof (*relocs); - relocs =malloc (size); -if (!relocs) { + size = nr *sizeof (GElf_Rel); + buf =malloc (size); +if (!buf) {perror ("malloc" );return -1 ; } - sec->data->d_buf = relocs; + sec->data->d_buf = buf; sec->data->d_size = size; + sec->data->d_type =ELF_T_REL ; sec->sh.sh_size = size; idx =0 ;list_for_each_entry (reloc, &sec->reloc_list, list) { - relocs[idx].r_offset = reloc->offset; - relocs[idx].r_info =GELF_R_INFO (reloc->sym->idx, reloc->type); + reloc->rel.r_offset = reloc->offset; + reloc->rel.r_info =GELF_R_INFO (reloc->sym->idx, reloc->type); +gelf_update_rel (sec->data, idx, &reloc->rel); idx++; }
@@ -858,26 +860,28 @@ static int elf_rebuild_rela_reloc_section(struct section *sec, int nr) {struct reloc *reloc;int idx =0 , size; -GElf_Rela *relocs; +void *buf;/* Allocate a buffer for relocations with addends */ - size = nr *sizeof (*relocs); - relocs =malloc (size); -if (!relocs) { + size = nr *sizeof (GElf_Rela); + buf =malloc (size); +if (!buf) {perror ("malloc" );return -1 ; } - sec->data->d_buf = relocs; + sec->data->d_buf = buf; sec->data->d_size = size; + sec->data->d_type =ELF_T_RELA ; sec->sh.sh_size = size; idx =0 ;list_for_each_entry (reloc, &sec->reloc_list, list) { - relocs[idx].r_offset = reloc->offset; - relocs[idx].r_addend = reloc->addend; - relocs[idx].r_info =GELF_R_INFO (reloc->sym->idx, reloc->type); + reloc->rela.r_offset = reloc->offset; + reloc->rela.r_addend = reloc->addend; + reloc->rela.r_info =GELF_R_INFO (reloc->sym->idx, reloc->type); +gelf_update_rela (sec->data, idx, &reloc->rela); idx++; }
Signature · 1 line
2.25.4
PATCH v5 4/5 objtool: Fix x86 orc generation on big endian cross compiles
In reply to Vasily GorbikCorrect objtool orc generation endianness problems to enable fully functional x86 cross compiles on big endian hardware.
Introduces bswap_if_needed macro which does a byte swap if target endianness doesn't match the host, i.e. cross compilation for little endian on big endian and vice versa. To be used for multi-byte values conversion, which are read from / about to be written to a target native endianness ELF file.
--- arch/x86/include/asm/orc_types.h | 10 +++++ tools/arch/x86/include/asm/orc_types.h | 10 +++++ .../arch/x86/include/arch_endianness.h | 9 +++++ tools/objtool/check.c | 5 ++- tools/objtool/endianness.h | 38 +++++++++++++++++++ tools/objtool/orc_dump.c | 5 ++- tools/objtool/orc_gen.c | 3 ++ tools/objtool/special.c | 6 ++- 8 files changed, 80 insertions(+), 6 deletions(-) create mode 100644 tools/objtool/arch/x86/include/arch_endianness.h create mode 100644 tools/objtool/endianness.h
arch/x86/include/asm/orc_types.h +10 -0
@@ -40,6 +40,8 @@#define ORC_REG_MAX 15#ifndef __ASSEMBLY__ +#include <asm/byteorder.h> +/* * This struct is more or less a vastly simplified version of the DWARF Call * Frame Information standard. It contains only the necessary parts of DWARF
@@ -51,10 +53,18 @@struct orc_entry {s16 sp_offset;s16 bp_offset; +#if defined(__LITTLE_ENDIAN_BITFIELD)unsigned sp_reg:4 ;unsigned bp_reg:4 ;unsigned type:2 ;unsigned end:1 ; +#elif defined(__BIG_ENDIAN_BITFIELD) +unsigned bp_reg:4 ; +unsigned sp_reg:4 ; +unsigned unused:5 ; +unsigned end:1 ; +unsigned type:2 ; +#endif } __packed;#endif /* __ASSEMBLY__ */
tools/arch/x86/include/asm/orc_types.h +10 -0
@@ -40,6 +40,8 @@#define ORC_REG_MAX 15#ifndef __ASSEMBLY__ +#include <asm/byteorder.h> +/* * This struct is more or less a vastly simplified version of the DWARF Call * Frame Information standard. It contains only the necessary parts of DWARF
@@ -51,10 +53,18 @@struct orc_entry {s16 sp_offset;s16 bp_offset; +#if defined(__LITTLE_ENDIAN_BITFIELD)unsigned sp_reg:4 ;unsigned bp_reg:4 ;unsigned type:2 ;unsigned end:1 ; +#elif defined(__BIG_ENDIAN_BITFIELD) +unsigned bp_reg:4 ; +unsigned sp_reg:4 ; +unsigned unused:5 ; +unsigned end:1 ; +unsigned type:2 ; +#endif } __packed;#endif /* __ASSEMBLY__ */
tools/objtool/arch/x86/include/arch_endianness.h new file +9 -0
@@ -0,0 +1,9 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +#ifndef _ARCH_ENDIANNESS_H +#define _ARCH_ENDIANNESS_H + +#include <endian.h> + +#define __TARGET_BYTE_ORDER __LITTLE_ENDIAN + +#endif /* _ARCH_ENDIANNESS_H */
tools/objtool/check.c +3 -2
@@ -13,6 +13,7 @@#include "special.h" #include "warn.h" #include "arch_elf.h" +#include "endianness.h" #include <linux/objtool.h> #include <linux/hashtable.h>
@@ -1372,7 +1373,7 @@ static int read_unwind_hints(struct objtool_file *file) cfa = &insn->cfi.cfa;if (hint->type ==UNWIND_HINT_TYPE_RET_OFFSET ) { - insn->ret_offset = hint->sp_offset; + insn->ret_offset =bswap_if_needed (hint->sp_offset);continue ; }
@@ -1384,7 +1385,7 @@ static int read_unwind_hints(struct objtool_file *file)return -1 ; } - cfa->offset = hint->sp_offset; + cfa->offset =bswap_if_needed (hint->sp_offset); insn->cfi.type = hint->type; insn->cfi.end = hint->end; }
tools/objtool/endianness.h new file +38 -0
@@ -0,0 +1,38 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +#ifndef _OBJTOOL_ENDIANNESS_H +#define _OBJTOOL_ENDIANNESS_H + +#include <linux/kernel.h> +#include <endian.h> +#include "arch_endianness.h" + +#ifndef __TARGET_BYTE_ORDER +#error undefined arch __TARGET_BYTE_ORDER +#endif + +#if __BYTE_ORDER != __TARGET_BYTE_ORDER +#define __NEED_BSWAP 1 +#else +#define __NEED_BSWAP 0 +#endif + +/* +* Does a byte swap if target endianness doesn't match the host, i.e. cross +* compilation for little endian on big endian and vice versa. +* To be used for multi-byte values conversion, which are read from / about +* to be written to a target native endianness ELF file. +*/ +#define bswap_if_needed (val) \ +({ \ + __typeof__(val) __ret; \ + switch (sizeof(val)) { \ + case 8: __ret = __NEED_BSWAP ? bswap_64(val) : (val); break; \ + case 4: __ret = __NEED_BSWAP ? bswap_32(val) : (val); break; \ + case 2: __ret = __NEED_BSWAP ? bswap_16(val) : (val); break; \ + default: \ + BUILD_BUG(); break; \ + } \ + __ret; \ +}) + +#endif /* _OBJTOOL_ENDIANNESS_H */
tools/objtool/orc_dump.c +3 -2
@@ -8,6 +8,7 @@#include <asm/orc_types.h> #include "objtool.h" #include "warn.h" +#include "endianness.h" static const char *reg_name (unsigned int reg) {
@@ -197,11 +198,11 @@ int orc_dump(const char *_objname)printf (" sp:" ); -print_reg (orc[i].sp_reg, orc[i].sp_offset); +print_reg (orc[i].sp_reg,bswap_if_needed (orc[i].sp_offset));printf (" bp:" ); -print_reg (orc[i].bp_reg, orc[i].bp_offset); +print_reg (orc[i].bp_reg,bswap_if_needed (orc[i].bp_offset));printf (" type:%s end:%d\n" ,orc_type_name (orc[i].type), orc[i].end);
tools/objtool/orc_gen.c +3 -0
@@ -11,6 +11,7 @@#include "check.h" #include "warn.h" +#include "endianness.h" int create_orc (struct objtool_file *file) {
@@ -96,6 +97,8 @@ static int create_orc_entry(struct elf *elf, struct section *u_sec, struct secti/* populate ORC data */ orc = (struct orc_entry *)u_sec->data->d_buf + idx;memcpy (orc, o,sizeof (*orc)); + orc->sp_offset =bswap_if_needed (orc->sp_offset); + orc->bp_offset =bswap_if_needed (orc->bp_offset);/* populate reloc for ip */ reloc =malloc (sizeof (*reloc));
tools/objtool/special.c +4 -2
@@ -15,6 +15,7 @@#include "special.h" #include "warn.h" #include "arch_special.h" +#include "endianness.h" struct special_entry {const char *sec;
@@ -77,8 +78,9 @@ static int get_alt_entry(struct elf *elf, struct special_entry *entry,if (entry->feature) {unsigned short feature; - feature = *(unsigned short *)(sec->data->d_buf + offset + - entry->feature); + feature =bswap_if_needed (*(unsigned short *)(sec->data->d_buf + + offset + + entry->feature));arch_handle_alternative (feature, alt); }
Signature · 1 line
2.25.4
PATCH v5 5/5 objtool: Rework header include paths
In reply to Vasily GorbikCurrently objtool headers are being included either by their base name or included via ../ from a parent directory. In case of a base name usage:
#include "warn.h"
#include "arch_elf.h"
it does not make it apparent from which directory the file comes from. To make it slightly better, and actually to avoid name clashes some arch specific files have "arch_" suffix. And files from an arch folder have to revert to including via ../ e.g:
#include "../../elf.h"
With additional architectures support and the code base growth there is a need for clearer headers naming scheme for multiple reasons:
1. to make it instantly obvious where these files come from (objtool itself / objtool arch|generic folders / some other external files),
2. to avoid name clashes of objtool arch specific headers, potential obtool arch generic headers and the system header files (there is /usr/include/elf.h already),
3. to avoid ../ includes and improve code readability.
4. to give a warm fuzzy feeling to developers who are mostly kernel developers and are accustomed to linux kernel headers arranging scheme.
Doesn't this make it instantly obvious where are these files come from?
#include <objtool/warn.h>
#include <arch/elf.h>
And doesn't it look nicer to avoid ugly ../ includes? Which also guarantees this is elf.h from the objtool and not /usr/include/elf.h.
#include <objtool/elf.h>
This patch defines and implements new objtool headers arranging scheme. Which is:
- all generic headers go to include/objtool (similar to include/linux)
- all arch headers go to arch/$(SRCARCH)/include/arch (to get arch prefix). This is similar to linux arch specific "asm/*" headers but we are not abusing "asm" name and calling it what it is. This also helps to prevent name clashes (arch is not used in system headers or kernel exports).
To bring objtool to this state the following things are done:
1. current top level tools/objtool/ headers are moved into include/objtool/ subdirectory,
2. arch specific headers, currently only arch/x86/include/ are moved into arch/x86/include/arch/ and were stripped of "arch_" suffix,
3. new -I$(srctree)/tools/objtool/include include path to make includes like <objtool/warn.h> possible,
4. rewriting file includes,
5. make git not to ignore include/objtool/ subdirectory.
---
tools/objtool/.gitignore | 2 +-
tools/objtool/Makefile | 1 +
tools/objtool/arch/x86/decode.c | 8 ++++----
.../arch/x86/include/{ => arch}/cfi_regs.h | 0
.../arch/x86/include/{arch_elf.h => arch/elf.h} | 0
.../{arch_endianness.h => arch/endianness.h} | 0
.../include/{arch_special.h => arch/special.h} | 0
tools/objtool/arch/x86/special.c | 4 ++--
tools/objtool/builtin-check.c | 4 ++--
tools/objtool/builtin-orc.c | 4 ++--
tools/objtool/check.c | 16 ++++++++--------
tools/objtool/elf.c | 6 +++---
tools/objtool/{ => include/objtool}/arch.h | 4 ++--
tools/objtool/{ => include/objtool}/builtin.h | 0
tools/objtool/{ => include/objtool}/cfi.h | 2 +-
tools/objtool/{ => include/objtool}/check.h | 4 ++--
tools/objtool/{ => include/objtool}/elf.h | 0
tools/objtool/{ => include/objtool}/endianness.h | 2 +-
tools/objtool/{ => include/objtool}/objtool.h | 2 +-
tools/objtool/{ => include/objtool}/special.h | 4 ++--
tools/objtool/{ => include/objtool}/warn.h | 2 +-
tools/objtool/objtool.c | 6 +++---
tools/objtool/orc_dump.c | 6 +++---
tools/objtool/orc_gen.c | 6 +++---
tools/objtool/special.c | 10 +++++-----
tools/objtool/weak.c | 2 +-
26 files changed, 48 insertions(+), 47 deletions(-)
rename tools/objtool/arch/x86/include/{ => arch}/cfi_regs.h (100%)
rename tools/objtool/arch/x86/include/{arch_elf.h => arch/elf.h} (100%)
rename tools/objtool/arch/x86/include/{arch_endianness.h => arch/endianness.h} (100%)
rename tools/objtool/arch/x86/include/{arch_special.h => arch/special.h} (100%)
rename tools/objtool/{ => include/objtool}/arch.h (96%)
rename tools/objtool/{ => include/objtool}/builtin.h (100%)
rename tools/objtool/{ => include/objtool}/cfi.h (96%)
rename tools/objtool/{ => include/objtool}/check.h (96%)
rename tools/objtool/{ => include/objtool}/elf.h (100%)
rename tools/objtool/{ => include/objtool}/endianness.h (97%)
rename tools/objtool/{ => include/objtool}/objtool.h (96%)
rename tools/objtool/{ => include/objtool}/special.h (94%)
rename tools/objtool/{ => include/objtool}/warn.h (98%)tools/objtool/.gitignore +1 -1
@@ -1,4 +1,4 @@ # SPDX-License-Identifier: GPL-2.0-only arch/x86/lib/inat-tables.c -objtool +/objtool fixdep
tools/objtool/Makefile +1 -0
@@ -36,6 +36,7 @@ all: $(OBJTOOL) INCLUDES := -I$(srctree)/tools/include \ -I$(srctree)/tools/arch/$(HOSTARCH)/include/uapi \ -I$(srctree)/tools/arch/$(SRCARCH)/include \ + -I$(srctree)/tools/objtool/include \ -I$(srctree)/tools/objtool/arch/$(SRCARCH)/include WARNINGS := $(EXTRA_WARNINGS) -Wno-switch-default -Wno-switch-enum -Wno-packed -Wno-nested-externs CFLAGS := -Werror $(WARNINGS) $(KBUILD_HOSTCFLAGS) -g $(INCLUDES) $(LIBELF_FLAGS)
tools/objtool/arch/x86/decode.c +4 -4
@@ -11,11 +11,11 @@#include "../../../arch/x86/lib/inat.c" #include "../../../arch/x86/lib/insn.c" -#include "../../check.h" -#include "../../elf.h" -#include "../../arch.h" -#include "../../warn.h" #include <asm/orc_types.h> +#include <objtool/check.h> +#include <objtool/elf.h> +#include <objtool/arch.h> +#include <objtool/warn.h> static unsigned char op_to_cfi_reg[][2 ] = { {CFI_AX ,CFI_R8 },
tools/objtool/arch/x86/include/arch/cfi_regs.h renamed from tools/objtool/arch/x86/include/cfi_regs.h +0 -0
tools/objtool/arch/x86/include/arch/elf.h renamed from tools/objtool/arch/x86/include/arch_elf.h +0 -0
tools/objtool/arch/x86/include/arch/endianness.h renamed from tools/objtool/arch/x86/include/arch_endianness.h +0 -0
tools/objtool/arch/x86/include/arch/special.h renamed from tools/objtool/arch/x86/include/arch_special.h +0 -0
tools/objtool/arch/x86/special.c +2 -2
@@ -1,8 +1,8 @@// SPDX-License-Identifier: GPL-2.0-or-later #include <string.h> -#include "../../special.h" -#include "../../builtin.h" +#include <objtool/special.h> +#include <objtool/builtin.h> #define X86_FEATURE_POPCNT (4 * 32 + 23)#define X86_FEATURE_SMAP (9 * 32 + 20)
tools/objtool/builtin-check.c +2 -2
@@ -15,8 +15,8 @@#include <subcmd/parse-options.h> #include <string.h> -#include "builtin.h" -#include "objtool.h" +#include <objtool/builtin.h> +#include <objtool/objtool.h> bool no_fp, no_unreachable, retpoline, module, backtrace, uaccess, stats, validate_dup, vmlinux;
tools/objtool/builtin-orc.c +2 -2
@@ -13,8 +13,8 @@*/ #include <string.h> -#include "builtin.h" -#include "objtool.h" +#include <objtool/builtin.h> +#include <objtool/objtool.h> static const char *orc_usage[] = {"objtool orc generate [<options>] file.o" ,
tools/objtool/check.c +8 -8
@@ -6,14 +6,14 @@#include <string.h> #include <stdlib.h> -#include "builtin.h" -#include "cfi.h" -#include "arch.h" -#include "check.h" -#include "special.h" -#include "warn.h" -#include "arch_elf.h" -#include "endianness.h" +#include <arch/elf.h> +#include <objtool/builtin.h> +#include <objtool/cfi.h> +#include <objtool/arch.h> +#include <objtool/check.h> +#include <objtool/special.h> +#include <objtool/warn.h> +#include <objtool/endianness.h> #include <linux/objtool.h> #include <linux/hashtable.h>
tools/objtool/elf.c +3 -3
@@ -15,10 +15,10 @@#include <string.h> #include <unistd.h> #include <errno.h> -#include "builtin.h" +#include <objtool/builtin.h> -#include "elf.h" -#include "warn.h" +#include <objtool/elf.h> +#include <objtool/warn.h> #define MAX_NAME_LEN 128
tools/objtool/include/objtool/arch.h renamed from tools/objtool/arch.h +2 -2
@@ -8,8 +8,8 @@#include <stdbool.h> #include <linux/list.h> -#include "objtool.h" -#include "cfi.h" +#include <objtool/objtool.h> +#include <objtool/cfi.h> #ifdef INSN_USE_ORC #include <asm/orc_types.h>
tools/objtool/include/objtool/builtin.h renamed from tools/objtool/builtin.h +0 -0
tools/objtool/include/objtool/cfi.h renamed from tools/objtool/cfi.h +1 -1
@@ -6,7 +6,7 @@#ifndef _OBJTOOL_CFI_H#define _OBJTOOL_CFI_H -#include "cfi_regs.h" +#include <arch/cfi_regs.h> #define CFI_UNDEFINED -1#define CFI_CFA -2
tools/objtool/include/objtool/check.h renamed from tools/objtool/check.h +2 -2
@@ -7,8 +7,8 @@#define _CHECK_H#include <stdbool.h> -#include "cfi.h" -#include "arch.h" +#include <objtool/cfi.h> +#include <objtool/arch.h> struct insn_state {struct cfi_state cfi;
tools/objtool/include/objtool/elf.h renamed from tools/objtool/elf.h +0 -0
tools/objtool/include/objtool/endianness.h renamed from tools/objtool/endianness.h +1 -1
@@ -2,9 +2,9 @@#ifndef _OBJTOOL_ENDIANNESS_H#define _OBJTOOL_ENDIANNESS_H +#include <arch/endianness.h> #include <linux/kernel.h> #include <endian.h> -#include "arch_endianness.h" #ifndef __TARGET_BYTE_ORDER#error undefined arch __TARGET_BYTE_ORDER
tools/objtool/include/objtool/objtool.h renamed from tools/objtool/objtool.h +1 -1
@@ -10,7 +10,7 @@#include <linux/list.h> #include <linux/hashtable.h> -#include "elf.h" +#include <objtool/elf.h> #define __weak __attribute__((weak))
tools/objtool/include/objtool/special.h renamed from tools/objtool/special.h +2 -2
@@ -7,8 +7,8 @@#define _SPECIAL_H#include <stdbool.h> -#include "check.h" -#include "elf.h" +#include <objtool/check.h> +#include <objtool/elf.h> #define C_JUMP_TABLE_SECTION ".rodata..c_jump_table"
tools/objtool/include/objtool/warn.h renamed from tools/objtool/warn.h +1 -1
@@ -11,7 +11,7 @@#include <sys/types.h> #include <sys/stat.h> #include <fcntl.h> -#include "elf.h" +#include <objtool/elf.h> extern const char *objname;
tools/objtool/objtool.c +3 -3
@@ -21,9 +21,9 @@#include <subcmd/pager.h> #include <linux/kernel.h> -#include "builtin.h" -#include "objtool.h" -#include "warn.h" +#include <objtool/builtin.h> +#include <objtool/objtool.h> +#include <objtool/warn.h> struct cmd_struct {const char *name;
tools/objtool/orc_dump.c +3 -3
@@ -6,9 +6,9 @@#include <unistd.h> #include <linux/objtool.h> #include <asm/orc_types.h> -#include "objtool.h" -#include "warn.h" -#include "endianness.h" +#include <objtool/objtool.h> +#include <objtool/warn.h> +#include <objtool/endianness.h> static const char *reg_name (unsigned int reg) {
tools/objtool/orc_gen.c +3 -3
@@ -9,9 +9,9 @@#include <linux/objtool.h> #include <asm/orc_types.h> -#include "check.h" -#include "warn.h" -#include "endianness.h" +#include <objtool/check.h> +#include <objtool/warn.h> +#include <objtool/endianness.h> int create_orc (struct objtool_file *file) {
tools/objtool/special.c +5 -5
@@ -11,11 +11,11 @@#include <stdlib.h> #include <string.h> -#include "builtin.h" -#include "special.h" -#include "warn.h" -#include "arch_special.h" -#include "endianness.h" +#include <arch/special.h> +#include <objtool/builtin.h> +#include <objtool/special.h> +#include <objtool/warn.h> +#include <objtool/endianness.h> struct special_entry {const char *sec;
tools/objtool/weak.c +1 -1
@@ -7,7 +7,7 @@#include <stdbool.h> #include <errno.h> -#include "objtool.h" +#include <objtool/objtool.h> #define UNSUPPORTED (name) \ ({ \
Signature · 1 line
2.25.4
Re: [PATCH v5 5/5] objtool: Rework header include paths
Quoted 53 lines · Vasily Gorbik
Currently objtool headers are being included either by their base name or included via ../ from a parent directory. In case of a base name usage:
#include "
warn.h"
#include "arch_elf.h"it does not make it apparent from which directory the file comes from. To make it slightly better, and actually to avoid name clashes some arch specific files have "
arch_" suffix. And files from an arch folder have to revert to including via ../ e.g:
#include "../../elf.h"With additional architectures support and the code base growth there is a need for clearer headers naming scheme for multiple reasons:
1. to make it instantly obvious where these files come from (objtool itself / objtool arch|generic folders / some other external files),
2. to avoid name clashes of objtool arch specific headers, potential obtool arch generic headers and the system header files (there is/usr/include/elf.halready),
3. to avoid ../ includes and improve code readability.
4. to give a warm fuzzy feeling to developers who are mostly kernel developers and are accustomed to linux kernel headers arranging scheme.Doesn't this make it instantly obvious where are these files come from?
#include <
objtool/warn.h>
#include <arch/elf.h>And doesn't it look nicer to avoid ugly ../ includes? Which also guarantees this is
elf.hfrom the objtool and not/usr/include/elf.h.#include <
objtool/elf.h>This patch defines and implements new objtool headers arranging scheme. Which is:
- all generic headers go toinclude/objtool(similar toinclude/linux)
- all arch headers go to arch/$(SRCARCH)/include/arch (to get arch prefix). This is similar to linux arch specific "asm/*" headers but we are not abusing "asm" name and calling it what it is. This also helps to prevent name clashes (arch is not used in system headers or kernel exports).To bring objtool to this state the following things are done:
1. current top leveltools/objtool/headers are moved intoinclude/objtool/subdirectory,
2. arch specific headers, currently onlyarch/x86/include/are moved intoarch/x86/include/arch/and were stripped of "arch_" suffix,
3. new -I$(srctree)/tools/objtool/include include path to make includes like <objtool/warn.h> possible,
4. rewriting file includes,
5. make git not to ignoreinclude/objtool/subdirectory.
Quoted 1 line
Signed-off-by Vasily Gorbik <[email protected]>
Nice!
For the whole series:
PATCH 1/1 x86/insn: Fix vector instructions decoding on big endian
In reply to Vasily GorbikRunning instruction decoder posttest on s390 with allyesconfig shows errors. Instructions used in couple of kernel objects could not be correctly decoded on big endian system.
insn_decoder_test: warning: objdump says 6 bytes, but insn_get_length() says 5insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning: ffffffff831eb4e1: 62 d1 fd 48 7f 04 24 vmovdqa64 %zmm0,(%r12)insn_decoder_test: warning: objdump says 7 bytes, but insn_get_length() says 6insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning: ffffffff831eb4e8: 62 51 fd 48 7f 44 24 01 vmovdqa64 %zmm8,0x40(%r12)insn_decoder_test: warning: objdump says 8 bytes, but insn_get_length() says 6
This is because in few places instruction field bytes are set directly with further usage of "value". To address that introduce and use insn_set_byte() helper, which correctly updates "value" on big endian systems.
---
Please let me know if this patch is good as it is or I should squash it into the patch 2 of my patch series and resend it again.
arch/x86/include/asm/insn.h | 12 ++++++++++++ arch/x86/lib/insn.c | 18 +++++++++--------- tools/arch/x86/include/asm/insn.h | 12 ++++++++++++ tools/arch/x86/lib/insn.c | 18 +++++++++--------- 4 files changed, 42 insertions(+), 18 deletions(-)
arch/x86/include/asm/insn.h +12 -0
@@ -30,6 +30,12 @@ static inline void insn_field_set(struct insn_field *p, insn_value_t v, p->nbytes = n; } +static inline void insn_set_byte (struct insn_field *p,unsigned char n, +insn_byte_t v) +{ + p->bytes[n] = v; +} +#else struct insn_field {
@@ -51,6 +57,12 @@ static inline void insn_field_set(struct insn_field *p, insn_value_t v, p->nbytes = n; } +static inline void insn_set_byte (struct insn_field *p,unsigned char n, +insn_byte_t v) +{ + p->bytes[n] = v; + p->value =__le32_to_cpu (p->little); +}#endif struct insn {
arch/x86/lib/insn.c +9 -9
@@ -161,9 +161,9 @@ void insn_get_prefixes(struct insn *insn) b = insn->prefixes.bytes[3 ];for (i =0 ; i < nb; i++)if (prefixes->bytes[i] == lb) - prefixes->bytes[i] = b; +insn_set_byte (prefixes, i, b); } - insn->prefixes.bytes[3 ] = lb; +insn_set_byte (&insn->prefixes,3 , lb); }/* Decode REX prefix */
@@ -194,13 +194,13 @@ void insn_get_prefixes(struct insn *insn)if (X86_MODRM_MOD (b2) !=3 ) goto vex_end; } - insn->vex_prefix.bytes[0 ] = b; - insn->vex_prefix.bytes[1 ] = b2; +insn_set_byte (&insn->vex_prefix,0 , b); +insn_set_byte (&insn->vex_prefix,1 , b2);if (inat_is_evex_prefix (attr)) { b2 =peek_nbyte_next (insn_byte_t, insn,2 ); - insn->vex_prefix.bytes[2 ] = b2; +insn_set_byte (&insn->vex_prefix,2 , b2); b2 =peek_nbyte_next (insn_byte_t, insn,3 ); - insn->vex_prefix.bytes[3 ] = b2; +insn_set_byte (&insn->vex_prefix,3 , b2); insn->vex_prefix.nbytes =4 ; insn->next_byte +=4 ;if (insn->x86_64 &&X86_VEX_W (b2))
@@ -208,7 +208,7 @@ void insn_get_prefixes(struct insn *insn) insn->opnd_bytes =8 ; }else if (inat_is_vex3_prefix (attr)) { b2 =peek_nbyte_next (insn_byte_t, insn,2 ); - insn->vex_prefix.bytes[2 ] = b2; +insn_set_byte (&insn->vex_prefix,2 , b2); insn->vex_prefix.nbytes =3 ; insn->next_byte +=3 ;if (insn->x86_64 &&X86_VEX_W (b2))
@@ -220,7 +220,7 @@ void insn_get_prefixes(struct insn *insn)* Makes it easier to decode vex.W, vex.vvvv, * vex.L and vex.pp. Masking with 0x7f sets vex.W == 0. */ - insn->vex_prefix.bytes[2 ] = b2 &0x7f ; +insn_set_byte (&insn->vex_prefix,2 , b2 &0x7f ); insn->vex_prefix.nbytes =2 ; insn->next_byte +=2 ; }
@@ -256,7 +256,7 @@ void insn_get_opcode(struct insn *insn)/* Get first opcode */ op =get_next (insn_byte_t, insn); - opcode->bytes[0 ] = op; +insn_set_byte (opcode,0 , op); opcode->nbytes =1 ;/* Check if there is VEX prefix or not */
tools/arch/x86/include/asm/insn.h +12 -0
@@ -30,6 +30,12 @@ static inline void insn_field_set(struct insn_field *p, insn_value_t v, p->nbytes = n; } +static inline void insn_set_byte (struct insn_field *p,unsigned char n, +insn_byte_t v) +{ + p->bytes[n] = v; +} +#else struct insn_field {
@@ -51,6 +57,12 @@ static inline void insn_field_set(struct insn_field *p, insn_value_t v, p->nbytes = n; } +static inline void insn_set_byte (struct insn_field *p,unsigned char n, +insn_byte_t v) +{ + p->bytes[n] = v; + p->value =__le32_to_cpu (p->little); +}#endif struct insn {
tools/arch/x86/lib/insn.c +9 -9
@@ -161,9 +161,9 @@ void insn_get_prefixes(struct insn *insn) b = insn->prefixes.bytes[3 ];for (i =0 ; i < nb; i++)if (prefixes->bytes[i] == lb) - prefixes->bytes[i] = b; +insn_set_byte (prefixes, i, b); } - insn->prefixes.bytes[3 ] = lb; +insn_set_byte (&insn->prefixes,3 , lb); }/* Decode REX prefix */
@@ -194,13 +194,13 @@ void insn_get_prefixes(struct insn *insn)if (X86_MODRM_MOD (b2) !=3 ) goto vex_end; } - insn->vex_prefix.bytes[0 ] = b; - insn->vex_prefix.bytes[1 ] = b2; +insn_set_byte (&insn->vex_prefix,0 , b); +insn_set_byte (&insn->vex_prefix,1 , b2);if (inat_is_evex_prefix (attr)) { b2 =peek_nbyte_next (insn_byte_t, insn,2 ); - insn->vex_prefix.bytes[2 ] = b2; +insn_set_byte (&insn->vex_prefix,2 , b2); b2 =peek_nbyte_next (insn_byte_t, insn,3 ); - insn->vex_prefix.bytes[3 ] = b2; +insn_set_byte (&insn->vex_prefix,3 , b2); insn->vex_prefix.nbytes =4 ; insn->next_byte +=4 ;if (insn->x86_64 &&X86_VEX_W (b2))
@@ -208,7 +208,7 @@ void insn_get_prefixes(struct insn *insn) insn->opnd_bytes =8 ; }else if (inat_is_vex3_prefix (attr)) { b2 =peek_nbyte_next (insn_byte_t, insn,2 ); - insn->vex_prefix.bytes[2 ] = b2; +insn_set_byte (&insn->vex_prefix,2 , b2); insn->vex_prefix.nbytes =3 ; insn->next_byte +=3 ;if (insn->x86_64 &&X86_VEX_W (b2))
@@ -220,7 +220,7 @@ void insn_get_prefixes(struct insn *insn)* Makes it easier to decode vex.W, vex.vvvv, * vex.L and vex.pp. Masking with 0x7f sets vex.W == 0. */ - insn->vex_prefix.bytes[2 ] = b2 &0x7f ; +insn_set_byte (&insn->vex_prefix,2 , b2 &0x7f ); insn->vex_prefix.nbytes =2 ; insn->next_byte +=2 ; }
@@ -256,7 +256,7 @@ void insn_get_opcode(struct insn *insn)/* Get first opcode */ op =get_next (insn_byte_t, insn); - opcode->bytes[0 ] = op; +insn_set_byte (opcode,0 , op); opcode->nbytes =1 ;/* Check if there is VEX prefix or not */
Signature · 1 line
2.25.4
Re: [PATCH] x86/insn: Fix vector instructions decoding on big endian
Quoted 17 lines · Vasily Gorbik
Running instruction decoder posttest on s390 with allyesconfig shows errors. Instructions used in couple of kernel objects could not be correctly decoded on big endian system.
insn_decoder_test: warning: objdump says 6 bytes, butinsn_get_length()says 5insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning:ffffffff831eb4e1: 62 d1 fd 48 7f 04 24 vmovdqa64 %zmm0,(%r12)insn_decoder_test: warning: objdump says 7 bytes, butinsn_get_length()says 6insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning:ffffffff831eb4e8: 62 51 fd 48 7f 44 24 01 vmovdqa64 %zmm8,0x40(%r12)insn_decoder_test: warning: objdump says 8 bytes, butinsn_get_length()says 6This is because in few places instruction field bytes are set directly with further usage of "value". To address that introduce and use
insn_set_byte()helper, which correctly updates "value" on big endian systems.
Quoted 4 lines
Signed-off-by Vasily Gorbik <[email protected]>---
Please let me know if this patch is good as it is or I should squash it into the patch 2 of my patch series and resend it again.
It all looks good to me, thanks!
Masami, does this patch look good, and also patches 1-2 of the series? (I think you previously ACKed patch 2).
Signature · 1 line
Josh
Re: [PATCH] x86/insn: Fix vector instructions decoding on big endian
Quoted 23 lines · Josh Poimboeuf
Quoted 17 lines · Vasily Gorbik
Running instruction decoder posttest on s390 with allyesconfig shows errors. Instructions used in couple of kernel objects could not be correctly decoded on big endian system.
insn_decoder_test: warning: objdump says 6 bytes, butinsn_get_length()says 5insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning:ffffffff831eb4e1: 62 d1 fd 48 7f 04 24 vmovdqa64 %zmm0,(%r12)insn_decoder_test: warning: objdump says 7 bytes, butinsn_get_length()says 6insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning:ffffffff831eb4e8: 62 51 fd 48 7f 44 24 01 vmovdqa64 %zmm8,0x40(%r12)insn_decoder_test: warning: objdump says 8 bytes, butinsn_get_length()says 6This is because in few places instruction field bytes are set directly with further usage of "value". To address that introduce and use
insn_set_byte()helper, which correctly updates "value" on big endian systems.Quoted 4 lines
Signed-off-by Vasily Gorbik <[email protected]>---
Please let me know if this patch is good as it is or I should squash it into the patch 2 of my patch series and resend it again.
Quoted 5 lines
It all looks good to me, thanks!
Masami, does this patch look good, and also patches 1-2 of the series? (I think you previously ACKed patch 2).
Friendly ping...
Masami Hiramatsu
Acked-byRe: [PATCH] x86/insn: Fix vector instructions decoding on big endian
Quoted 24 lines · On Tue, 24 Nov 2020 14:33:10 +0100 Vasily Gorbik <[email protected]> wrote:
Quoted 23 lines · Josh Poimboeuf
Quoted 21 lines · Vasily Gorbik
Running instruction decoder posttest on s390 with allyesconfig shows errors. Instructions used in couple of kernel objects could not be correctly decoded on big endian system.
insn_decoder_test: warning: objdump says 6 bytes, butinsn_get_length()says 5insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning:ffffffff831eb4e1: 62 d1 fd 48 7f 04 24 vmovdqa64 %zmm0,(%r12)insn_decoder_test: warning: objdump says 7 bytes, butinsn_get_length()says 6insn_decoder_test: warning: Found an x86 instruction decoder bug, please report this.insn_decoder_test: warning:ffffffff831eb4e8: 62 51 fd 48 7f 44 24 01 vmovdqa64 %zmm8,0x40(%r12)insn_decoder_test: warning: objdump says 8 bytes, butinsn_get_length()says 6This is because in few places instruction field bytes are set directly with further usage of "value". To address that introduce and use
insn_set_byte()helper, which correctly updates "value" on big endian systems.Signed-off-by Vasily Gorbik <[email protected]>---
Please let me know if this patch is good as it is or I should squash it into the patch 2 of my patch series and resend it again.
Quoted 7 lines
Quoted 5 lines
It all looks good to me, thanks!
Masami, does this patch look good, and also patches 1-2 of the series? (I think you previously ACKed patch 2).
Friendly ping...
Sorry for replying late.
Yes, I think this series and the last patch look good to me.
for this series.
Thank you!
Signature · 1 line
Masami Hiramatsu <[email protected]>
PATCH 1/1 scripts/sorttable: Fix ORC unwind table sorting on big endian
In reply to Vasily GorbikCurrently when x86_64 kernel is cross compiled on big endian hardware ORC unwind table is not sorted correctly. Due to missing byte swaps and treating size as 4-byte value ORC sections sizes end up as 0 and the problem is silently ignored.
Make ORC unwind table sorting endianness aware.
---
This goes on top of the patch series:
http://lkml.kernel.org/r/cover.thread-1e2854.your-ad-here.call-01605220128-ext-6070@work.hours
scripts/sorttable.h | 20 +++++++++++--------- 1 file changed, 11 insertions(+), 9 deletions(-)
scripts/sorttable.h +11 -9
@@ -59,6 +59,8 @@# define uint_t uint64_t# define _r r8# define _w w8 +# define _r4 r +# define _w4 w#else # define extable_ent_size 8# define compare_extable compare_extable_32
@@ -80,6 +82,8 @@# define uint_t uint32_t# define _r r# define _w w +# define _r4 r +# define _w4 w#endif #if defined(SORTTABLE_64 ) && defined(UNWINDER_ORC_ENABLED )
@@ -98,7 +102,7 @@ pthread_t orc_sort_thread;static inline unsigned long orc_ip (const int *ip) { -return (unsigned long )ip + *ip; +return (unsigned long )ip + (int )_r4 ((uint32_t *)ip); }static int orc_sort_cmp (const void *_a,const void *_b)
@@ -158,7 +162,7 @@ static void *sort_orctable(void *arg)/* initialize indices array, convert ip_table to absolute address */ for (i =0 ; i < num_entries; i++) { idxs[i] = i; - tmp_orc_ip_table[i] = g_orc_ip_table[i] + i *sizeof (int ); + tmp_orc_ip_table[i] = (int )_r4 ((uint32_t *)&g_orc_ip_table[i]) + i *sizeof (int ); }memcpy (tmp_orc_table, g_orc_table, orc_size);
@@ -169,7 +173,7 @@ static void *sort_orctable(void *arg)continue ;/* convert back to relative address */ - g_orc_ip_table[i] = tmp_orc_ip_table[idxs[i]] - i *sizeof (int ); +_w4 (tmp_orc_ip_table[idxs[i]] - i *sizeof (int ), (uint32_t *)&g_orc_ip_table[i]); g_orc_table[i] = tmp_orc_table[idxs[i]]; }
@@ -256,14 +260,12 @@ static int do_sort(Elf_Ehdr *ehdr,#if defined(SORTTABLE_64 ) && defined(UNWINDER_ORC_ENABLED )/* locate the ORC unwind tables */ if (!strcmp (secstrings + idx,".orc_unwind_ip" )) { - orc_ip_size = s->sh_size; - g_orc_ip_table = (int *)((void *)ehdr + - s->sh_offset); + orc_ip_size =_r (&s->sh_size); + g_orc_ip_table = (int *)((void *)ehdr +_r (&s->sh_offset)); }if (!strcmp (secstrings + idx,".orc_unwind" )) { - orc_size = s->sh_size; - g_orc_table = (struct orc_entry *)((void *)ehdr + - s->sh_offset); + orc_size =_r (&s->sh_size); + g_orc_table = (struct orc_entry *)((void *)ehdr +_r (&s->sh_offset)); }#endif }/* for loop */
Signature · 1 line
2.25.4
Re: [PATCH] scripts/sorttable: Fix ORC unwind table sorting on big endian
Quoted 7 lines · Vasily Gorbik
Currently when
x86_64kernel is cross compiled on big endian hardware ORC unwind table is not sorted correctly. Due to missing byte swaps and treating size as 4-byte value ORC sections sizes end up as 0 and the problem is silently ignored.Make ORC unwind table sorting endianness aware.
Quoted 7 lines
Signed-off-by Vasily Gorbik <[email protected]>---
This goes on top of the patch series:
http://lkml.kernel.org/r/cover.thread-1e2854.your-ad-here.call-01605220128-ext-6070@work.hoursscripts/sorttable.h | 20 +++++++++++--------- 1 file changed, 11 insertions(+), 9 deletions(-)
Friendly ping...