Add XSAVE layout description to Core files for debuggers to support varying XSAVE layouts
Subsystems (4)
v5 cover Add XSAVE layout description to Core files for debuggers to support varying XSAVE layouts
This patch proposes to add an extra .note section in the corefile to dump the CPUID information of a machine.
This is being done to solve the issue of tools like the debuggers having to deal with coredumps from machines with varying XSAVE layouts in spite of having the same XCR0 bits.
The new proposed .note section, at this point, consists of an array of records containing the information of each extended feature that is present. This provides details about the offsets and the sizes of the various extended save state components of the machine where the application crash occurred. Requesting a review for this patch.
Vignesh Balasubramanian (1):
x86/elf: Add a new .note section containing xfeatures buffer layout
info to x86 core files
arch/x86/Kconfig | 1 + arch/x86/include/uapi/asm/elf.h | 17 +++++++ arch/x86/kernel/fpu/xstate.c | 89 +++++++++++++++++++++++++++++++++ fs/binfmt_elf.c | 4 +- include/uapi/linux/elf.h | 1 + 5 files changed, 110 insertions(+), 2 deletions(-) create mode 100644 arch/x86/include/uapi/asm/elf.h
Signature · 1 line
2.34.1
PATCH v5 1/1 x86/elf: Add a new .note section containing xfeatures buffer layout info to x86 core files
Add a new .note section containing type, size, offset and flags of every xfeature that is present.
This information will be used by debuggers to understand the XSAVE layout of the machine where the core file has been dumped, and to read XSAVE registers, especially during cross-platform debugging.
The XSAVE layouts of modern AMD and Intel CPUs differ, especially since Memory Protection Keys and the AVX-512 features have been inculcated into the AMD CPUs.
Since AMD never adopted (and hence never left room in the XSAVE layout for) the Intel MPX feature. Tools like GDB had assumed a fixed XSAVE layout matching that of Intel (based on the XCR0 mask).
Hence, core dumps from AMD CPUs didn't match the known size for the XCR0 mask. This resulted in GDB and other tools not being able to access the values of the AVX-512 and PKRU registers on AMD CPUs.
To solve this, an interim solution has been accepted into GDB, and is already a part of GDB 14, see
https://sourceware.org/pipermail/gdb-patches/2023-March/198081.html.
But it depends on heuristics based on the total XSAVE register set size and the XCR0 mask to infer the layouts of the various register blocks for core dumps, and hence, is not a foolproof mechanism to determine the layout of the XSAVE area.
Therefore, add a new core dump note in order to allow GDB/LLDB and other relevant tools to determine the layout of the XSAVE area of the machine where the corefile was dumped.
The new core dump note (which is being proposed as a per-process .note section), NT_X86_XSAVE_LAYOUT (0x205) contains an array of structures.
Each structure describes an individual extended feature containing offset, size and flags in this format:
struct x86_xfeat_component {
u32 type;
u32 size;
u32 offset;
u32 flags;
};and in an independent manner, allowing for future extensions without depending on hw arch specifics like CPUID etc.
---v4->v5: Fixed build bot error
arch/x86/Kconfig | 1 + arch/x86/include/uapi/asm/elf.h | 17 +++++++ arch/x86/kernel/fpu/xstate.c | 89 +++++++++++++++++++++++++++++++++ fs/binfmt_elf.c | 4 +- include/uapi/linux/elf.h | 1 + 5 files changed, 110 insertions(+), 2 deletions(-) create mode 100644 arch/x86/include/uapi/asm/elf.h
arch/x86/Kconfig +1 -0
@@ -107,6 +107,7 @@ config X86 select ARCH_HAS_DEBUG_WX select ARCH_HAS_ZONE_DMA_SET if EXPERT select ARCH_HAVE_NMI_SAFE_CMPXCHG + select ARCH_HAVE_EXTRA_ELF_NOTES select ARCH_MHP_MEMMAP_ON_MEMORY_ENABLE select ARCH_MIGHT_HAVE_ACPI_PDC if ACPI select ARCH_MIGHT_HAVE_PC_PARPORT
arch/x86/include/uapi/asm/elf.h new file +17 -0
@@ -0,0 +1,17 @@ +/* SPDX-License-Identifier: GPL-2.0 WITH Linux-syscall-note */ +#ifndef _UAPI_ASM_X86_ELF_H +#define _UAPI_ASM_X86_ELF_H + +#include <linux/types.h> + +struct x86_xfeat_component { +__u32 type; +__u32 size; +__u32 offset; +__u32 flags; +} __packed; + +_Static_assert (sizeof (struct x86_xfeat_component )%4 ==0 ,"x86_xfeat_component is not aligned" ); + +#endif /* _UAPI_ASM_X86_ELF_H */ +
arch/x86/kernel/fpu/xstate.c +89 -0
104 lines not on this page · raw message
fs/binfmt_elf.c +2 -2
@@ -2039,7 +2039,7 @@ static int elf_core_dump(struct coredump_params *cprm) {size_t sz = info.size; -/* For cell spufs */ +/* For cell spufs and x86 xstate */ sz +=elf_coredump_extra_notes_size (); phdr4note =kmalloc (sizeof (*phdr4note),GFP_KERNEL );
@@ -2103,7 +2103,7 @@ static int elf_core_dump(struct coredump_params *cprm)if (!write_note_info (&info, cprm)) goto end_coredump; -/* For cell spufs */ +/* For cell spufs and x86 xstate */ if (elf_coredump_extra_notes_write (cprm)) goto end_coredump;
include/uapi/linux/elf.h +1 -0
@@ -411,6 +411,7 @@ typedef struct elf64_shdr {#define NT_X86_XSTATE 0x202/* x86 extended state using xsave */ /* Old binutils treats 0x203 as a CET state */ #define NT_X86_SHSTK 0x204/* x86 SHSTK state */ +#define NT_X86_XSAVE_LAYOUT 0x205/* XSAVE layout description */ #define NT_S390_HIGH_GPRS 0x300/* s390 upper register halves */ #define NT_S390_TIMER 0x301/* s390 timer register */ #define NT_S390_TODCMP 0x302/* s390 TOD clock comparator register */
Signature · 1 line
2.34.1
[tip: x86/fpu] x86/elf: Add a new FPU buffer layout info to x86 core files
The following commit has been merged into the x86/fpu branch of tip:
The following commit has been merged into the x86/fpu branch of tip:
Commit-ID: ba386777a30b38dabcc7fb8a89ec2869a09915f7 Gitweb: https://git.kernel.org/tip/ba386777a30b38dabcc7fb8a89ec2869a09915f7 Author: Vignesh Balasubramanian <[email protected]> AuthorDate: Thu, 25 Jul 2024 21:40:18 +05:30 Committer: Borislav Petkov (AMD) <[email protected]> CommitterDate: Mon, 29 Jul 2024 10:45:43 +02:00
x86/elf: Add a new FPU buffer layout info to x86 core files
Add a new .note section containing type, size, offset and flags of every xfeature that is present.
This information will be used by debuggers to understand the XSAVE layout of the machine where the core file has been dumped, and to read XSAVE registers, especially during cross-platform debugging.
The XSAVE layouts of modern AMD and Intel CPUs differ, especially since Memory Protection Keys and the AVX-512 features have been inculcated into the AMD CPUs.
Since AMD never adopted (and hence never left room in the XSAVE layout for) the Intel MPX feature, tools like GDB had assumed a fixed XSAVE layout matching that of Intel (based on the XCR0 mask).
Hence, core dumps from AMD CPUs didn't match the known size for the XCR0 mask. This resulted in GDB and other tools not being able to access the values of the AVX-512 and PKRU registers on AMD CPUs.
To solve this, an interim solution has been accepted into GDB, and is already a part of GDB 14, see
https://sourceware.org/pipermail/gdb-patches/2023-March/198081.html.
But it depends on heuristics based on the total XSAVE register set size and the XCR0 mask to infer the layouts of the various register blocks for core dumps, and hence, is not a foolproof mechanism to determine the layout of the XSAVE area.
Therefore, add a new core dump note in order to allow GDB/LLDB and other relevant tools to determine the layout of the XSAVE area of the machine where the corefile was dumped.
The new core dump note (which is being proposed as a per-process .note section), NT_X86_XSAVE_LAYOUT (0x205) contains an array of structures.
Each structure describes an individual extended feature containing offset, size and flags in this format:
struct x86_xfeat_component {
u32 type;
u32 size;
u32 offset;
u32 flags;
};and in an independent manner, allowing for future extensions without depending on hw arch specifics like CPUID etc.
[ bp: Massage commit message, zap trailing whitespace. ]
--- arch/x86/Kconfig | 1 +- arch/x86/include/uapi/asm/elf.h | 16 ++++++- arch/x86/kernel/fpu/xstate.c | 89 ++++++++++++++++++++++++++++++++- fs/binfmt_elf.c | 4 +- include/uapi/linux/elf.h | 1 +- 5 files changed, 109 insertions(+), 2 deletions(-) create mode 100644 arch/x86/include/uapi/asm/elf.h
arch/x86/Kconfig +1 -0
@@ -107,6 +107,7 @@ config X86 select ARCH_HAS_DEBUG_WX select ARCH_HAS_ZONE_DMA_SET if EXPERT select ARCH_HAVE_NMI_SAFE_CMPXCHG + select ARCH_HAVE_EXTRA_ELF_NOTES select ARCH_MHP_MEMMAP_ON_MEMORY_ENABLE select ARCH_MIGHT_HAVE_ACPI_PDC if ACPI select ARCH_MIGHT_HAVE_PC_PARPORT
arch/x86/include/uapi/asm/elf.h new file +16 -0
@@ -0,0 +1,16 @@ +/* SPDX-License-Identifier: GPL-2.0 WITH Linux-syscall-note */ +#ifndef _UAPI_ASM_X86_ELF_H +#define _UAPI_ASM_X86_ELF_H + +#include <linux/types.h> + +struct x86_xfeat_component { +__u32 type; +__u32 size; +__u32 offset; +__u32 flags; +} __packed; + +_Static_assert (sizeof (struct x86_xfeat_component ) %4 ==0 ,"x86_xfeat_component is not aligned" ); + +#endif /* _UAPI_ASM_X86_ELF_H */
arch/x86/kernel/fpu/xstate.c +89 -0
104 lines not on this page · raw message
fs/binfmt_elf.c +2 -2
@@ -2039,7 +2039,7 @@ static int elf_core_dump(struct coredump_params *cprm) {size_t sz = info.size; -/* For cell spufs */ +/* For cell spufs and x86 xstate */ sz +=elf_coredump_extra_notes_size (); phdr4note =kmalloc (sizeof (*phdr4note),GFP_KERNEL );
@@ -2103,7 +2103,7 @@ static int elf_core_dump(struct coredump_params *cprm)if (!write_note_info (&info, cprm)) goto end_coredump; -/* For cell spufs */ +/* For cell spufs and x86 xstate */ if (elf_coredump_extra_notes_write (cprm)) goto end_coredump;
include/uapi/linux/elf.h +1 -0
@@ -411,6 +411,7 @@ typedef struct elf64_shdr {#define NT_X86_XSTATE 0x202/* x86 extended state using xsave */ /* Old binutils treats 0x203 as a CET state */ #define NT_X86_SHSTK 0x204/* x86 SHSTK state */ +#define NT_X86_XSAVE_LAYOUT 0x205/* XSAVE layout description */ #define NT_S390_HIGH_GPRS 0x300/* s390 upper register halves */ #define NT_S390_TIMER 0x301/* s390 timer register */ #define NT_S390_TODCMP 0x302/* s390 TOD clock comparator register */