Initial Prefixed Instruction support
Subsystems (5)
v5 cover Initial Prefixed Instruction support
A future revision of the ISA will introduce prefixed instructions. A prefixed instruction is composed of a 4-byte prefix followed by a 4-byte suffix.
All prefixes have the major opcode 1. A prefix will never be a valid word instruction. A suffix may be an existing word instruction or a new instruction.
This series enables prefixed instructions and extends the instruction emulation to support them. Then the places where prefixed instructions might need to be emulated are updated.
v5 is based on feedback from Nick Piggins, Michael Ellerman, Balamuruhan Suriyakumar and Alistair Popple.
The major changes:
- The ppc instruction type is now a struct
- Series now just based on next
- ppc_inst_masked() dropped
- Space for xmon breakpoints allocated in an assembly file
- "Add prefixed instructions to instruction data type" patch seperated in to smaller patches
- Calling convention for create_branch() is changed
- Some places which had not been updated to use the data type are now updated
v4 is based on feedback from Nick Piggins, Christophe Leroy and Daniel Axtens. The major changes:
- Move xmon breakpoints from data section to text section
- Introduce a data type for instructions on powerpc
v3 is based on feedback from Christophe Leroy. The major changes:
- Completely replacing store_inst() with patch_instruction() in xmon
- Improve implementation of mread_instr() to not use mread().
- Base the series on top of
https://patchwork.ozlabs.org/patch/1232619/ as this will effect kprobes.
- Some renaming and simplification of conditionals.
v2 incorporates feedback from Daniel Axtens and and Balamuruhan S. The major changes are:
- Squashing together all commits about SRR1 bits
- Squashing all commits for supporting prefixed load stores
- Changing abbreviated references to sufx/prfx -> suffix/prefix
- Introducing macros for returning the length of an instruction
- Removing sign extension flag from pstd/pld in sstep.c
- Dropping patch "powerpc/fault: Use analyse_instr() to check for store with updates to sp" from the series, it did not really fit with prefixed enablement in the first place and as reported by Greg Kurz did not work correctly.
Alistair Popple (1):
powerpc: Enable Prefixed Instructions
Jordan Niethe (20):
powerpc/xmon: Remove store_inst() for patch_instruction() powerpc/xmon: Move out-of-line instructions to text section
powerpc: Change calling convention for create_branch() et. al.
powerpc: Use a macro for creating instructions from u32s
powerpc: Use a function for getting the instruction op code
powerpc: Use an accessor for instructions
powerpc: Use a function for byte swapping instructions
powerpc: Introduce functions for instruction equality
powerpc: Use a datatype for instructions
powerpc: Use a function for reading instructions
powerpc: Define and use __get_user_instr{,inatomic}()
powerpc: Introduce a function for reporting instruction length powerpc/xmon: Use a function for reading instructions powerpc/xmon: Move insertion of breakpoint for xol'ing
powerpc: Make test_translate_branch() independent of instruction
length
powerpc: Define new SRR1 bits for a future ISA version
powerpc64: Add prefixed instructions to instruction data type
powerpc: Support prefixed instructions in alignment handler powerpc sstep: Add support for prefixed load/stores powerpc sstep: Add support for prefixed fixed-point arithmetic
arch/powerpc/include/asm/code-patching.h | 37 +- arch/powerpc/include/asm/inst.h | 106 ++++++ arch/powerpc/include/asm/kprobes.h | 2 +- arch/powerpc/include/asm/reg.h | 7 +- arch/powerpc/include/asm/sstep.h | 15 +- arch/powerpc/include/asm/uaccess.h | 28 ++ arch/powerpc/include/asm/uprobes.h | 7 +- arch/powerpc/kernel/align.c | 13 +- arch/powerpc/kernel/epapr_paravirt.c | 5 +- arch/powerpc/kernel/hw_breakpoint.c | 5 +- arch/powerpc/kernel/jump_label.c | 5 +- arch/powerpc/kernel/kgdb.c | 9 +- arch/powerpc/kernel/kprobes.c | 24 +- arch/powerpc/kernel/mce_power.c | 5 +- arch/powerpc/kernel/module_64.c | 3 +- arch/powerpc/kernel/optprobes.c | 91 +++-- arch/powerpc/kernel/optprobes_head.S | 3 + arch/powerpc/kernel/security.c | 9 +- arch/powerpc/kernel/setup_32.c | 4 +- arch/powerpc/kernel/trace/ftrace.c | 190 ++++++---- arch/powerpc/kernel/traps.c | 20 +- arch/powerpc/kernel/uprobes.c | 3 +- arch/powerpc/kernel/vecemu.c | 20 +- arch/powerpc/kvm/book3s_hv_nested.c | 2 +- arch/powerpc/kvm/book3s_hv_rm_mmu.c | 2 +- arch/powerpc/kvm/emulate_loadstore.c | 2 +- arch/powerpc/lib/code-patching.c | 289 +++++++------- arch/powerpc/lib/feature-fixups.c | 69 ++-- arch/powerpc/lib/sstep.c | 455 ++++++++++++++++------- arch/powerpc/lib/test_emulate_step.c | 56 +-- arch/powerpc/perf/core-book3s.c | 4 +- arch/powerpc/xmon/Makefile | 2 +- arch/powerpc/xmon/xmon.c | 94 +++-- arch/powerpc/xmon/xmon_bpts.S | 10 + arch/powerpc/xmon/xmon_bpts.h | 8 + 35 files changed, 1042 insertions(+), 562 deletions(-) create mode 100644 arch/powerpc/include/asm/inst.h create mode 100644 arch/powerpc/xmon/xmon_bpts.S create mode 100644 arch/powerpc/xmon/xmon_bpts.h
Signature · 1 line
2.17.1
PATCH v5 1/21 powerpc/xmon: Remove store_inst() for patch_instruction()
For modifying instructions in xmon, patch_instruction() can serve the same role that store_inst() is performing with the advantage of not being specific to xmon. In some places patch_instruction() is already being using followed by store_inst(). In these cases just remove the store_inst(). Otherwise replace store_inst() with patch_instruction().
---
v4: Read into a local variable
--- arch/powerpc/xmon/xmon.c | 18 +++++------------- 1 file changed, 5 insertions(+), 13 deletions(-)
arch/powerpc/xmon/xmon.c +5 -13
@@ -325,11 +325,6 @@ static inline void sync(void) asmvolatile ("sync; isync" ); } -static inline void store_inst (void *p) -{ - asmvolatile ("dcbst 0,%0; sync; icbi 0,%0; isync" : :"r" (p)); -} -static inline void cflush (void *p) { asmvolatile ("dcbf 0,%0; icbi 0,%0" : :"r" (p));
@@ -881,8 +876,7 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; - bp->instr[1 ] = bpinstr; -store_inst (&bp->instr[1 ]); +patch_instruction (&bp->instr[1 ], bpinstr);return bp; } }
@@ -894,25 +888,26 @@ static struct bpt *new_breakpoint(unsigned long a)static void insert_bpts (void ) {int i; +unsigned int instr;struct bpt *bp; bp = bpts;for (i =0 ; i <NBPTS ; ++i, ++bp) {if ((bp->enabled & (BP_TRAP |BP_CIABR )) ==0 )continue ; -if (mread (bp->address, &bp->instr[0 ],4 ) !=4 ) { +if (mread (bp->address, &instr,4 ) !=4 ) {printf ("Couldn't read instruction at %lx, " "disabling breakpoint there\n" , bp->address); bp->enabled =0 ;continue ; } -if (IS_MTMSRD (bp->instr[0 ]) ||IS_RFID (bp->instr[0 ])) { +if (IS_MTMSRD (instr) ||IS_RFID (instr)) {printf ("Breakpoint at %lx is on an mtmsrd or rfid " "instruction, disabling it\n" , bp->address); bp->enabled =0 ;continue ; } -store_inst (&bp->instr[0 ]); +patch_instruction (bp->instr, instr);if (bp->enabled &BP_CIABR )continue ; if (patch_instruction((unsigned int *)bp->address,
@@ -922,7 +917,6 @@ static void insert_bpts(void) bp->enabled &= ~BP_TRAP ;continue ; } -store_inst ((void *)bp->address); } }
@@ -957,8 +951,6 @@ static void remove_bpts(void) (unsigned int *)bp->address, bp->instr[0]) != 0)printf ("Couldn't remove breakpoint at %lx\n" , bp->address); - else - store_inst((void *)bp->address); } }
Signature · 1 line
2.17.1
PATCH v5 2/21 powerpc/xmon: Move out-of-line instructions to text section
In reply to Jordan NietheTo execute an instruction out of line after a breakpoint, the NIP is set to the address of struct bpt::instr. Here a copy of the instruction that was replaced with a breakpoint is kept, along with a trap so normal flow can be resumed after XOLing. The struct bpt's are located within the data section. This is problematic as the data section may be marked as no execute.
Instead of each struct bpt holding the instructions to be XOL'd, make a new array, bpt_table[], with enough space to hold instructions for the number of supported breakpoints. Place this array in the text section. Make struct bpt::instr a pointer to the instructions in bpt_table[] associated with that breakpoint. This association is a simple mapping:
bpts[n] -> bpt_table[n * words per breakpoint]. Currently we only need the copied instruction followed by a trap, so 2 words per breakpoint.
---
v4: New to series
v5: - Do not use __section(), use a .space directive in .S file
- Simplify in_breakpoint_table() calculation
- Define BPT_SIZE
--- arch/powerpc/xmon/Makefile | 2 +- arch/powerpc/xmon/xmon.c | 23 +++++++++++++---------- arch/powerpc/xmon/xmon_bpts.S | 8 ++++++++ arch/powerpc/xmon/xmon_bpts.h | 8 ++++++++ 4 files changed, 30 insertions(+), 11 deletions(-) create mode 100644 arch/powerpc/xmon/xmon_bpts.S create mode 100644 arch/powerpc/xmon/xmon_bpts.h
arch/powerpc/xmon/Makefile +1 -1
@@ -21,7 +21,7 @@ endif ccflags-$(CONFIG_PPC64) := $(NO_MINIMAL_TOC) -obj-y += xmon.o nonstdio.o spr_access.o +obj-y += xmon.o nonstdio.o spr_access.o xmon_bpts.o ifdef CONFIG_XMON_DISASSEMBLY obj-y += ppc-dis.o ppc-opc.o
arch/powerpc/xmon/xmon.c +13 -10
@@ -62,6 +62,7 @@#include "nonstdio.h" #include "dis-asm.h" +#include "xmon_bpts.h" #ifdef CONFIG_SMP static cpumask_t cpus_in_xmon =CPU_MASK_NONE ;
@@ -97,7 +98,7 @@ static long *xmon_fault_jmp[NR_CPUS];/* Breakpoint stuff */ struct bpt {unsigned long address; -unsigned int instr[2 ]; +unsigned int *instr;atomic_t ref_count;int enabled;unsigned long pad;
@@ -108,7 +109,6 @@ struct bpt {#define BP_TRAP 2#define BP_DABR 4 -#define NBPTS 256static struct bpt bpts[NBPTS ];static struct bpt dabr;static struct bpt *iabr;
@@ -116,6 +116,10 @@ static unsigned bpinstr = 0x7fe00008; /* trap */#define BP_NUM (bp) ((bp) - bpts + 1) +#define BPT_SIZE (sizeof(unsigned int) * 2) +#define BPT_WORDS (BPT_SIZE / sizeof(unsigned int)) +extern unsigned int bpt_table[NBPTS *BPT_WORDS ]; +/* Prototypes */ static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );
@@ -853,15 +857,13 @@ static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) {unsigned long off; - off = nip - (unsigned long ) bpts; -if (off >=sizeof (bpts)) + off = nip - (unsigned long ) bpt_table; +if (off >=sizeof (bpt_table))return NULL ; - off %=sizeof (struct bpt ); - if (off != offsetof(struct bpt, instr[0]) - && off != offsetof(struct bpt, instr[1])) + *offp = off %BPT_SIZE ; +if (*offp !=0 && *offp !=4 )return NULL ; - *offp = off - offsetof(struct bpt, instr[0]); -return (struct bpt *) (nip - off); +return bpts + (off /BPT_SIZE ); }static struct bpt *new_breakpoint (unsigned long a)
@@ -876,7 +878,8 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; -patch_instruction (&bp->instr[1 ], bpinstr); + bp->instr = bpt_table + ((bp - bpts) *BPT_WORDS ); +patch_instruction (bp->instr +1 , bpinstr);return bp; } }
arch/powerpc/xmon/xmon_bpts.S new file +8 -0
@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#include <asm/ppc_asm.h> +#include <asm/asm-compat.h> +#include "xmon_bpts.h" + +.global bpt_table +bpt_table: + .space NBPTS * 8
arch/powerpc/xmon/xmon_bpts.h new file +8 -0
@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#ifndef XMON_BPTS_H +#define XMON_BPTS_H + +#define NBPTS 256 + +#endif /* XMON_BPTS_H */ +
Signature · 1 line
2.17.1
Re: [PATCH v5 02/21] powerpc/xmon: Move out-of-line instructions to text section
Quoted 7 lines · Jordan Niethe
To execute an instruction out of line after a breakpoint, the NIP is set to the address of struct
bpt::instr. Here a copy of the instruction that was replaced with a breakpoint is kept, along with a trap so normal flow can be resumed after XOLing. The struct bpt's are located within the data section. This is problematic as the data section may be marked as no execute.
Quoted 7 lines
Instead of each struct bpt holding the instructions to be XOL'd, make a new array, bpt_table[], with enough space to hold instructions for the number of supported breakpoints. Place this array in the text section. Make struct
bpt::instra pointer to the instructions in bpt_table[] associated with that breakpoint. This association is a simple mapping:
bpts[n] -> bpt_table[n * words per breakpoint]. Currently we only need the copied instruction followed by a trap, so 2 words per breakpoint.
we do 2 things here and we discussed to split it into 2 commits, may be it is up to your thoughts and leave it to you. But otherwise rest looks good to me.
-- Bala
Quoted 129 lines
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: - Do not use__section(), use a .space directive in .S file
- Simplifyin_breakpoint_table()calculation
- DefineBPT_SIZE--- arch/powerpc/xmon/Makefile | 2 +- arch/powerpc/xmon/xmon.c | 23 +++++++++++++---------- arch/powerpc/xmon/xmon_bpts.S | 8 ++++++++ arch/powerpc/xmon/xmon_bpts.h | 8 ++++++++ 4 files changed, 30 insertions(+), 11 deletions(-) create mode 100644 arch/powerpc/xmon/xmon_bpts.S create mode 100644 arch/powerpc/xmon/xmon_bpts.harch/powerpc/xmon/Makefile +1
-1@@ -21,7 +21,7 @@ endif ccflags-$(CONFIG_PPC64) := $(NO_MINIMAL_TOC) -obj-y += xmon.o nonstdio.o spr_access.o +obj-y += xmon.o nonstdio.o spr_access.o xmon_bpts.o ifdef CONFIG_XMON_DISASSEMBLY obj-y += ppc-dis.o ppc-opc.oarch/powerpc/xmon/xmon.c +11
-9@@ -62,6 +62,7 @@#include "nonstdio.h" #include "dis-asm.h" +#include "xmon_bpts.h" #ifdef CONFIG_SMP static cpumask_t cpus_in_xmon =CPU_MASK_NONE ;@@ -97,7 +98,7 @@ static long *xmon_fault_jmp[NR_CPUS];/* Breakpoint stuff */ struct bpt {unsigned long address; -unsigned int instr[2 ]; +unsigned int *instr;atomic_t ref_count;int enabled;unsigned long pad;@@ -108,7 +109,6 @@ struct bpt {#define BP_TRAP 2#define BP_DABR 4 -#define NBPTS 256static struct bpt bpts[NBPTS ];static struct bpt dabr;static struct bpt *iabr;@@ -116,6 +116,10 @@ static unsigned bpinstr = 0x7fe00008; /* trap */#define BP_NUM (bp) ((bp) - bpts + 1) +#define BPT_SIZE (sizeof(unsigned int) * 2) +#define BPT_WORDS (BPT_SIZE / sizeof(unsigned int)) +extern unsigned int bpt_table[NBPTS *BPT_WORDS ]; +/* Prototypes */ static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );@@ -853,15 +857,13 @@ static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) {unsigned long off; - off = nip - (unsigned long ) bpts; -if (off >=sizeof (bpts)) + off = nip - (unsigned long ) bpt_table; +if (off >=sizeof (bpt_table))return NULL ; - off %=sizeof (struct bpt ); - if (off != offsetof(struct bpt, instr[0]) - && off != offsetof(struct bpt, instr[1])) + *offp = off %BPT_SIZE ; +if (*offp !=0 && *offp !=4 )return NULL ; - *offp = off - offsetof(struct bpt, instr[0]); -return (struct bpt *) (nip - off); +return bpts + (off /BPT_SIZE ); }static struct bpt *new_breakpoint(unsigned long a)
arch/powerpc/xmon/xmon.c +2
-1@@ -876,7 +878,8 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; -patch_instruction (&bp->instr[1 ], bpinstr); + bp->instr = bpt_table + ((bp - bpts) *BPT_WORDS ); +patch_instruction (bp->instr +1 , bpinstr);return bp; } }arch/powerpc/xmon/xmon_bpts.S new file +8
-0@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#include <asm/ppc_asm.h> +#include <asm/asm-compat.h> +#include "xmon_bpts.h" + +.global bpt_table +bpt_table: + .space NBPTS * 8arch/powerpc/xmon/xmon_bpts.h new file +8
-0@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#ifndef XMON_BPTS_H +#define XMON_BPTS_H + +#define NBPTS 256 + +#endif /* XMON_BPTS_H */ +
Re: [PATCH v5 02/21] powerpc/xmon: Move out-of-line instructions to text section
In reply to Jordan NietheLe 06/04/2020 à 10:09, Jordan Niethe a écrit :
Quoted 15 lines
To execute an instruction out of line after a breakpoint, the NIP is set to the address of struct
bpt::instr. Here a copy of the instruction that was replaced with a breakpoint is kept, along with a trap so normal flow can be resumed after XOLing. The struct bpt's are located within the data section. This is problematic as the data section may be marked as no execute.Instead of each struct bpt holding the instructions to be XOL'd, make a new array, bpt_table[], with enough space to hold instructions for the number of supported breakpoints. Place this array in the text section. Make struct
bpt::instra pointer to the instructions in bpt_table[] associated with that breakpoint. This association is a simple mapping:
bpts[n] -> bpt_table[n * words per breakpoint]. Currently we only need the copied instruction followed by a trap, so 2 words per breakpoint.
Quoted 4 lines
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: - Do not use__section(), use a .space directive in .S file
I was going to comment to use __section() instead of creating a dedicated .S file.
Why did you change that in v5 ?
Quoted 54 lines
- Simplify
in_breakpoint_table()calculation
- DefineBPT_SIZE--- arch/powerpc/xmon/Makefile | 2 +- arch/powerpc/xmon/xmon.c | 23 +++++++++++++---------- arch/powerpc/xmon/xmon_bpts.S | 8 ++++++++ arch/powerpc/xmon/xmon_bpts.h | 8 ++++++++ 4 files changed, 30 insertions(+), 11 deletions(-)create mode 100644
arch/powerpc/xmon/xmon_bpts.Screate mode 100644arch/powerpc/xmon/xmon_bpts.harch/powerpc/xmon/Makefile +1
-1@@ -21,7 +21,7 @@ endif ccflags-$(CONFIG_PPC64) := $(NO_MINIMAL_TOC) -obj-y += xmon.o nonstdio.o spr_access.o +obj-y += xmon.o nonstdio.o spr_access.o xmon_bpts.o ifdef CONFIG_XMON_DISASSEMBLY obj-y += ppc-dis.o ppc-opc.oarch/powerpc/xmon/xmon.c +2
-2@@ -62,6 +62,7 @@#include "nonstdio.h" #include "dis-asm.h" +#include "xmon_bpts.h" #ifdef CONFIG_SMP static cpumask_t cpus_in_xmon =CPU_MASK_NONE ;@@ -97,7 +98,7 @@ static long *xmon_fault_jmp[NR_CPUS];/* Breakpoint stuff */ struct bpt {unsigned long address; -unsigned int instr[2 ]; +unsigned int *instr;atomic_t ref_count;int enabled;unsigned long pad;@@ -108,7 +109,6 @@ struct bpt {#define BP_TRAP 2#define BP_DABR 4 -#define NBPTS 256static struct bpt bpts[NBPTS ];static struct bpt dabr;static struct bpt *iabr;
arch/powerpc/xmon/xmon.c static unsigned bpinstr = 0x7fe00008; /* trap */ · line 120
Quoted 5 lines
arch/powerpc/xmon/xmon.c +2
-0@@ -116,6 +116,10 @@ static unsigned bpinstr = 0x7fe00008; /* trap */#define BP_NUM (bp) ((bp) - bpts + 1) +#define BPT_SIZE (sizeof(unsigned int) * 2) +#define BPT_WORDS (BPT_SIZE / sizeof(unsigned int))
Wouldn't it make more sense to do the following ? :
#define BPT_WORDS 2
#define BPT_SIZE (BPT_WORDS * sizeof(unsigned int))
arch/powerpc/xmon/xmon.c static unsigned bpinstr = 0x7fe00008; /* trap */ · line 121
Quoted 1 line
arch/powerpc/xmon/xmon.c +1
-0+extern unsigned int bpt_table[NBPTS *BPT_WORDS ];
Should go in xmon_bpts.h if we keep the definition in xmon_bpts.S
Quoted 7 lines
arch/powerpc/xmon/xmon.c +1
-0+/* Prototypes */ static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );@@ -853,15 +857,13 @@ static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) {unsigned long off;
arch/powerpc/xmon/xmon.c static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) · line 863
Quoted 10 lines
arch/powerpc/xmon/xmon.c +3
-5- off = nip - (unsigned long ) bpts; -if (off >=sizeof (bpts)) + off = nip - (unsigned long ) bpt_table; +if (off >=sizeof (bpt_table))return NULL ; - off %=sizeof (struct bpt ); - if (off != offsetof(struct bpt, instr[0]) - && off != offsetof(struct bpt, instr[1])) + *offp = off %BPT_SIZE ;
Can we use logical operation instead ?
*offp = off & (BPT_SIZE - 1);
arch/powerpc/xmon/xmon.c static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) · line 864
Quoted 1 line
arch/powerpc/xmon/xmon.c +1
-0+if (*offp !=0 && *offp !=4 )
Could be:
if (off & 3)
Quoted 23 lines
arch/powerpc/xmon/xmon.c +3
-3return NULL ; - *offp = off - offsetof(struct bpt, instr[0]); -return (struct bpt *) (nip - off); +return bpts + (off /BPT_SIZE ); }static struct bpt *new_breakpoint (unsigned long a)@@ -876,7 +878,8 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; -patch_instruction (&bp->instr[1 ], bpinstr); + bp->instr = bpt_table + ((bp - bpts) *BPT_WORDS ); +patch_instruction (bp->instr +1 , bpinstr);return bp; } }arch/powerpc/xmon/xmon_bpts.S new file +0
-0
arch/powerpc/xmon/xmon_bpts.S line 8
Quoted 8 lines
arch/powerpc/xmon/xmon_bpts.S new file +8
-0@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#include <asm/ppc_asm.h> +#include <asm/asm-compat.h> +#include "xmon_bpts.h" + +.global bpt_table +bpt_table: + .space NBPTS * 8
Should use BPT_SIZE instead of raw coding 8.
Quoted 7 lines
arch/powerpc/xmon/xmon_bpts.h new file +0
-0
arch/powerpc/xmon/xmon_bpts.h line 8
Quoted 8 lines
arch/powerpc/xmon/xmon_bpts.h new file +8
-0@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#ifndef XMON_BPTS_H +#define XMON_BPTS_H + +#define NBPTS 256 + +#endif /* XMON_BPTS_H */ +
I think it would be better to split this patch in two patches:
1/ First patch to move breakpoints out of struct bpt into a bpt_table. 2/ Second patch to move bpt_table into .text section.
Christophe
Re: [PATCH v5 02/21] powerpc/xmon: Move out-of-line instructions to text section
Quoted 24 lines · Christophe Leroy
Quoted 15 lines · Jordan Niethe
To execute an instruction out of line after a breakpoint, the NIP is set to the address of struct
bpt::instr. Here a copy of the instruction that was replaced with a breakpoint is kept, along with a trap so normal flow can be resumed after XOLing. The struct bpt's are located within the data section. This is problematic as the data section may be marked as no execute.Instead of each struct bpt holding the instructions to be XOL'd, make a new array, bpt_table[], with enough space to hold instructions for the number of supported breakpoints. Place this array in the text section. Make struct
bpt::instra pointer to the instructions in bpt_table[] associated with that breakpoint. This association is a simple mapping:
bpts[n] -> bpt_table[n * words per breakpoint]. Currently we only need the copied instruction followed by a trap, so 2 words per breakpoint.Quoted 4 lines
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: - Do not use__section(), use a .space directive in .S file
Quoted 4 lines
I was going to comment to use
__section()instead of creating a dedicated .S file.Why did you change that in v5 ?
I noticed with some toolchains I was getting this message:
Warning: setting incorrect section attributes for .text.xmon_bpts I was talking with mpe about it and he said that the usual way for doing things like this was with .space in a .S file so I changed to that way.
Quoted 58 lines
Quoted 58 lines
- Simplify
in_breakpoint_table()calculation
- DefineBPT_SIZE--- arch/powerpc/xmon/Makefile | 2 +- arch/powerpc/xmon/xmon.c | 23 +++++++++++++---------- arch/powerpc/xmon/xmon_bpts.S | 8 ++++++++ arch/powerpc/xmon/xmon_bpts.h | 8 ++++++++ 4 files changed, 30 insertions(+), 11 deletions(-)create mode 100644
arch/powerpc/xmon/xmon_bpts.Screate mode 100644arch/powerpc/xmon/xmon_bpts.harch/powerpc/xmon/Makefile +1
-1@@ -21,7 +21,7 @@ endif ccflags-$(CONFIG_PPC64) := $(NO_MINIMAL_TOC) -obj-y += xmon.o nonstdio.o spr_access.o +obj-y += xmon.o nonstdio.o spr_access.o xmon_bpts.o ifdef CONFIG_XMON_DISASSEMBLY obj-y += ppc-dis.o ppc-opc.oarch/powerpc/xmon/xmon.c +2
-2@@ -62,6 +62,7 @@#include "nonstdio.h" #include "dis-asm.h" +#include "xmon_bpts.h" #ifdef CONFIG_SMP static cpumask_t cpus_in_xmon =CPU_MASK_NONE ;@@ -97,7 +98,7 @@ static long *xmon_fault_jmp[NR_CPUS];/* Breakpoint stuff */ struct bpt {unsigned long address; -unsigned int instr[2 ]; +unsigned int *instr;atomic_t ref_count;int enabled;unsigned long pad;@@ -108,7 +109,6 @@ struct bpt {#define BP_TRAP 2#define BP_DABR 4 -#define NBPTS 256static struct bpt bpts[NBPTS ];static struct bpt dabr;static struct bpt *iabr;@@ -116,6 +116,10 @@ static unsigned bpinstr = 0x7fe00008; /* trap */#define BP_NUM (bp) ((bp) - bpts + 1)
Quoted 7 lines
arch/powerpc/xmon/xmon.c static unsigned bpinstr = 0x7fe00008; /* trap */ · line 120
Quoted 2 lines
arch/powerpc/xmon/xmon.c +2
-0+#define BPT_SIZE (sizeof(unsigned int) * 2) +#define BPT_WORDS (BPT_SIZE / sizeof(unsigned int))Wouldn't it make more sense to do the following ? :
#define
BPT_WORDS2
#defineBPT_SIZE(BPT_WORDS* sizeof(unsigned int))
I defined it like that so when we changed unsigned int -> struct ppc_inst it would be the correct size whether or not the struct included a suffix.
Otherwise it would be more straightforward to do it like that.
Quoted 4 lines
arch/powerpc/xmon/xmon.c static unsigned bpinstr = 0x7fe00008; /* trap */ · line 121
Quoted 2 lines
arch/powerpc/xmon/xmon.c +1
-0+extern unsigned int bpt_table[NBPTS *BPT_WORDS ];Should go in
xmon_bpts.hif we keep the definition inxmon_bpts.S
Right.
Quoted 9 lines
Quoted 9 lines
arch/powerpc/xmon/xmon.c +1
-0+/* Prototypes */ static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );@@ -853,15 +857,13 @@ static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) {unsigned long off;
Quoted 11 lines
arch/powerpc/xmon/xmon.c static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) · line 863
Quoted 9 lines
arch/powerpc/xmon/xmon.c +3
-5- off = nip - (unsigned long ) bpts; -if (off >=sizeof (bpts)) + off = nip - (unsigned long ) bpt_table; +if (off >=sizeof (bpt_table))return NULL ; - off %=sizeof (struct bpt ); - if (off != offsetof(struct bpt, instr[0]) - && off != offsetof(struct bpt, instr[1])) + *offp = off %BPT_SIZE ;Can we use logical operation instead ?
Sure, I was just adapting how it was already but that would probably be clearer.
Quoted 33 lines
*offp = off & (BPT_SIZE - 1);arch/powerpc/xmon/xmon.c static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) · line 864
Quoted 1 line
arch/powerpc/xmon/xmon.c +1
-0+if (*offp !=0 && *offp !=4 )Could be:
if (off & 3)Quoted 25 lines
arch/powerpc/xmon/xmon.c +3
-3return NULL ; - *offp = off - offsetof(struct bpt, instr[0]); -return (struct bpt *) (nip - off); +return bpts + (off /BPT_SIZE ); }static struct bpt *new_breakpoint (unsigned long a)@@ -876,7 +878,8 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; -patch_instruction (&bp->instr[1 ], bpinstr); + bp->instr = bpt_table + ((bp - bpts) *BPT_WORDS ); +patch_instruction (bp->instr +1 , bpinstr);return bp; } }arch/powerpc/xmon/xmon_bpts.S new file +2
-0@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#include <asm/ppc_asm.h>
Quoted 8 lines
arch/powerpc/xmon/xmon_bpts.S line 8
Quoted 6 lines
arch/powerpc/xmon/xmon_bpts.S new file +6
-0+#include <asm/asm-compat.h> +#include "xmon_bpts.h" + +.global bpt_table +bpt_table: + .space NBPTS * 8Should use
BPT_SIZEinstead of raw coding 8.
Right.
Quoted 12 lines
Quoted 12 lines
arch/powerpc/xmon/xmon_bpts.h new file +5
-0@@ -0,0 +1,8 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#ifndef XMON_BPTS_H +#define XMON_BPTS_H + +#define NBPTS 256
Quoted 8 lines
arch/powerpc/xmon/xmon_bpts.h line 8
Quoted 4 lines
arch/powerpc/xmon/xmon_bpts.h new file +3
-0+ +#endif /* XMON_BPTS_H */ +I think it would be better to split this patch in two patches:
1/ First patch to move breakpoints out of struct bpt into abpt_table. 2/ Second patch to movebpt_tableinto .text section.
Bala suggested so too, I will separate them next time.
Quoted 2 lines
Christophe
PATCH v5 3/21 powerpc: Change calling convention for create_branch() et. al.
In reply to Jordan Niethecreate_branch(), create_cond_branch() and translate_branch() return the instruction that they create, or return 0 to signal an error. Seperate these concerns in preparation for an instruction type that is not just an unsigned int. Fill the created instruction to a pointer passed as the first parameter to the function and use a non-zero return value to signify an error.
---
v5: New to series
--- arch/powerpc/include/asm/code-patching.h | 12 +- arch/powerpc/kernel/optprobes.c | 24 ++-- arch/powerpc/kernel/setup_32.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 24 ++-- arch/powerpc/lib/code-patching.c | 133 +++++++++++++---------- arch/powerpc/lib/feature-fixups.c | 5 +- 6 files changed, 117 insertions(+), 83 deletions(-)
arch/powerpc/include/asm/code-patching.h +6 -6
@@ -22,10 +22,10 @@#define BRANCH_ABSOLUTE 0x2bool is_offset_in_branch_range (long offset); -unsigned int create_branch (const unsigned int *addr, -unsigned long target,int flags); -unsigned int create_cond_branch (const unsigned int *addr, -unsigned long target,int flags); +int create_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags); +int create_cond_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags);int patch_branch (unsigned int *addr,unsigned long target,int flags);int patch_instruction (unsigned int *addr,unsigned int instr);int raw_patch_instruction (unsigned int *addr,unsigned int instr);
@@ -60,8 +60,8 @@ int instr_is_relative_branch(unsigned int instr);int instr_is_relative_link_branch (unsigned int instr);int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr);unsigned long branch_target (const unsigned int *instr); -unsigned int translate_branch (const unsigned int *dest, -const unsigned int *src); +int translate_branch (unsigned int *instr,const unsigned int *dest, +const unsigned int *src);extern bool is_conditional_branch (unsigned int instr);#ifdef CONFIG_PPC_BOOK3E_64 void __patch_exception (int exc,unsigned long addr);
arch/powerpc/kernel/optprobes.c +14 -10
@@ -251,15 +251,17 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) goto error; } - branch_op_callback =create_branch ((unsigned int *)buff +TMPL_CALL_HDLR_IDX , - (unsigned long )op_callback_addr, -BRANCH_SET_LINK ); + rc =create_branch (&branch_op_callback, + (unsigned int *)buff +TMPL_CALL_HDLR_IDX , + (unsigned long )op_callback_addr, +BRANCH_SET_LINK ); - branch_emulate_step =create_branch ((unsigned int *)buff +TMPL_EMULATE_IDX , - (unsigned long )emulate_step_addr, -BRANCH_SET_LINK ); + rc |=create_branch (&branch_emulate_step, + (unsigned int *)buff +TMPL_EMULATE_IDX , + (unsigned long )emulate_step_addr, +BRANCH_SET_LINK ); -if (!branch_op_callback || !branch_emulate_step) +if (rc) goto error;patch_instruction (buff +TMPL_CALL_HDLR_IDX , branch_op_callback);
@@ -305,6 +307,7 @@ int arch_check_optimized_kprobe(struct optimized_kprobe *op)void arch_optimize_kprobes (struct list_head *oplist) { +unsigned int instr;struct optimized_kprobe *op;struct optimized_kprobe *tmp;
@@ -315,9 +318,10 @@ void arch_optimize_kprobes(struct list_head *oplist)*/ memcpy (op->optinsn.copied_insn, op->kp.addr,RELATIVEJUMP_SIZE ); -patch_instruction (op->kp.addr, -create_branch ((unsigned int *)op->kp.addr, - (unsigned long )op->optinsn.insn,0 )); +create_branch (&instr, + (unsigned int *)op->kp.addr, + (unsigned long )op->optinsn.insn,0 ); +patch_instruction (op->kp.addr, instr);list_del_init (&op->list); } }
arch/powerpc/kernel/setup_32.c +1 -1
@@ -88,7 +88,7 @@ notrace void __init machine_init(u64 dt_ptr)patch_instruction_site (&patch__memcpy_nocache,PPC_INST_NOP ); - insn =create_cond_branch (addr,branch_target (addr),0x820000 ); +create_cond_branch (&insn, addr,branch_target (addr),0x820000 );patch_instruction (addr, insn);/* replace b by bne cr0 */ /* Do some early initialization based on the flat device tree */
arch/powerpc/kernel/trace/ftrace.c +15 -9
@@ -48,7 +48,7 @@ ftrace_call_replace(unsigned long ip, unsigned long addr, int link) addr =ppc_function_entry ((void *)addr);/* if (link) set op to 'bl' else 'b' */ - op =create_branch ((unsigned int *)ip, addr, link ?1 :0 ); +create_branch (&op, (unsigned int *)ip, addr, link ?1 :0 );return op; }
@@ -89,10 +89,11 @@ ftrace_modify_code(unsigned long ip, unsigned int old, unsigned int new)*/ static int test_24bit_addr (unsigned long ip,unsigned long addr) { +unsigned int op; addr =ppc_function_entry ((void *)addr);/* use the create_branch to verify that this offset can be branched */ -return create_branch ((unsigned int *)ip, addr,0 ); +return create_branch (&op, (unsigned int *)ip, addr,0 ) ==0 ; }static int is_bl_op (unsigned int op)
@@ -287,6 +288,7 @@ __ftrace_make_nop(struct module *mod,static unsigned long find_ftrace_tramp (unsigned long ip) {int i; +unsigned int instr;/* * We have the compiler generated long_branch tramps at the end
@@ -295,7 +297,8 @@ static unsigned long find_ftrace_tramp(unsigned long ip)for (i =NUM_FTRACE_TRAMPS -1 ; i >=0 ; i--)if (!ftrace_tramps[i])continue ; -else if (create_branch ((void *)ip, ftrace_tramps[i],0 )) +else if (create_branch (&instr, (void *)ip, + ftrace_tramps[i],0 ) ==0 )return ftrace_tramps[i];return 0 ;
@@ -324,6 +327,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp) {int i, op;unsigned long ptr; +unsigned int instr;static unsigned long ftrace_plt_tramps[NUM_FTRACE_TRAMPS ];/* Is this a known long jump tramp? */
@@ -366,7 +370,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)#else ptr =ppc_global_function_entry ((void *)ftrace_caller);#endif -if (!create_branch ((void *)tramp, ptr,0 )) { +if (create_branch (&instr, (void *)tramp, ptr,0 )) {pr_debug ("%ps is not reachable from existing mcount tramp\n" , (void *)ptr);return -1 ;
@@ -511,6 +515,7 @@ static int __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) {unsigned int op[2 ]; +unsigned int instr;void *ip = (void *)rec->ip;unsigned long entry, ptr, tramp;struct module *mod = rec->arch.mod;
@@ -557,7 +562,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }/* Ensure branch is within 24 bits */ -if (!create_branch (ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&instr, ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ; }
@@ -574,6 +579,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)static int __ftrace_make_call (struct dyn_ftrace *rec,unsigned long addr) { +int err;unsigned int op;unsigned long ip = rec->ip;
@@ -594,9 +600,9 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }/* create the branch to the trampoline */ - op =create_branch ((unsigned int *)ip, - rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); -if (!op) { + err =create_branch (&op, (unsigned int *)ip, + rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); +if (!err) {pr_err ("REL24 out of range!\n" );return -EINVAL ; }
@@ -776,7 +782,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* Ensure branch is within 24 bits */ -if (!create_branch ((unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&op, (unsigned int *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ; }
arch/powerpc/lib/code-patching.c +78 -55
323 lines not on this page · raw message
arch/powerpc/lib/feature-fixups.c +3 -2
@@ -44,6 +44,7 @@ static unsigned int *calc_addr(struct fixup_entry *fcur, long offset)static int patch_alt_instruction (unsigned int *src,unsigned int *dest,unsigned int *alt_start,unsigned int *alt_end) { +int err;unsigned int instr; instr = *src;
@@ -53,8 +54,8 @@ static int patch_alt_instruction(unsigned int *src, unsigned int *dest,/* Branch within the section doesn't need translating */ if (target < alt_start || target > alt_end) { - instr =translate_branch (dest, src); -if (!instr) + err =translate_branch (&instr, dest, src); +if (err)return 1 ; } }
Signature · 1 line
2.17.1
kbuild test robot
build botRe: [PATCH v5 03/21] powerpc: Change calling convention for create_branch() et. al.
Thank you for the patch! Yet something to improve:
Hi Jordan,
Thank you for the patch! Yet something to improve:
[auto build test ERROR on v5.6]
[also build test ERROR on next-20200406]
[cannot apply to powerpc/next kvm-ppc/kvm-ppc-next scottwood/next] [if your patch is applied to the wrong git tree, please drop us a note to help improve the system. BTW, we also suggest to use '--base' option to specify the base tree in git format-patch, please see https://stackoverflow.com/a/37406982]
url: https://github.com/0day-ci/linux/commits/Jordan-Niethe/Initial-Prefixed-Instruction-support/20200406-165215 base: 7111951b8d4973bda27ff663f2cf18b663d15b48 config: powerpc-allnoconfig (attached as .config) compiler: powerpc-linux-gcc (GCC) 9.3.0
reproduce:
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin/make.cross
# save the attached .config to linux build tree
GCC_VERSION=9.3.0 make.cross ARCH=powerpc
If you fix the issue, kindly add following tag as appropriate
All errors (new ones prefixed by >>):
arch/powerpc/kernel/setup_32.c: In function 'machine_init':
>> arch/powerpc/kernel/setup_32.c:91:21: error: passing argument 1 of 'create_cond_branch' from incompatible pointer type [-Werror=incompatible-pointer-types]
91 | create_cond_branch(&insn, addr, branch_target(addr), 0x820000);
| ^~~~~
| |
| long unsigned int * In file included from arch/powerpc/kernel/setup_32.c:42:
arch/powerpc/include/asm/code-patching.h:27:38: note: expected 'unsigned int *' but argument is of type 'long unsigned int *'
27 | int create_cond_branch(unsigned int *instr, const unsigned int *addr,
| ~~~~~~~~~~~~~~^~~~~
cc1: all warnings being treated as errors
vim +/create_cond_branch +91 arch/powerpc/kernel/setup_32.c
67
68 /*
69 * This is run before start_kernel(), the kernel has been relocated
70 * and we are running with enough of the MMU enabled to have our
71 * proper kernel virtual addresses
72 *
73 * We do the initial parsing of the flat device-tree and prepares
74 * for the MMU to be fully initialized.
75 */
76 notrace void __init machine_init(u64 dt_ptr)
77 {
78 unsigned int *addr = (unsigned int *)patch_site_addr(&patch__memset_nocache);
79 unsigned long insn;
80
81 /* Configure static keys first, now that we're relocated. */
82 setup_feature_keys();
83
84 early_ioremap_setup();
85
86 /* Enable early debugging if any specified (see udbg.h) */
87 udbg_early_init();
88
89 patch_instruction_site(&patch__memcpy_nocache, PPC_INST_NOP);
90
> 91 create_cond_branch(&insn, addr, branch_target(addr), 0x820000);
92 patch_instruction(addr, insn); /* replace b by bne cr0 */
93
94 /* Do some early initialization based on the flat device tree */
95 early_init_devtree(__va(dt_ptr));
96
97 early_init_mmu();
98
99 setup_kdump_trampoline(); 100 }
101
---
0-DAY CI Kernel Test Service, Intel Corporation
https://lists.01.org/hyperkitty/list/kbuild-all(a)lists.01.org
Re: [PATCH v5 03/21] powerpc: Change calling convention for create_branch() et. al.
In reply to Jordan NietheQuoted 2 lines · Jordan Niethe
create_branch(),create_cond_branch()andtranslate_branch()return the instruction that they create, or return 0 to signal an error. Seperate
s/seperate/separate
Quoted 211 lines
these concerns in preparation for an instruction type that is not just an unsigned int. Fill the created instruction to a pointer passed as the first parameter to the function and use a non-zero return value to signify an error.
Signed-off-by Jordan Niethe <[email protected]>---
v5: New to series--- arch/powerpc/include/asm/code-patching.h | 12 +- arch/powerpc/kernel/optprobes.c | 24 ++-- arch/powerpc/kernel/setup_32.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 24 ++-- arch/powerpc/lib/code-patching.c | 133 +++++++++++++---------- arch/powerpc/lib/feature-fixups.c | 5 +- 6 files changed, 117 insertions(+), 83 deletions(-)arch/powerpc/include/asm/code-patching.h +6
-6@@ -22,10 +22,10 @@#define BRANCH_ABSOLUTE 0x2bool is_offset_in_branch_range (long offset); -unsigned int create_branch (const unsigned int *addr, -unsigned long target,int flags); -unsigned int create_cond_branch (const unsigned int *addr, -unsigned long target,int flags); +int create_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags); +int create_cond_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags);int patch_branch (unsigned int *addr,unsigned long target,int flags);int patch_instruction (unsigned int *addr,unsigned int instr);int raw_patch_instruction (unsigned int *addr,unsigned int instr);@@ -60,8 +60,8 @@ int instr_is_relative_branch(unsigned int instr);int instr_is_relative_link_branch (unsigned int instr);int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr);unsigned long branch_target (const unsigned int *instr); -unsigned int translate_branch (const unsigned int *dest, -const unsigned int *src); +int translate_branch (unsigned int *instr,const unsigned int *dest, +const unsigned int *src);extern bool is_conditional_branch (unsigned int instr);#ifdef CONFIG_PPC_BOOK3E_64 void __patch_exception (int exc,unsigned long addr);arch/powerpc/kernel/optprobes.c +9
-7@@ -251,15 +251,17 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) goto error; } - branch_op_callback =create_branch ((unsigned int *)buff +TMPL_CALL_HDLR_IDX , - (unsigned long )op_callback_addr, -BRANCH_SET_LINK ); + rc =create_branch (&branch_op_callback, + (unsigned int *)buff +TMPL_CALL_HDLR_IDX , + (unsigned long )op_callback_addr, +BRANCH_SET_LINK ); - branch_emulate_step =create_branch ((unsigned int *)buff +TMPL_EMULATE_IDX , - (unsigned long )emulate_step_addr, -BRANCH_SET_LINK ); + rc |=create_branch (&branch_emulate_step, + (unsigned int *)buff +TMPL_EMULATE_IDX , + (unsigned long )emulate_step_addr, +BRANCH_SET_LINK ); -if (!branch_op_callback || !branch_emulate_step) +if (rc)arch/powerpc/kernel/optprobes.c +5
-3goto error;patch_instruction (buff +TMPL_CALL_HDLR_IDX , branch_op_callback);@@ -305,6 +307,7 @@ int arch_check_optimized_kprobe(struct optimized_kprobe *op)void arch_optimize_kprobes (struct list_head *oplist) { +unsigned int instr;struct optimized_kprobe *op;struct optimized_kprobe *tmp;@@ -315,9 +318,10 @@ void arch_optimize_kprobes(struct list_head *oplist)*/ memcpy (op->optinsn.copied_insn, op->kp.addr,RELATIVEJUMP_SIZE ); -patch_instruction (op->kp.addr, -create_branch ((unsigned int *)op->kp.addr, - (unsigned long )op->optinsn.insn,0 )); +create_branch (&instr, + (unsigned int *)op->kp.addr, + (unsigned long )op->optinsn.insn,0 ); +patch_instruction (op->kp.addr, instr);list_del_init (&op->list); } }arch/powerpc/kernel/setup_32.c +1
-1@@ -88,7 +88,7 @@ notrace void __init machine_init(u64 dt_ptr)patch_instruction_site (&patch__memcpy_nocache,PPC_INST_NOP ); - insn =create_cond_branch (addr,branch_target (addr),0x820000 ); +create_cond_branch (&insn, addr,branch_target (addr),0x820000 );patch_instruction (addr, insn);/* replace b by bne cr0 */ /* Do some early initialization based on the flat device tree */ arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -48,7 +48,7 @@ ftrace_call_replace(unsigned long ip, unsigned long addr, int link) addr =ppc_function_entry ((void *)addr);/* if (link) set op to 'bl' else 'b' */ - op =create_branch ((unsigned int *)ip, addr, link ?1 :0 ); +create_branch (&op, (unsigned int *)ip, addr, link ?1 :0 );return op;}
arch/powerpc/kernel/trace/ftrace.c +2
-1@@ -89,10 +89,11 @@ ftrace_modify_code(unsigned long ip, unsigned int old,unsigned int new) */ static int test_24bit_addr (unsigned long ip,unsigned long addr) { +unsigned int op; addr =ppc_function_entry ((void *)addr);/* use the create_branch to verify that this offset can be branched */ -return create_branch ((unsigned int *)ip, addr,0 ); +return create_branch (&op, (unsigned int *)ip, addr,0 ) ==0 ; }static int
is_bl_op(unsigned int op)arch/powerpc/kernel/trace/ftrace.c +4
-1@@ -287,6 +288,7 @@ __ftrace_make_nop(struct module *mod,static unsigned long find_ftrace_tramp (unsigned long ip) {int i; +unsigned int instr;/* * We have the compiler generated long_branch tramps at the end @@ -295,7 +297,8 @@ static unsigned long find_ftrace_tramp(unsigned long ip)for (i =NUM_FTRACE_TRAMPS -1 ; i >=0 ; i--)if (!ftrace_tramps[i])continue ; -else if (create_branch ((void *)ip, ftrace_tramps[i],0 )) +else if (create_branch (&instr, (void *)ip, + ftrace_tramps[i],0 ) ==0 )return ftrace_tramps[i];return 0 ;@@ -324,6 +327,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp) {int i, op;unsigned long ptr; +unsigned int instr;static unsigned long ftrace_plt_tramps[NUM_FTRACE_TRAMPS ];arch/powerpc/kernel/trace/ftrace.c +1
-1/* Is this a known long jump tramp? */ @@ -366,7 +370,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)#else ptr =ppc_global_function_entry ((void *)ftrace_caller);#endif -if (!create_branch ((void *)tramp, ptr,0 )) { +if (create_branch (&instr, (void *)tramp, ptr,0 )) {pr_debug ("%ps is not reachable from existing mcount tramp\n" , (void *)ptr);arch/powerpc/kernel/trace/ftrace.c +2
-1return -1 ;@@ -511,6 +515,7 @@ static int __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) {unsigned int op[2 ]; +unsigned int instr;void *ip = (void *)rec->ip;unsigned long entry, ptr, tramp;struct module *mod = rec->arch.mod;@@ -557,7 +562,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }/* Ensure branch is within 24 bits */ -if (!create_branch (ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&instr, ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +1
-0}@@ -574,6 +579,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) static int__ftrace_make_call (struct dyn_ftrace *rec,unsigned long addr) { +int err;unsigned int op;unsigned long ip = rec->ip;
arch/powerpc/kernel/trace/ftrace.c __ftrace_make_call(struct dyn_ftrace *rec, unsigned long · line 606
Quoted 10 lines
arch/powerpc/kernel/trace/ftrace.c +3
-3@@ -594,9 +600,9 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }/* create the branch to the trampoline */ - op =create_branch ((unsigned int *)ip, - rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); -if (!op) { + err =create_branch (&op, (unsigned int *)ip, + rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); +if (!err) {
should this be if (err) as per your new changes ?
Quoted 170 lines
arch/powerpc/kernel/trace/ftrace.c +0
-0pr_err ("REL24 out of range!\n" );return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -776,7 +782,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* Ensure branch is within 24 bits */ -if (!create_branch ((unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&op, (unsigned int *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +0
-0}arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index3345f039a876..4af564aeedf1100644arch/powerpc/lib/code-patching.c +16
-13@@ -196,7 +196,10 @@ NOKPROBE_SYMBOL(patch_instruction);int patch_branch (unsigned int *addr,unsigned long target,int flags) { -return patch_instruction (addr,create_branch (addr, target, flags)); +unsigned int instr; + +create_branch (&instr, addr, target, flags); +return patch_instruction (addr, instr); }bool is_offset_in_branch_range (long offset)@@ -243,30 +246,30 @@ bool is_conditional_branch(unsigned int instr) }NOKPROBE_SYMBOL (is_conditional_branch); -unsigned int create_branch (const unsigned int *addr, -unsigned long target,int flags) +int create_branch (unsigned int *instr, +const unsigned int *addr, +unsigned long target,int flags) { -unsigned int instruction;long offset; + *instr =0 ; offset = target;if (! (flags &BRANCH_ABSOLUTE )) offset = offset - (unsigned long )addr;/* Check we can represent the target in the instruction format */ if (!is_offset_in_branch_range (offset)) -return 0 ; +return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - instruction =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); + *instr =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); -return instruction; +return 0 ; } -unsigned int create_cond_branch (const unsigned int *addr, -unsigned long target,int flags) +int create_cond_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags) { -unsigned int instruction;long offset; offset = target;@@ -275,12 +278,12 @@ unsigned int create_cond_branch(const unsigned int *addr,/* Check we can represent the target in the instruction format */ if (offset < -0x8000 || offset > 0x7FFF || offset & 0x3) -return 0 ; +return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - instruction =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); + *instr =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); -return instruction; +return 0 ; }static unsigned int
branch_opcode(unsigned int instr)arch/powerpc/lib/code-patching.c +4
-4@@ -361,18 +364,18 @@ int instr_is_branch_to_addr(const unsigned int *instr, unsigned long addr)return 0 ; } -unsigned int translate_branch (const unsigned int *dest,const unsigned int *src) +int translate_branch (unsigned int *instr,const unsigned int *dest,const unsigned int *src) {unsigned long target; target =branch_target (src);if (instr_is_branch_iform (*src)) -return create_branch (dest, target, *src); +return create_branch (instr, dest, target, *src);else if (instr_is_branch_bform (*src)) -return create_cond_branch (dest, target, *src); +return create_cond_branch (instr, dest, target, *src); -return 0 ; +return 1 ;}
#ifdef
CONFIG_PPC_BOOK3E_64arch/powerpc/lib/code-patching.c +12
-11@@ -403,6 +406,7 @@ static void __init test_trampoline(void)static void __init test_branch_iform (void ) { +int err;unsigned int instr;unsigned long addr;@@ -443,35 +447,35 @@ static void __init test_branch_iform(void)check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Branch to self, with link */ - instr =create_branch (&instr, addr,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr));/* Branch to self - 0x100, with link */ - instr =create_branch (&instr, addr -0x100 ,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr -0x100 ,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr -0x100 ));/* Branch to self + 0x100, no link */ - instr =create_branch (&instr, addr +0x100 ,0 ); + err =create_branch (&instr, &instr, addr +0x100 ,0 );check (instr_is_branch_to_addr (&instr, addr +0x100 ));/* Maximum relative negative offset, - 32 MB */ - instr =create_branch (&instr, addr -0x2000000 ,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr -0x2000000 ,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Out of range relative negative offset, - 32 MB + 4*/ - instr =create_branch (&instr, addr -0x2000004 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr -0x2000004 ,BRANCH_SET_LINK ); +check (err);/* Out of range relative positive offset, + 32 MB */ - instr =create_branch (&instr, addr +0x2000000 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr +0x2000000 ,BRANCH_SET_LINK ); +check (err);/* Unaligned target */ - instr =create_branch (&instr, addr +3 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr +3 ,BRANCH_SET_LINK ); +check (err);/* Check flags are masked correctly */ - instr =create_branch (&instr, addr,0xFFFFFFFC ); + err =create_branch (&instr, &instr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr));check (instr ==0x48000000 ); }@@ -480,16 +484,19 @@ static void __init test_create_function_call(void) {
arch/powerpc/lib/code-patching.c static void __init test_create_function_call(void) · line 493
Quoted 10 lines
arch/powerpc/lib/code-patching.c +3
-1unsigned int *iptr;unsigned long dest; +unsigned int instr;/* Check we can create a function call */ iptr = (unsigned int *)ppc_function_entry (test_trampoline); dest =ppc_function_entry (test_create_function_call); -patch_instruction (iptr,create_branch (iptr, dest,BRANCH_SET_LINK )); +create_branch (&instr, iptr, dest,BRANCH_SET_LINK ); +patch_instruction (iptr, instr);
Are we sure that create_branch() would always succeed here to do patch_instruction() ?
Quoted 65 lines
arch/powerpc/lib/code-patching.c +13
-11check (instr_is_branch_to_addr (iptr, dest)); }static void __init test_branch_bform (void ) { +int err;unsigned long addr;unsigned int *iptr, instr, flags;@@ -525,35 +532,35 @@ static void __init test_branch_bform(void) flags =0x3ff000 |BRANCH_SET_LINK ;/* Branch to self */ - instr =create_cond_branch (iptr, addr, flags); + err =create_cond_branch (&instr, iptr, addr, flags);check (instr_is_branch_to_addr (&instr, addr));/* Branch to self - 0x100 */ - instr =create_cond_branch (iptr, addr -0x100 , flags); + err =create_cond_branch (&instr, iptr, addr -0x100 , flags);check (instr_is_branch_to_addr (&instr, addr -0x100 ));/* Branch to self + 0x100 */ - instr =create_cond_branch (iptr, addr +0x100 , flags); + err =create_cond_branch (&instr, iptr, addr +0x100 , flags);check (instr_is_branch_to_addr (&instr, addr +0x100 ));/* Maximum relative negative offset, - 32 KB */ - instr =create_cond_branch (iptr, addr -0x8000 , flags); + err =create_cond_branch (&instr, iptr, addr -0x8000 , flags);check (instr_is_branch_to_addr (&instr, addr -0x8000 ));/* Out of range relative negative offset, - 32 KB + 4*/ - instr =create_cond_branch (iptr, addr -0x8004 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr -0x8004 , flags); +check (err);/* Out of range relative positive offset, + 32 KB */ - instr =create_cond_branch (iptr, addr +0x8000 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr +0x8000 , flags); +check (err);/* Unaligned target */ - instr =create_cond_branch (iptr, addr +3 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr +3 , flags); +check (err);/* Check flags are masked correctly */ - instr =create_cond_branch (iptr, addr,0xFFFFFFFC ); + err =create_cond_branch (&instr, iptr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr));check (instr ==0x43FF0000 ); }@@ -562,6 +569,7 @@ static void __init test_translate_branch(void) {unsigned long addr;unsigned int *p, *q; +unsigned int instr;void *buf; buf =vmalloc (PAGE_ALIGN (0x2000000 +1 ));
arch/powerpc/lib/code-patching.c static void __init test_translate_branch(void) · line 587
Quoted 6 lines
arch/powerpc/lib/code-patching.c +2
-1@@ -575,7 +583,8 @@ static void __init test_translate_branch(void)patch_branch (p, addr,0 );check (instr_is_branch_to_addr (p, addr)); q = p +1 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);
same here and elsewhere in similar such places where we do patch_instruction()
-- Bala
Quoted 138 lines
arch/powerpc/lib/code-patching.c +28
-14check (instr_is_branch_to_addr (q, addr));/* Maximum negative case, move b . to addr + 32 MB */ @@ -583,7 +592,8 @@ static void __init test_translate_branch(void) addr = (unsigned long )p;patch_branch (p, addr,0 ); q = buf +0x2000000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x4a000000 );@@ -593,7 +603,8 @@ static void __init test_translate_branch(void) addr = (unsigned long )p;patch_branch (p, addr,0 ); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x49fffffc );@@ -603,7 +614,8 @@ static void __init test_translate_branch(void) addr =0x1000000 + (unsigned long )buf;patch_branch (p, addr,BRANCH_SET_LINK ); q = buf +0x1400000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));@@ -612,7 +624,8 @@ static void __init test_translate_branch(void) addr =0x2000000 + (unsigned long )buf;patch_branch (p, addr,0 ); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));@@ -622,18 +635,22 @@ static void __init test_translate_branch(void)/* Simple case, branch to self moved a little */ p = buf; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0 )); +create_cond_branch (&instr, p, addr,0 ); +patch_instruction (p, instr);check (instr_is_branch_to_addr (p, addr)); q = p +1 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (q, addr));/* Maximum negative case, move b . to addr + 32 KB */ p = buf; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0xFFFFFFFC )); +create_cond_branch (&instr, p, addr,0xFFFFFFFC ); +patch_instruction (p, instr); q = buf +0x8000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x43ff8000 );@@ -641,9 +658,11 @@ static void __init test_translate_branch(void)/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0xFFFFFFFC )); +create_cond_branch (&instr, p, addr,0xFFFFFFFC ); +patch_instruction (p, instr); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x43ff7ffc );@@ -651,18 +670,22 @@ static void __init test_translate_branch(void)/* Jump to x + 12 KB moved to x + 20 KB */ p = buf; addr =0x3000 + (unsigned long )buf; -patch_instruction (p,create_cond_branch (p, addr,BRANCH_SET_LINK )); +create_cond_branch (&instr, p, addr,BRANCH_SET_LINK ); +patch_instruction (p, instr); q = buf +0x5000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));/* Jump to x + 8 KB moved to x - 8 KB + 4 */ p = buf +0x2000 ; addr =0x4000 + (unsigned long )buf; -patch_instruction (p,create_cond_branch (p, addr,0 )); +create_cond_branch (&instr, p, addr,0 ); +patch_instruction (p, instr); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
index4ba634b89ce5..b129d7b4e7dd100644arch/powerpc/lib/feature-fixups.c +1
-0@@ -44,6 +44,7 @@ static unsigned int *calc_addr(struct fixup_entry *fcur, long offset)static int patch_alt_instruction (unsigned int *src,unsigned int *dest,unsigned int *alt_start,unsigned int *alt_end) { +int err;unsigned int instr;arch/powerpc/lib/feature-fixups.c +2
-2instr = *src;@@ -53,8 +54,8 @@ static int patch_alt_instruction(unsigned int *src,unsigned int *dest,/* Branch within the section doesn't need translating */ if (target < alt_start || target > alt_end) { - instr = translate_branch(dest, src); -if (!instr) + err = translate_branch(&instr, dest, src); +if (err)return 1 ; }}
Re: [PATCH v5 03/21] powerpc: Change calling convention for create_branch() et. al.
Quoted 6 lines · Balamuruhan S
Quoted 2 lines · Jordan Niethe
create_branch(),create_cond_branch()andtranslate_branch()return the instruction that they create, or return 0 to signal an error. Seperates/seperate/separate
thanks.
Quoted 215 lines
Quoted 215 lines
these concerns in preparation for an instruction type that is not just an unsigned int. Fill the created instruction to a pointer passed as the first parameter to the function and use a non-zero return value to signify an error.
Signed-off-by Jordan Niethe <[email protected]>---
v5: New to series--- arch/powerpc/include/asm/code-patching.h | 12 +- arch/powerpc/kernel/optprobes.c | 24 ++-- arch/powerpc/kernel/setup_32.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 24 ++-- arch/powerpc/lib/code-patching.c | 133 +++++++++++++---------- arch/powerpc/lib/feature-fixups.c | 5 +- 6 files changed, 117 insertions(+), 83 deletions(-)arch/powerpc/include/asm/code-patching.h +6
-6@@ -22,10 +22,10 @@#define BRANCH_ABSOLUTE 0x2bool is_offset_in_branch_range (long offset); -unsigned int create_branch (const unsigned int *addr, -unsigned long target,int flags); -unsigned int create_cond_branch (const unsigned int *addr, -unsigned long target,int flags); +int create_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags); +int create_cond_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags);int patch_branch (unsigned int *addr,unsigned long target,int flags);int patch_instruction (unsigned int *addr,unsigned int instr);int raw_patch_instruction (unsigned int *addr,unsigned int instr);@@ -60,8 +60,8 @@ int instr_is_relative_branch(unsigned int instr);int instr_is_relative_link_branch (unsigned int instr);int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr);unsigned long branch_target (const unsigned int *instr); -unsigned int translate_branch (const unsigned int *dest, -const unsigned int *src); +int translate_branch (unsigned int *instr,const unsigned int *dest, +const unsigned int *src);extern bool is_conditional_branch (unsigned int instr);#ifdef CONFIG_PPC_BOOK3E_64 void __patch_exception (int exc,unsigned long addr);arch/powerpc/kernel/optprobes.c +9
-7@@ -251,15 +251,17 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) goto error; } - branch_op_callback =create_branch ((unsigned int *)buff +TMPL_CALL_HDLR_IDX , - (unsigned long )op_callback_addr, -BRANCH_SET_LINK ); + rc =create_branch (&branch_op_callback, + (unsigned int *)buff +TMPL_CALL_HDLR_IDX , + (unsigned long )op_callback_addr, +BRANCH_SET_LINK ); - branch_emulate_step =create_branch ((unsigned int *)buff +TMPL_EMULATE_IDX , - (unsigned long )emulate_step_addr, -BRANCH_SET_LINK ); + rc |=create_branch (&branch_emulate_step, + (unsigned int *)buff +TMPL_EMULATE_IDX , + (unsigned long )emulate_step_addr, +BRANCH_SET_LINK ); -if (!branch_op_callback || !branch_emulate_step) +if (rc)goto error; patch_instruction(buff + TMPL_CALL_HDLR_IDX, branch_op_callback);arch/powerpc/kernel/optprobes.c +5
-3@@ -305,6 +307,7 @@ int arch_check_optimized_kprobe(struct optimized_kprobe *op)void arch_optimize_kprobes (struct list_head *oplist) { +unsigned int instr;struct optimized_kprobe *op;struct optimized_kprobe *tmp;@@ -315,9 +318,10 @@ void arch_optimize_kprobes(struct list_head *oplist)*/ memcpy (op->optinsn.copied_insn, op->kp.addr,RELATIVEJUMP_SIZE ); -patch_instruction (op->kp.addr, -create_branch ((unsigned int *)op->kp.addr, - (unsigned long )op->optinsn.insn,0 )); +create_branch (&instr, + (unsigned int *)op->kp.addr, + (unsigned long )op->optinsn.insn,0 ); +patch_instruction (op->kp.addr, instr);list_del_init (&op->list); } }arch/powerpc/kernel/setup_32.c +1
-1@@ -88,7 +88,7 @@ notrace void __init machine_init(u64 dt_ptr)patch_instruction_site (&patch__memcpy_nocache,PPC_INST_NOP ); - insn =create_cond_branch (addr,branch_target (addr),0x820000 ); +create_cond_branch (&insn, addr,branch_target (addr),0x820000 );patch_instruction (addr, insn);/* replace b by bne cr0 */ /* Do some early initialization based on the flat device tree */ arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -48,7 +48,7 @@ ftrace_call_replace(unsigned long ip, unsigned long addr, int link) addr =ppc_function_entry ((void *)addr);/* if (link) set op to 'bl' else 'b' */ - op =create_branch ((unsigned int *)ip, addr, link ?1 :0 ); +create_branch (&op, (unsigned int *)ip, addr, link ?1 :0 );return op;}
arch/powerpc/kernel/trace/ftrace.c +2
-1@@ -89,10 +89,11 @@ ftrace_modify_code(unsigned long ip, unsigned int old,unsigned int new) */ static int test_24bit_addr (unsigned long ip,unsigned long addr) { +unsigned int op; addr =ppc_function_entry ((void *)addr);/* use the create_branch to verify that this offset can be branched */ -return create_branch ((unsigned int *)ip, addr,0 ); +return create_branch (&op, (unsigned int *)ip, addr,0 ) ==0 ; }static int
is_bl_op(unsigned int op)arch/powerpc/kernel/trace/ftrace.c +4
-1@@ -287,6 +288,7 @@ __ftrace_make_nop(struct module *mod,static unsigned long find_ftrace_tramp (unsigned long ip) {int i; +unsigned int instr;/* * We have the compiler generated long_branch tramps at the end @@ -295,7 +297,8 @@ static unsigned long find_ftrace_tramp(unsigned long ip)for (i =NUM_FTRACE_TRAMPS -1 ; i >=0 ; i--)if (!ftrace_tramps[i])continue ; -else if (create_branch ((void *)ip, ftrace_tramps[i],0 )) +else if (create_branch (&instr, (void *)ip, + ftrace_tramps[i],0 ) ==0 )return ftrace_tramps[i];return 0 ;@@ -324,6 +327,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp) {int i, op;unsigned long ptr; +unsigned int instr;static unsigned long ftrace_plt_tramps[NUM_FTRACE_TRAMPS ];/* Is this a known long jump tramp? */arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -366,7 +370,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)#else ptr =ppc_global_function_entry ((void *)ftrace_caller);#endif -if (!create_branch ((void *)tramp, ptr,0 )) { +if (create_branch (&instr, (void *)tramp, ptr,0 )) {pr_debug ("%ps is not reachable from existing mcount tramp\n" , (void *)ptr);return -1;arch/powerpc/kernel/trace/ftrace.c +2
-1@@ -511,6 +515,7 @@ static int __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) {unsigned int op[2 ]; +unsigned int instr;void *ip = (void *)rec->ip;unsigned long entry, ptr, tramp;struct module *mod = rec->arch.mod;@@ -557,7 +562,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }/* Ensure branch is within 24 bits */ -if (!create_branch (ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&instr, ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ;}arch/powerpc/kernel/trace/ftrace.c +1
-0@@ -574,6 +579,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) static int__ftrace_make_call (struct dyn_ftrace *rec,unsigned long addr) { +int err;unsigned int op;unsigned long ip = rec->ip;@@ -594,9 +600,9 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }
Quoted 10 lines
arch/powerpc/kernel/trace/ftrace.c __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) · line 605
Quoted 7 lines
arch/powerpc/kernel/trace/ftrace.c +3
-3/* create the branch to the trampoline */ - op =create_branch ((unsigned int *)ip, - rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); -if (!op) { + err =create_branch (&op, (unsigned int *)ip, + rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); +if (!err) {should this be
if (err)as per your new changes ?
You are right.
Quoted 251 lines
Quoted 172 lines
arch/powerpc/kernel/trace/ftrace.c +0
-0pr_err ("REL24 out of range!\n" );return -EINVAL ;}arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -776,7 +782,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* Ensure branch is within 24 bits */ -if (!create_branch ((unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&op, (unsigned int *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ;}arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index3345f039a876..4af564aeedf1100644arch/powerpc/lib/code-patching.c +16
-13@@ -196,7 +196,10 @@ NOKPROBE_SYMBOL(patch_instruction);int patch_branch (unsigned int *addr,unsigned long target,int flags) { -return patch_instruction (addr,create_branch (addr, target, flags)); +unsigned int instr; + +create_branch (&instr, addr, target, flags); +return patch_instruction (addr, instr); }bool is_offset_in_branch_range (long offset)@@ -243,30 +246,30 @@ bool is_conditional_branch(unsigned int instr) }NOKPROBE_SYMBOL (is_conditional_branch); -unsigned int create_branch (const unsigned int *addr, -unsigned long target,int flags) +int create_branch (unsigned int *instr, +const unsigned int *addr, +unsigned long target,int flags) { -unsigned int instruction;long offset; + *instr =0 ; offset = target;if (! (flags &BRANCH_ABSOLUTE )) offset = offset - (unsigned long )addr;/* Check we can represent the target in the instruction format */ if (!is_offset_in_branch_range (offset)) -return 0 ; +return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - instruction =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); + *instr =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); -return instruction; +return 0 ; } -unsigned int create_cond_branch (const unsigned int *addr, -unsigned long target,int flags) +int create_cond_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags) { -unsigned int instruction;long offset; offset = target;@@ -275,12 +278,12 @@ unsigned int create_cond_branch(const unsigned int *addr,/* Check we can represent the target in the instruction format */ if (offset < -0x8000 || offset > 0x7FFF || offset & 0x3) -return 0 ; +return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - instruction =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); + *instr =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); -return instruction; +return 0 ; }static unsigned int
branch_opcode(unsigned int instr)arch/powerpc/lib/code-patching.c +4
-4@@ -361,18 +364,18 @@ int instr_is_branch_to_addr(const unsigned int *instr, unsigned long addr)return 0 ; } -unsigned int translate_branch (const unsigned int *dest,const unsigned int *src) +int translate_branch (unsigned int *instr,const unsigned int *dest,const unsigned int *src) {unsigned long target; target =branch_target (src);if (instr_is_branch_iform (*src)) -return create_branch (dest, target, *src); +return create_branch (instr, dest, target, *src);else if (instr_is_branch_bform (*src)) -return create_cond_branch (dest, target, *src); +return create_cond_branch (instr, dest, target, *src); -return 0 ; +return 1 ;}
#ifdef
CONFIG_PPC_BOOK3E_64arch/powerpc/lib/code-patching.c +12
-11@@ -403,6 +406,7 @@ static void __init test_trampoline(void)static void __init test_branch_iform (void ) { +int err;unsigned int instr;unsigned long addr;@@ -443,35 +447,35 @@ static void __init test_branch_iform(void)check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Branch to self, with link */ - instr =create_branch (&instr, addr,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr));/* Branch to self - 0x100, with link */ - instr =create_branch (&instr, addr -0x100 ,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr -0x100 ,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr -0x100 ));/* Branch to self + 0x100, no link */ - instr =create_branch (&instr, addr +0x100 ,0 ); + err =create_branch (&instr, &instr, addr +0x100 ,0 );check (instr_is_branch_to_addr (&instr, addr +0x100 ));/* Maximum relative negative offset, - 32 MB */ - instr =create_branch (&instr, addr -0x2000000 ,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr -0x2000000 ,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Out of range relative negative offset, - 32 MB + 4*/ - instr =create_branch (&instr, addr -0x2000004 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr -0x2000004 ,BRANCH_SET_LINK ); +check (err);/* Out of range relative positive offset, + 32 MB */ - instr =create_branch (&instr, addr +0x2000000 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr +0x2000000 ,BRANCH_SET_LINK ); +check (err);/* Unaligned target */ - instr =create_branch (&instr, addr +3 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr +3 ,BRANCH_SET_LINK ); +check (err);/* Check flags are masked correctly */ - instr =create_branch (&instr, addr,0xFFFFFFFC ); + err =create_branch (&instr, &instr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr));check (instr ==0x48000000 ); }@@ -480,16 +484,19 @@ static void __init test_create_function_call(void) {arch/powerpc/lib/code-patching.c static void __init test_create_function_call(void) · line 493
Quoted 10 lines
arch/powerpc/lib/code-patching.c +3
-1unsigned int *iptr;unsigned long dest; +unsigned int instr;/* Check we can create a function call */ iptr = (unsigned int *)ppc_function_entry (test_trampoline); dest =ppc_function_entry (test_create_function_call); -patch_instruction (iptr,create_branch (iptr, dest,BRANCH_SET_LINK )); +create_branch (&instr, iptr, dest,BRANCH_SET_LINK ); +patch_instruction (iptr, instr);Are we sure that
create_branch()would always succeed here to dopatch_instruction()?Quoted 63 lines
arch/powerpc/lib/code-patching.c +13
-11check (instr_is_branch_to_addr (iptr, dest)); }static void __init test_branch_bform (void ) { +int err;unsigned long addr;unsigned int *iptr, instr, flags;@@ -525,35 +532,35 @@ static void __init test_branch_bform(void) flags =0x3ff000 |BRANCH_SET_LINK ;/* Branch to self */ - instr =create_cond_branch (iptr, addr, flags); + err =create_cond_branch (&instr, iptr, addr, flags);check (instr_is_branch_to_addr (&instr, addr));/* Branch to self - 0x100 */ - instr =create_cond_branch (iptr, addr -0x100 , flags); + err =create_cond_branch (&instr, iptr, addr -0x100 , flags);check (instr_is_branch_to_addr (&instr, addr -0x100 ));/* Branch to self + 0x100 */ - instr =create_cond_branch (iptr, addr +0x100 , flags); + err =create_cond_branch (&instr, iptr, addr +0x100 , flags);check (instr_is_branch_to_addr (&instr, addr +0x100 ));/* Maximum relative negative offset, - 32 KB */ - instr =create_cond_branch (iptr, addr -0x8000 , flags); + err =create_cond_branch (&instr, iptr, addr -0x8000 , flags);check (instr_is_branch_to_addr (&instr, addr -0x8000 ));/* Out of range relative negative offset, - 32 KB + 4*/ - instr =create_cond_branch (iptr, addr -0x8004 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr -0x8004 , flags); +check (err);/* Out of range relative positive offset, + 32 KB */ - instr =create_cond_branch (iptr, addr +0x8000 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr +0x8000 , flags); +check (err);/* Unaligned target */ - instr =create_cond_branch (iptr, addr +3 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr +3 , flags); +check (err);/* Check flags are masked correctly */ - instr =create_cond_branch (iptr, addr,0xFFFFFFFC ); + err =create_cond_branch (&instr, iptr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr));check (instr ==0x43FF0000 ); }@@ -562,6 +569,7 @@ static void __init test_translate_branch(void) {unsigned long addr;unsigned int *p, *q; +unsigned int instr;void *buf;
Quoted 11 lines
arch/powerpc/lib/code-patching.c static void __init test_translate_branch(void) · line 587
Quoted 8 lines
arch/powerpc/lib/code-patching.c +2
-1buf =vmalloc (PAGE_ALIGN (0x2000000 +1 ));@@ -575,7 +583,8 @@ static void __init test_translate_branch(void)patch_branch (p, addr,0 );check (instr_is_branch_to_addr (p, addr)); q = p +1 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);same here and elsewhere in similar such places where we do
patch_instruction()
I figured that if the existing code was not checking the return then we probably did not need to add a check.
Quoted 142 lines
-- Bala
Quoted 138 lines
arch/powerpc/lib/code-patching.c +28
-14check (instr_is_branch_to_addr (q, addr));/* Maximum negative case, move b . to addr + 32 MB */ @@ -583,7 +592,8 @@ static void __init test_translate_branch(void) addr = (unsigned long )p;patch_branch (p, addr,0 ); q = buf +0x2000000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x4a000000 );@@ -593,7 +603,8 @@ static void __init test_translate_branch(void) addr = (unsigned long )p;patch_branch (p, addr,0 ); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x49fffffc );@@ -603,7 +614,8 @@ static void __init test_translate_branch(void) addr =0x1000000 + (unsigned long )buf;patch_branch (p, addr,BRANCH_SET_LINK ); q = buf +0x1400000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));@@ -612,7 +624,8 @@ static void __init test_translate_branch(void) addr =0x2000000 + (unsigned long )buf;patch_branch (p, addr,0 ); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));@@ -622,18 +635,22 @@ static void __init test_translate_branch(void)/* Simple case, branch to self moved a little */ p = buf; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0 )); +create_cond_branch (&instr, p, addr,0 ); +patch_instruction (p, instr);check (instr_is_branch_to_addr (p, addr)); q = p +1 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (q, addr));/* Maximum negative case, move b . to addr + 32 KB */ p = buf; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0xFFFFFFFC )); +create_cond_branch (&instr, p, addr,0xFFFFFFFC ); +patch_instruction (p, instr); q = buf +0x8000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x43ff8000 );@@ -641,9 +658,11 @@ static void __init test_translate_branch(void)/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0xFFFFFFFC )); +create_cond_branch (&instr, p, addr,0xFFFFFFFC ); +patch_instruction (p, instr); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x43ff7ffc );@@ -651,18 +670,22 @@ static void __init test_translate_branch(void)/* Jump to x + 12 KB moved to x + 20 KB */ p = buf; addr =0x3000 + (unsigned long )buf; -patch_instruction (p,create_cond_branch (p, addr,BRANCH_SET_LINK )); +create_cond_branch (&instr, p, addr,BRANCH_SET_LINK ); +patch_instruction (p, instr); q = buf +0x5000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));/* Jump to x + 8 KB moved to x - 8 KB + 4 */ p = buf +0x2000 ; addr =0x4000 + (unsigned long )buf; -patch_instruction (p,create_cond_branch (p, addr,0 )); +create_cond_branch (&instr, p, addr,0 ); +patch_instruction (p, instr); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
index4ba634b89ce5..b129d7b4e7dd100644arch/powerpc/lib/feature-fixups.c +1
-0@@ -44,6 +44,7 @@ static unsigned int *calc_addr(struct fixup_entry *fcur, long offset)static int patch_alt_instruction (unsigned int *src,unsigned int *dest,unsigned int *alt_start,unsigned int *alt_end) { +int err;unsigned int instr;instr = *src;arch/powerpc/lib/feature-fixups.c +2
-2@@ -53,8 +54,8 @@ static int patch_alt_instruction(unsigned int *src,unsigned int *dest,/* Branch within the section doesn't need translating */ if (target < alt_start || target > alt_end) { - instr =translate_branch (dest, src); -if (!instr) + err =translate_branch (&instr, dest, src); +if (err)return 1 ; }}
Re: [PATCH v5 03/21] powerpc: Change calling convention for create_branch() et. al.
Quoted 512 lines · Jordan Niethe
Quoted 5 lines · Balamuruhan S
Quoted 2 lines · Jordan Niethe
create_branch(),create_cond_branch()andtranslate_branch()return the instruction that they create, or return 0 to signal an error. Seperates/seperate/separate
thanks.
Quoted 225 lines
Quoted 225 lines
these concerns in preparation for an instruction type that is not just an unsigned int. Fill the created instruction to a pointer passed as the first parameter to the function and use a non-zero return value to signify an error.
Signed-off-by Jordan Niethe <[email protected]>---
v5: New to series--- arch/powerpc/include/asm/code-patching.h | 12 +- arch/powerpc/kernel/optprobes.c | 24 ++-- arch/powerpc/kernel/setup_32.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 24 ++-- arch/powerpc/lib/code-patching.c | 133 +++++++++++++---------- arch/powerpc/lib/feature-fixups.c | 5 +- 6 files changed, 117 insertions(+), 83 deletions(-)arch/powerpc/include/asm/code-patching.h +6
-6@@ -22,10 +22,10 @@#define BRANCH_ABSOLUTE 0x2bool is_offset_in_branch_range (long offset); -unsigned int create_branch (const unsigned int *addr, -unsigned long target,int flags); -unsigned int create_cond_branch (const unsigned int *addr, -unsigned long target,int flags); +int create_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags); +int create_cond_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags);int patch_branch (unsigned int *addr,unsigned long target,int flags);int patch_instruction (unsigned int *addr,unsigned int instr);int raw_patch_instruction (unsigned int *addr,unsigned int instr);@@ -60,8 +60,8 @@ int instr_is_relative_branch(unsigned int instr);int instr_is_relative_link_branch (unsigned int instr);int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr);unsigned long branch_target (const unsigned int *instr); -unsigned int translate_branch (const unsigned int *dest, -const unsigned int *src); +int translate_branch (unsigned int *instr,const unsigned int *dest, +const unsigned int *src);extern bool is_conditional_branch (unsigned int instr);#ifdef CONFIG_PPC_BOOK3E_64 void
__patch_exception(int exc, unsigned long addr);arch/powerpc/kernel/optprobes.c +9
-7@@ -251,15 +251,17 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) goto error; } - branch_op_callback =create_branch ((unsigned int *)buff +TMPL_CALL_HDLR_IDX , - (unsigned long )op_callback_addr, -BRANCH_SET_LINK ); + rc =create_branch (&branch_op_callback, + (unsigned int *)buff +TMPL_CALL_HDLR_IDX , + (unsigned long )op_callback_addr, +BRANCH_SET_LINK ); - branch_emulate_step =create_branch ((unsigned int *)buff +TMPL_EMULATE_IDX , - (unsigned long )emulate_step_addr, -BRANCH_SET_LINK ); + rc |=create_branch (&branch_emulate_step, + (unsigned int *)buff +TMPL_EMULATE_IDX , + (unsigned long )emulate_step_addr, +BRANCH_SET_LINK ); -if (!branch_op_callback || !branch_emulate_step) +if (rc)goto error; patch_instruction(buff + TMPL_CALL_HDLR_IDX, branch_op_callback);arch/powerpc/kernel/optprobes.c +0
-0@@ -305,6 +307,7 @@ int arch_check_optimized_kprobe(struct
optimized_kprobe
*op)void
arch_optimize_kprobes(struct list_head *oplist){arch/powerpc/kernel/optprobes.c +5
-3+unsigned int instr;struct optimized_kprobe *op;struct optimized_kprobe *tmp;@@ -315,9 +318,10 @@ void arch_optimize_kprobes(struct list_head *oplist)*/ memcpy (op->optinsn.copied_insn, op->kp.addr,RELATIVEJUMP_SIZE ); -patch_instruction (op->kp.addr, -create_branch ((unsigned int *)op->kp.addr, - (unsigned long )op->optinsn.insn,0 )); +create_branch (&instr, + (unsigned int *)op->kp.addr, + (unsigned long )op->optinsn.insn,0 ); +patch_instruction (op->kp.addr, instr);list_del_init (&op->list); } }arch/powerpc/kernel/setup_32.c +1
-1@@ -88,7 +88,7 @@ notrace void __init machine_init(u64 dt_ptr)patch_instruction_site (&patch__memcpy_nocache,PPC_INST_NOP ); - insn =create_cond_branch (addr,branch_target (addr),0x820000 ); +create_cond_branch (&insn, addr,branch_target (addr),0x820000 );patch_instruction (addr, insn);/* replace b by bne cr0 */ /* Do some early initialization based on the flat device tree */ arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -48,7 +48,7 @@ ftrace_call_replace(unsigned long ip, unsigned long addr, int link) addr =ppc_function_entry ((void *)addr);/* if (link) set op to 'bl' else 'b' */ - op =create_branch ((unsigned int *)ip, addr, link ?1 :0 ); +create_branch (&op, (unsigned int *)ip, addr, link ?1 :0 );return op;}
arch/powerpc/kernel/trace/ftrace.c +2
-1@@ -89,10 +89,11 @@ ftrace_modify_code(unsigned long ip, unsigned intold, unsigned int new) */ static int test_24bit_addr (unsigned long ip,unsigned long addr) { +unsigned int op; addr =ppc_function_entry ((void *)addr);/* use the create_branch to verify that this offset can be branched */ -return create_branch ((unsigned int *)ip, addr,0 ); +return create_branch (&op, (unsigned int *)ip, addr,0 ) ==0 ;}
static int
is_bl_op(unsigned int op)arch/powerpc/kernel/trace/ftrace.c +3
-1@@ -287,6 +288,7 @@ __ftrace_make_nop(struct module *mod,static unsigned long find_ftrace_tramp (unsigned long ip) {int i; +unsigned int instr;/* * We have the compiler generated long_branch tramps at the end @@ -295,7 +297,8 @@ static unsigned long find_ftrace_tramp(unsigned long ip)for (i =NUM_FTRACE_TRAMPS -1 ; i >=0 ; i--)if (!ftrace_tramps[i])continue ; -else if (create_branch ((void *)ip, ftrace_tramps[i],0 )) +else if (create_branch (&instr, (void *)ip, + ftrace_tramps[i],0 ) ==0 )return ftrace_tramps[i];return 0;arch/powerpc/kernel/trace/ftrace.c +1
-0@@ -324,6 +327,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp) {int i, op;unsigned long ptr; +unsigned int instr;static unsigned long ftrace_plt_tramps[NUM_FTRACE_TRAMPS ];/* Is this a known long jump tramp? */arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -366,7 +370,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)#else ptr =ppc_global_function_entry ((void *)ftrace_caller);#endif -if (!create_branch ((void *)tramp, ptr,0 )) { +if (create_branch (&instr, (void *)tramp, ptr,0 )) { pr_debug("%ps is not reachable from existing mcount tramp\n",(void *)ptr); return -1;arch/powerpc/kernel/trace/ftrace.c +1
-0@@ -511,6 +515,7 @@ static int __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) {unsigned int op[2 ]; +unsigned int instr;void *ip = (void *)rec->ip;unsigned long entry, ptr, tramp;struct module *mod = rec->arch.mod;@@ -557,7 +562,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsignedlong
addr)} /* Ensure branch is within 24 bits */arch/powerpc/kernel/trace/ftrace.c +1
-1-if (!create_branch (ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&instr, ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ; }@@ -574,6 +579,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsignedlong
addr)
static int
__ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr){arch/powerpc/kernel/trace/ftrace.c +1
-0+int err;unsigned int op;unsigned long ip = rec->ip;@@ -594,9 +600,9 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsignedlong
addr)}Quoted 9 lines
arch/powerpc/kernel/trace/ftrace.c __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) · line 605
Quoted 7 lines
/* create the branch to the trampoline */arch/powerpc/kernel/trace/ftrace.c +3
-3- op =create_branch ((unsigned int *)ip, - rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); -if (!op) { + err =create_branch (&op, (unsigned int *)ip, + rec->arch.mod->arch.tramp,BRANCH_SET_LINK ); +if (!err) {should this be
if (err)as per your new changes ?You are right.
Quoted 259 lines
Quoted 181 lines
pr_err("REL24 out of range!\n"); return -EINVAL; }arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -776,7 +782,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* Ensure branch is within 24 bits */ -if (!create_branch ((unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&op, (unsigned int *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL; }arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index3345f039a876..4af564aeedf1100644arch/powerpc/lib/code-patching.c +13
-10@@ -196,7 +196,10 @@ NOKPROBE_SYMBOL(patch_instruction);int patch_branch (unsigned int *addr,unsigned long target,int flags) { -return patch_instruction (addr,create_branch (addr, target, flags)); +unsigned int instr; + +create_branch (&instr, addr, target, flags); +return patch_instruction (addr, instr); }bool is_offset_in_branch_range (long offset)@@ -243,30 +246,30 @@ bool is_conditional_branch(unsigned int instr) }NOKPROBE_SYMBOL (is_conditional_branch); -unsigned int create_branch (const unsigned int *addr, -unsigned long target,int flags) +int create_branch (unsigned int *instr, +const unsigned int *addr, +unsigned long target,int flags) { -unsigned int instruction;long offset; + *instr =0 ; offset = target;if (! (flags &BRANCH_ABSOLUTE )) offset = offset - (unsigned long )addr;/* Check we can represent the target in the instruction format */ if (!is_offset_in_branch_range (offset)) -return 0 ; +return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - instruction =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); + *instr =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); -return instruction; +return 0 ; } -unsigned int create_cond_branch (const unsigned int *addr, -unsigned long target,int flags) +int create_cond_branch (unsigned int *instr,const unsigned int *addr, +unsigned long target,int flags) { -unsigned int instruction;long offset;offset = target;arch/powerpc/lib/code-patching.c +3
-3@@ -275,12 +278,12 @@ unsigned int create_cond_branch(const unsigned int *addr,/* Check we can represent the target in the instruction format */ if (offset < -0x8000 || offset > 0x7FFF || offset & 0x3) -return 0 ; +return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - instruction =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); + *instr =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); -return instruction; +return 0 ; }static unsigned int
branch_opcode(unsigned int instr)arch/powerpc/lib/code-patching.c +0
-1@@ -361,18 +364,18 @@ int instr_is_branch_to_addr(const unsigned int *instr, unsigned long addr)return 0 ; } -unsigned int translate_branch(const unsigned int *dest, const unsignedint
*src)
+int translate_branch(unsigned int *instr, const unsigned int *dest, const
unsigned int *src){ unsigned long target; target = branch_target(src); if (instr_is_branch_iform(*src))arch/powerpc/lib/code-patching.c +15
-14-return create_branch (dest, target, *src); +return create_branch (instr, dest, target, *src); else if (instr_is_branch_bform(*src)) - return create_cond_branch(dest, target, *src); + return create_cond_branch(instr, dest, target, *src); -return 0 ; +return 1 ; }#ifdef CONFIG_PPC_BOOK3E_64 @@ -403,6 +406,7 @@ static void __init test_trampoline(void)static void __init test_branch_iform (void ) { +int err;unsigned int instr;unsigned long addr;@@ -443,35 +447,35 @@ static void __init test_branch_iform(void)check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Branch to self, with link */ - instr =create_branch (&instr, addr,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr));/* Branch to self - 0x100, with link */ - instr =create_branch (&instr, addr -0x100 ,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr -0x100 ,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr -0x100 ));/* Branch to self + 0x100, no link */ - instr =create_branch (&instr, addr +0x100 ,0 ); + err =create_branch (&instr, &instr, addr +0x100 ,0 );check (instr_is_branch_to_addr (&instr, addr +0x100 ));/* Maximum relative negative offset, - 32 MB */ - instr =create_branch (&instr, addr -0x2000000 ,BRANCH_SET_LINK ); + err =create_branch (&instr, &instr, addr -0x2000000 ,BRANCH_SET_LINK );check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Out of range relative negative offset, - 32 MB + 4*/ - instr =create_branch (&instr, addr -0x2000004 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr -0x2000004 ,BRANCH_SET_LINK ); +check (err);/* Out of range relative positive offset, + 32 MB */ - instr =create_branch (&instr, addr +0x2000000 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr +0x2000000 ,BRANCH_SET_LINK ); +check (err);/* Unaligned target */ - instr =create_branch (&instr, addr +3 ,BRANCH_SET_LINK ); -check (instr ==0 ); + err =create_branch (&instr, &instr, addr +3 ,BRANCH_SET_LINK ); +check (err);/* Check flags are masked correctly */ - instr =create_branch (&instr, addr,0xFFFFFFFC ); + err =create_branch (&instr, &instr, addr,0xFFFFFFFC );check(instr_is_branch_to_addr(&instr, addr)); check(instr == 0x48000000);}
arch/powerpc/lib/code-patching.c +0
-0@@ -480,16 +484,19 @@ static void __init test_create_function_call(void) {unsigned int *iptr;arch/powerpc/lib/code-patching.c static void __init test_create_function_call(void) · line 494
Quoted 10 lines
arch/powerpc/lib/code-patching.c +3
-1unsigned long dest; +unsigned int instr;/* Check we can create a function call */ iptr = (unsigned int *)ppc_function_entry (test_trampoline); dest =ppc_function_entry (test_create_function_call); -patch_instruction (iptr,create_branch (iptr, dest, BRANCH_SET_LINK)); +create_branch (&instr, iptr, dest,BRANCH_SET_LINK ); +patch_instruction (iptr, instr);Are we sure that
create_branch()would always succeed here to dopatch_instruction()?Quoted 63 lines
arch/powerpc/lib/code-patching.c +13
-11check (instr_is_branch_to_addr (iptr, dest)); }static void __init test_branch_bform (void ) { +int err;unsigned long addr;unsigned int *iptr, instr, flags;@@ -525,35 +532,35 @@ static void __init test_branch_bform(void) flags =0x3ff000 |BRANCH_SET_LINK ;/* Branch to self */ - instr =create_cond_branch (iptr, addr, flags); + err =create_cond_branch (&instr, iptr, addr, flags);check (instr_is_branch_to_addr (&instr, addr));/* Branch to self - 0x100 */ - instr =create_cond_branch (iptr, addr -0x100 , flags); + err =create_cond_branch (&instr, iptr, addr -0x100 , flags);check (instr_is_branch_to_addr (&instr, addr -0x100 ));/* Branch to self + 0x100 */ - instr =create_cond_branch (iptr, addr +0x100 , flags); + err =create_cond_branch (&instr, iptr, addr +0x100 , flags);check (instr_is_branch_to_addr (&instr, addr +0x100 ));/* Maximum relative negative offset, - 32 KB */ - instr =create_cond_branch (iptr, addr -0x8000 , flags); + err =create_cond_branch (&instr, iptr, addr -0x8000 , flags);check (instr_is_branch_to_addr (&instr, addr -0x8000 ));/* Out of range relative negative offset, - 32 KB + 4*/ - instr =create_cond_branch (iptr, addr -0x8004 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr -0x8004 , flags); +check (err);/* Out of range relative positive offset, + 32 KB */ - instr =create_cond_branch (iptr, addr +0x8000 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr +0x8000 , flags); +check (err);/* Unaligned target */ - instr =create_cond_branch (iptr, addr +3 , flags); -check (instr ==0 ); + err =create_cond_branch (&instr, iptr, addr +3 , flags); +check (err);/* Check flags are masked correctly */ - instr =create_cond_branch (iptr, addr,0xFFFFFFFC ); + err =create_cond_branch (&instr, iptr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr));check (instr ==0x43FF0000 ); }@@ -562,6 +569,7 @@ static void __init test_translate_branch(void) {unsigned long addr;unsigned int *p, *q; +unsigned int instr;void *buf;Quoted 11 lines
arch/powerpc/lib/code-patching.c static void __init test_translate_branch(void) · line 587
Quoted 8 lines
arch/powerpc/lib/code-patching.c +2
-1buf =vmalloc (PAGE_ALIGN (0x2000000 +1 ));@@ -575,7 +583,8 @@ static void __init test_translate_branch(void)patch_branch (p, addr,0 );check (instr_is_branch_to_addr (p, addr)); q = p +1 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);same here and elsewhere in similar such places where we do
patch_instruction()
Quoted 2 lines
I figured that if the existing code was not checking the return then we probably did not need to add a check.
yes existing code does not checking, I just wanted to ensure we do right thing. Thanks!
-- Bala
Quoted 142 lines
Quoted 142 lines
-- Bala
Quoted 140 lines
arch/powerpc/lib/code-patching.c +28
-14check (instr_is_branch_to_addr (q, addr));/* Maximum negative case, move b . to addr + 32 MB */ @@ -583,7 +592,8 @@ static void __init test_translate_branch(void) addr = (unsigned long )p;patch_branch (p, addr,0 ); q = buf +0x2000000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x4a000000 );@@ -593,7 +603,8 @@ static void __init test_translate_branch(void) addr = (unsigned long )p;patch_branch (p, addr,0 ); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x49fffffc );@@ -603,7 +614,8 @@ static void __init test_translate_branch(void) addr =0x1000000 + (unsigned long )buf;patch_branch (p, addr,BRANCH_SET_LINK ); q = buf +0x1400000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));@@ -612,7 +624,8 @@ static void __init test_translate_branch(void) addr =0x2000000 + (unsigned long )buf;patch_branch (p, addr,0 ); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));@@ -622,18 +635,22 @@ static void __init test_translate_branch(void)/* Simple case, branch to self moved a little */ p = buf; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0 )); +create_cond_branch (&instr, p, addr,0 ); +patch_instruction (p, instr);check (instr_is_branch_to_addr (p, addr)); q = p +1 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (q, addr));/* Maximum negative case, move b . to addr + 32 KB */ p = buf; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0xFFFFFFFC )); +create_cond_branch (&instr, p, addr,0xFFFFFFFC ); +patch_instruction (p, instr); q = buf +0x8000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x43ff8000 );@@ -641,9 +658,11 @@ static void __init test_translate_branch(void)/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ; addr = (unsigned long )p; -patch_instruction (p,create_cond_branch (p, addr,0xFFFFFFFC )); +create_cond_branch (&instr, p, addr,0xFFFFFFFC ); +patch_instruction (p, instr); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));check (*q ==0x43ff7ffc );@@ -651,18 +670,22 @@ static void __init test_translate_branch(void)/* Jump to x + 12 KB moved to x + 20 KB */ p = buf; addr =0x3000 + (unsigned long )buf; -patch_instruction (p,create_cond_branch (p, addr,BRANCH_SET_LINK )); +create_cond_branch (&instr, p, addr,BRANCH_SET_LINK ); +patch_instruction (p, instr); q = buf +0x5000 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));/* Jump to x + 8 KB moved to x - 8 KB + 4 */ p = buf +0x2000 ; addr =0x4000 + (unsigned long )buf; -patch_instruction (p,create_cond_branch (p, addr,0 )); +create_cond_branch (&instr, p, addr,0 ); +patch_instruction (p, instr); q = buf +4 ; -patch_instruction (q,translate_branch (q, p)); +translate_branch (&instr, q, p); +patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr));arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
index4ba634b89ce5..b129d7b4e7dd100644arch/powerpc/lib/feature-fixups.c +1
-0@@ -44,6 +44,7 @@ static unsigned int *calc_addr(struct fixup_entry *fcur, long offset)static int patch_alt_instruction (unsigned int *src,unsigned int *dest,unsigned int *alt_start,unsigned int *alt_end) { +int err;unsigned int instr; instr = *src;arch/powerpc/lib/feature-fixups.c +2
-2@@ -53,8 +54,8 @@ static int patch_alt_instruction(unsigned int *src,unsigned int *dest,/* Branch within the section doesn't need translating */ if (target < alt_start || target > alt_end) { - instr =translate_branch (dest, src); -if (!instr) + err =translate_branch (&instr, dest, src); +if (err)return 1 ; }}
PATCH v5 4/21 powerpc: Use a macro for creating instructions from u32s
In reply to Jordan NietheIn preparation for instructions having a more complex data type start using a macro, ppc_inst(), for making an instruction out of a u32. A macro is used so that instructions can be used as initializer elements. Currently this does nothing, but it will allow for creating a data type that can represent prefixed instructions.
---
v4: New to series
v5: - Rename PPC_INST() -> ppc_inst().
- Use on epapr_paravirt.c, kgdb.c
--- arch/powerpc/include/asm/code-patching.h | 3 +- arch/powerpc/include/asm/inst.h | 11 +++++ arch/powerpc/kernel/align.c | 1 + arch/powerpc/kernel/epapr_paravirt.c | 5 ++- arch/powerpc/kernel/hw_breakpoint.c | 3 +- arch/powerpc/kernel/jump_label.c | 3 +- arch/powerpc/kernel/kgdb.c | 5 ++- arch/powerpc/kernel/kprobes.c | 5 ++- arch/powerpc/kernel/module_64.c | 3 +- arch/powerpc/kernel/optprobes.c | 31 ++++++------- arch/powerpc/kernel/security.c | 9 ++-- arch/powerpc/kernel/trace/ftrace.c | 25 ++++++----- arch/powerpc/kernel/uprobes.c | 1 + arch/powerpc/kvm/emulate_loadstore.c | 2 +- arch/powerpc/lib/code-patching.c | 57 ++++++++++++------------ arch/powerpc/lib/feature-fixups.c | 39 ++++++++-------- arch/powerpc/lib/test_emulate_step.c | 39 ++++++++-------- arch/powerpc/xmon/xmon.c | 7 +-- 18 files changed, 138 insertions(+), 111 deletions(-) create mode 100644 arch/powerpc/include/asm/inst.h
arch/powerpc/include/asm/code-patching.h +2 -1
@@ -11,6 +11,7 @@#include <linux/string.h> #include <linux/kallsyms.h> #include <asm/asm-compat.h> +#include <asm/inst.h> /* Flags for create_branch: * "b" == create_branch(addr, target, 0);
@@ -48,7 +49,7 @@ static inline int patch_branch_site(s32 *site, unsigned long target, int flags)static inline int modify_instruction (unsigned int *addr,unsigned int clr,unsigned int set) { -return patch_instruction (addr, (*addr & ~clr) | set); +return patch_instruction (addr,ppc_inst ((*addr & ~clr) | set)); }static inline int modify_instruction_site (s32 *site,unsigned int clr,unsigned int set)
arch/powerpc/include/asm/inst.h new file +11 -0
@@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +#ifndef _ASM_INST_H +#define _ASM_INST_H + +/* +* Instruction data type for POWER +*/ + +#define ppc_inst (x) (x) + +#endif /* _ASM_INST_H */
arch/powerpc/kernel/align.c +1 -0
@@ -24,6 +24,7 @@#include <asm/disassemble.h> #include <asm/cpu_has_feature.h> #include <asm/sstep.h> +#include <asm/inst.h> struct aligninfo {unsigned char len;
arch/powerpc/kernel/epapr_paravirt.c +3 -2
@@ -11,6 +11,7 @@#include <asm/cacheflush.h> #include <asm/code-patching.h> #include <asm/machdep.h> +#include <asm/inst.h> #if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 )extern void epapr_ev_idle (void );
@@ -37,9 +38,9 @@ static int __init early_init_dt_scan_epapr(unsigned long node,for (i =0 ; i < (len /4 ); i++) {u32 inst =be32_to_cpu (insts[i]); -patch_instruction (epapr_hypercall_start + i, inst); +patch_instruction (epapr_hypercall_start + i,ppc_inst (inst));#if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 ) -patch_instruction (epapr_ev_idle_start + i, inst); +patch_instruction (epapr_ev_idle_start + i,ppc_inst (inst));#endif }
arch/powerpc/kernel/hw_breakpoint.c +2 -1
@@ -24,6 +24,7 @@#include <asm/debug.h> #include <asm/debugfs.h> #include <asm/hvcall.h> +#include <asm/inst.h> #include <linux/uaccess.h> /*
@@ -243,7 +244,7 @@ dar_range_overlaps(unsigned long dar, int size, struct arch_hw_breakpoint *info)static bool stepping_handler (struct pt_regs *regs,struct perf_event *bp,struct arch_hw_breakpoint *info) { -unsigned int instr =0 ; +unsigned int instr =ppc_inst (0 );int ret, type, size;struct instruction_op op;unsigned long addr = info->address;
arch/powerpc/kernel/jump_label.c +2 -1
@@ -6,6 +6,7 @@#include <linux/kernel.h> #include <linux/jump_label.h> #include <asm/code-patching.h> +#include <asm/inst.h> void arch_jump_label_transform (struct jump_entry *entry,enum jump_label_type type)
@@ -15,5 +16,5 @@ void arch_jump_label_transform(struct jump_entry *entry,if (type ==JUMP_LABEL_JMP )patch_branch (addr, entry->target,0 );else -patch_instruction (addr,PPC_INST_NOP ); +patch_instruction (addr,ppc_inst (PPC_INST_NOP )); }
arch/powerpc/kernel/kgdb.c +3 -2
@@ -26,6 +26,7 @@#include <asm/debug.h> #include <asm/code-patching.h> #include <linux/slab.h> +#include <asm/inst.h> /* * This table contains the mapping between PowerPC hardware trap types, and
@@ -424,7 +425,7 @@ int kgdb_arch_set_breakpoint(struct kgdb_bkpt *bpt)if (err)return err; - err =patch_instruction (addr,BREAK_INSTR ); + err =patch_instruction (addr,ppc_inst (BREAK_INSTR ));if (err)return -EFAULT ;
@@ -439,7 +440,7 @@ int kgdb_arch_remove_breakpoint(struct kgdb_bkpt *bpt)unsigned int instr = *(unsigned int *)bpt->saved_instr;unsigned int *addr = (unsigned int *)bpt->bpt_addr; - err =patch_instruction (addr, instr); + err =patch_instruction (addr,ppc_inst (instr));if (err)return -EFAULT ;
arch/powerpc/kernel/kprobes.c +3 -2
@@ -23,6 +23,7 @@#include <asm/cacheflush.h> #include <asm/sstep.h> #include <asm/sections.h> +#include <asm/inst.h> #include <linux/uaccess.h> DEFINE_PER_CPU(struct kprobe *, current_kprobe) = NULL;
@@ -138,13 +139,13 @@ NOKPROBE_SYMBOL(arch_prepare_kprobe);void arch_arm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,BREAKPOINT_INSTRUCTION ); +patch_instruction (p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); }NOKPROBE_SYMBOL (arch_arm_kprobe);void arch_disarm_kprobe (struct kprobe *p) { -patch_instruction (p->addr, p->opcode); +patch_instruction (p->addr,ppc_inst (p->opcode)); }NOKPROBE_SYMBOL (arch_disarm_kprobe);
arch/powerpc/kernel/module_64.c +2 -1
@@ -20,6 +20,7 @@#include <linux/sort.h> #include <asm/setup.h> #include <asm/sections.h> +#include <asm/inst.h> /* FIXME: We don't do .init separately. To do this, we'd need to have a separate r2 value in the init and core section, and stub between
@@ -506,7 +507,7 @@ static int restore_r2(const char *name, u32 *instruction, struct module *me)* "link" branches and they don't return, so they don't need the r2 * restore afterwards. */ -if (!instr_is_relative_link_branch (*prev_insn)) +if (!instr_is_relative_link_branch (ppc_inst (*prev_insn)))return 1 ;if (*instruction !=PPC_INST_NOP ) {
arch/powerpc/kernel/optprobes.c +16 -15
@@ -16,6 +16,7 @@#include <asm/code-patching.h> #include <asm/sstep.h> #include <asm/ppc-opcode.h> +#include <asm/inst.h> #define TMPL_CALL_HDLR_IDX \ (optprobe_template_call_handler - optprobe_template_entry)
@@ -147,13 +148,13 @@ void arch_remove_optimized_kprobe(struct optimized_kprobe *op)void patch_imm32_load_insns (unsigned int val,kprobe_opcode_t *addr) {/* addis r4,0,(insn)@h */ -patch_instruction (addr,PPC_INST_ADDIS |___PPC_RT (4 ) | - ((val >>16 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (4 ) | + ((val >>16 ) &0xffff ))); addr++;/* ori r4,r4,(insn)@l */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (4 ) | -___PPC_RS (4 ) | (val &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (4 ) | +___PPC_RS (4 ) | (val &0xffff ))); }/*
@@ -163,28 +164,28 @@ void patch_imm32_load_insns(unsigned int val, kprobe_opcode_t *addr)void patch_imm64_load_insns (unsigned long val,kprobe_opcode_t *addr) {/* lis r3,(op)@highest */ -patch_instruction (addr,PPC_INST_ADDIS |___PPC_RT (3 ) | - ((val >>48 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (3 ) | + ((val >>48 ) &0xffff ))); addr++;/* ori r3,r3,(op)@higher */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (3 ) | -___PPC_RS (3 ) | ((val >>32 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +___PPC_RS (3 ) | ((val >>32 ) &0xffff ))); addr++;/* rldicr r3,r3,32,31 */ -patch_instruction (addr,PPC_INST_RLDICR |___PPC_RA (3 ) | -___PPC_RS (3 ) |__PPC_SH64 (32 ) |__PPC_ME64 (31 )); +patch_instruction (addr,ppc_inst (PPC_INST_RLDICR |___PPC_RA (3 ) | +___PPC_RS (3 ) |__PPC_SH64 (32 ) |__PPC_ME64 (31 ))); addr++;/* oris r3,r3,(op)@h */ -patch_instruction (addr,PPC_INST_ORIS |___PPC_RA (3 ) | -___PPC_RS (3 ) | ((val >>16 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORIS |___PPC_RA (3 ) | +___PPC_RS (3 ) | ((val >>16 ) &0xffff ))); addr++;/* ori r3,r3,(op)@l */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (3 ) | -___PPC_RS (3 ) | (val &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +___PPC_RS (3 ) | (val &0xffff ))); }int arch_prepare_optimized_kprobe (struct optimized_kprobe *op,struct kprobe *p)
@@ -230,7 +231,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) size = (TMPL_END_IDX *sizeof (kprobe_opcode_t)) /sizeof (int );pr_devel ("Copying template to %p, size %lu\n" , buff, size);for (i =0 ; i < size; i++) { - rc =patch_instruction (buff + i, *(optprobe_template_entry + i)); + rc =patch_instruction (buff + i,ppc_inst (*(optprobe_template_entry + i)));if (rc <0 ) goto error; }
arch/powerpc/kernel/security.c +5 -4
@@ -14,6 +14,7 @@#include <asm/debugfs.h> #include <asm/security_features.h> #include <asm/setup.h> +#include <asm/inst.h> u64 powerpc_security_features__read_mostly =SEC_FTR_DEFAULT ;
@@ -403,9 +404,9 @@ static void toggle_count_cache_flush(bool enable) enable = false;if (!enable) { -patch_instruction_site (&patch__call_flush_count_cache,PPC_INST_NOP ); +patch_instruction_site (&patch__call_flush_count_cache,ppc_inst (PPC_INST_NOP ));#ifdef CONFIG_KVM_BOOK3S_HV_POSSIBLE -patch_instruction_site (&patch__call_kvm_flush_link_stack,PPC_INST_NOP ); +patch_instruction_site (&patch__call_kvm_flush_link_stack,ppc_inst (PPC_INST_NOP ));#endif pr_info ("link-stack-flush: software flush disabled.\n" ); link_stack_flush_enabled = false;
@@ -428,7 +429,7 @@ static void toggle_count_cache_flush(bool enable)// If we just need to flush the link stack, patch an early return if (!security_ftr_enabled (SEC_FTR_FLUSH_COUNT_CACHE )) { -patch_instruction_site (&patch__flush_link_stack_return,PPC_INST_BLR ); +patch_instruction_site (&patch__flush_link_stack_return,ppc_inst (PPC_INST_BLR ));no_count_cache_flush ();return ; }
@@ -439,7 +440,7 @@ static void toggle_count_cache_flush(bool enable)return ; } -patch_instruction_site (&patch__flush_count_cache_return,PPC_INST_BLR ); +patch_instruction_site (&patch__flush_count_cache_return,ppc_inst (PPC_INST_BLR )); count_cache_flush_type =COUNT_CACHE_FLUSH_HW ;pr_info ("count-cache-flush: hardware assisted flush sequence enabled\n" ); }
arch/powerpc/kernel/trace/ftrace.c +13 -12
@@ -27,6 +27,7 @@#include <asm/code-patching.h> #include <asm/ftrace.h> #include <asm/syscall.h> +#include <asm/inst.h> #ifdef CONFIG_DYNAMIC_FTRACE
@@ -161,7 +162,7 @@ __ftrace_make_nop(struct module *mod,#ifdef CONFIG_MPROFILE_KERNEL /* When using -mkernel_profile there is no load to jump over */ - pop =PPC_INST_NOP ; + pop =ppc_inst (PPC_INST_NOP );if (probe_kernel_read (&op, (void *)(ip -4 ),4 )) {pr_err ("Fetching instruction at %lx failed.\n" , ip -4 );
@@ -169,7 +170,7 @@ __ftrace_make_nop(struct module *mod, }/* We expect either a mflr r0, or a std r0, LRSAVE(r1) */ -if (op !=PPC_INST_MFLR && op !=PPC_INST_STD_LR ) { +if (op !=ppc_inst (PPC_INST_MFLR ) && op !=ppc_inst (PPC_INST_STD_LR )) {pr_err ("Unexpected instruction %08x around bl _mcount\n" , op);return -EINVAL ; }
@@ -188,7 +189,7 @@ __ftrace_make_nop(struct module *mod,* Use a b +8 to jump over the load. */ - pop =PPC_INST_BRANCH |8 ;/* b +8 */ + pop =ppc_inst (PPC_INST_BRANCH |8 );/* b +8 */ /* * Check what is in the next instruction. We can see ld r2,40(r1), but
@@ -199,7 +200,7 @@ __ftrace_make_nop(struct module *mod,return -EFAULT ; } -if (op !=PPC_INST_LD_TOC ) { +if (op !=ppc_inst (PPC_INST_LD_TOC )) {pr_err ("Expected %08x found %08x\n" ,PPC_INST_LD_TOC , op);return -EINVAL ; }
@@ -275,7 +276,7 @@ __ftrace_make_nop(struct module *mod,return -EINVAL ; } - op =PPC_INST_NOP ; + op =ppc_inst (PPC_INST_NOP );if (patch_instruction ((unsigned int *)ip, op))return -EPERM ;
@@ -420,7 +421,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr) } } -if (patch_instruction ((unsigned int *)ip,PPC_INST_NOP )) { +if (patch_instruction ((unsigned int *)ip,ppc_inst (PPC_INST_NOP ))) {pr_err ("Patching NOP failed.\n" );return -EPERM ; }
@@ -442,7 +443,7 @@ int ftrace_make_nop(struct module *mod,if (test_24bit_addr (ip, addr)) {/* within range */ old =ftrace_call_replace (ip, addr,1 ); - new =PPC_INST_NOP ; + new =ppc_inst (PPC_INST_NOP );return ftrace_modify_code (ip, old, new); }else if (core_kernel_text (ip))return __ftrace_make_nop_kernel (rec, addr);
@@ -496,7 +497,7 @@ expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1)* The load offset is different depending on the ABI. For simplicity * just mask it out when doing the compare. */ -if ((op0 !=0x48000008 ) || ((op1 &0xffff0000 ) !=0xe8410000 )) +if ((op0 !=ppc_inst (0x48000008 )) || ((op1 &0xffff0000 ) !=0xe8410000 ))return 0 ;return 1 ; }
@@ -505,7 +506,7 @@ static int expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1) {/* look for patched "NOP" on ppc64 with -mprofile-kernel */ -if (op0 !=PPC_INST_NOP ) +if (op0 !=ppc_inst (PPC_INST_NOP ))return 0 ;return 1 ; }
@@ -588,7 +589,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ;/* It should be pointing to a nop */ -if (op !=PPC_INST_NOP ) { +if (op !=ppc_inst (PPC_INST_NOP )) {pr_err ("Expected NOP but have %x\n" , op);return -EINVAL ; }
@@ -645,7 +646,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ; } -if (op !=PPC_INST_NOP ) { +if (op !=ppc_inst (PPC_INST_NOP )) {pr_err ("Unexpected call sequence at %p: %x\n" , ip, op);return -EINVAL ; }
@@ -676,7 +677,7 @@ int ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)*/ if (test_24bit_addr (ip, addr)) {/* within range */ - old =PPC_INST_NOP ; + old =ppc_inst (PPC_INST_NOP ); new =ftrace_call_replace (ip, addr,1 );return ftrace_modify_code (ip, old, new); }else if (core_kernel_text (ip))
arch/powerpc/kernel/uprobes.c +1 -0
@@ -14,6 +14,7 @@#include <linux/kdebug.h> #include <asm/sstep.h> +#include <asm/inst.h> #define UPROBE_TRAP_NR UINT_MAX
arch/powerpc/kvm/emulate_loadstore.c +1 -1
@@ -95,7 +95,7 @@ int kvmppc_emulate_loadstore(struct kvm_vcpu *vcpu) emulated =EMULATE_FAIL ; vcpu->arch.regs.msr = vcpu->arch.shared->msr; -if (analyse_instr (&op, &vcpu->arch.regs, inst) ==0 ) { +if (analyse_instr (&op, &vcpu->arch.regs,ppc_inst (inst)) ==0 ) {int type = op.type &INSTR_TYPE_MASK ;int size =GETSIZE (op.type);
arch/powerpc/lib/code-patching.c +29 -28
142 lines not on this page · raw message
arch/powerpc/lib/feature-fixups.c +20 -19
@@ -21,6 +21,7 @@#include <asm/setup.h> #include <asm/security_features.h> #include <asm/firmware.h> +#include <asm/inst.h> struct fixup_entry {unsigned long mask;
@@ -89,7 +90,7 @@ static int patch_feature_section(unsigned long value, struct fixup_entry *fcur) }for (; dest < end; dest++) -raw_patch_instruction (dest,PPC_INST_NOP ); +raw_patch_instruction (dest,ppc_inst (PPC_INST_NOP ));return 0 ; }
@@ -146,15 +147,15 @@ static void do_stf_entry_barrier_fixups(enum stf_barrier_type types)pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instrs[0 ]); +patch_instruction (dest,ppc_inst (instrs[0 ]));if (types &STF_BARRIER_FALLBACK )patch_branch (dest +1 , (unsigned long )&stf_barrier_fallback,BRANCH_SET_LINK );else -patch_instruction (dest +1 , instrs[1 ]); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); -patch_instruction (dest +2 , instrs[2 ]); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); } printk(KERN_DEBUG "stf-barrier: patched %d entry locations (%s barrier)\n", i,
@@ -207,12 +208,12 @@ static void do_stf_exit_barrier_fixups(enum stf_barrier_type types)pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instrs[0 ]); -patch_instruction (dest +1 , instrs[1 ]); -patch_instruction (dest +2 , instrs[2 ]); -patch_instruction (dest +3 , instrs[3 ]); -patch_instruction (dest +4 , instrs[4 ]); -patch_instruction (dest +5 , instrs[5 ]); +patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); +patch_instruction (dest +3 ,ppc_inst (instrs[3 ])); +patch_instruction (dest +4 ,ppc_inst (instrs[4 ])); +patch_instruction (dest +5 ,ppc_inst (instrs[5 ])); } printk(KERN_DEBUG "stf-barrier: patched %d exit locations (%s barrier)\n", i, (types == STF_BARRIER_NONE) ? "no" :
@@ -260,9 +261,9 @@ void do_rfi_flush_fixups(enum l1d_flush_type types)pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instrs[0 ]); -patch_instruction (dest +1 , instrs[1 ]); -patch_instruction (dest +2 , instrs[2 ]); +patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); } printk(KERN_DEBUG "rfi-flush: patched %d locations (%s flush)\n", i,
@@ -295,7 +296,7 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instr); +patch_instruction (dest,ppc_inst (instr)); }printk (KERN_DEBUG "barrier-nospec: patched %d locations\n" , i);
@@ -338,8 +339,8 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instr[0 ]); -patch_instruction (dest +1 , instr[1 ]); +patch_instruction (dest,ppc_inst (instr[0 ])); +patch_instruction (dest +1 ,ppc_inst (instr[1 ])); }printk (KERN_DEBUG "barrier-nospec: patched %d locations\n" , i);
@@ -353,7 +354,7 @@ static void patch_btb_flush_section(long *curr) end = (void *)curr + *(curr +1 );for (; start < end; start++) {pr_devel ("patching dest %lx\n" , (unsigned long )start); -patch_instruction (start,PPC_INST_NOP ); +patch_instruction (start,ppc_inst (PPC_INST_NOP )); } }
@@ -382,7 +383,7 @@ void do_lwsync_fixups(unsigned long value, void *fixup_start, void *fixup_end)for (; start < end; start++) { dest = (void *)start + *start; -raw_patch_instruction (dest,PPC_INST_LWSYNC ); +raw_patch_instruction (dest,ppc_inst (PPC_INST_LWSYNC )); } }
@@ -400,7 +401,7 @@ static void do_final_fixups(void) length = (__end_interrupts - _stext) /sizeof (int );while (length--) { -raw_patch_instruction (dest, *src); +raw_patch_instruction (dest,ppc_inst (*src)); src++; dest++; }
arch/powerpc/lib/test_emulate_step.c +20 -19
@@ -11,6 +11,7 @@#include <asm/sstep.h> #include <asm/ppc-opcode.h> #include <asm/code-patching.h> +#include <asm/inst.h> #define IMM_L (i) ((uintptr_t)(i) & 0xffff)
@@ -18,40 +19,40 @@* Defined with TEST_ prefix so it does not conflict with other * definitions. */ -#define TEST_LD (r, base, i) (PPC_INST_LD | ___PPC_RT(r) | \ +#define TEST_LD (r, base, i) ppc_inst(PPC_INST_LD | ___PPC_RT(r) | \ ___PPC_RA(base) | IMM_L(i)) -#define TEST_LWZ (r, base, i) (PPC_INST_LWZ | ___PPC_RT(r) | \ +#define TEST_LWZ (r, base, i) ppc_inst(PPC_INST_LWZ | ___PPC_RT(r) | \ ___PPC_RA(base) | IMM_L(i)) -#define TEST_LWZX (t, a, b) (PPC_INST_LWZX | ___PPC_RT(t) | \ +#define TEST_LWZX (t, a, b) ppc_inst(PPC_INST_LWZX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STD (r, base, i) (PPC_INST_STD | ___PPC_RS(r) | \ +#define TEST_STD (r, base, i) ppc_inst(PPC_INST_STD | ___PPC_RS(r) | \ ___PPC_RA(base) | ((i) & 0xfffc)) -#define TEST_LDARX (t, a, b, eh) (PPC_INST_LDARX | ___PPC_RT(t) | \ +#define TEST_LDARX (t, a, b, eh) ppc_inst(PPC_INST_LDARX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b) | \ __PPC_EH(eh)) -#define TEST_STDCX (s, a, b) (PPC_INST_STDCX | ___PPC_RS(s) | \ +#define TEST_STDCX (s, a, b) ppc_inst(PPC_INST_STDCX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LFSX (t, a, b) (PPC_INST_LFSX | ___PPC_RT(t) | \ +#define TEST_LFSX (t, a, b) ppc_inst(PPC_INST_LFSX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STFSX (s, a, b) (PPC_INST_STFSX | ___PPC_RS(s) | \ +#define TEST_STFSX (s, a, b) ppc_inst(PPC_INST_STFSX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LFDX (t, a, b) (PPC_INST_LFDX | ___PPC_RT(t) | \ +#define TEST_LFDX (t, a, b) ppc_inst(PPC_INST_LFDX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STFDX (s, a, b) (PPC_INST_STFDX | ___PPC_RS(s) | \ +#define TEST_STFDX (s, a, b) ppc_inst(PPC_INST_STFDX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LVX (t, a, b) (PPC_INST_LVX | ___PPC_RT(t) | \ +#define TEST_LVX (t, a, b) ppc_inst(PPC_INST_LVX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STVX (s, a, b) (PPC_INST_STVX | ___PPC_RS(s) | \ +#define TEST_STVX (s, a, b) ppc_inst(PPC_INST_STVX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LXVD2X (s, a, b) (PPC_INST_LXVD2X | VSX_XX1((s), R##a, R##b)) -#define TEST_STXVD2X (s, a, b) (PPC_INST_STXVD2X | VSX_XX1((s), R##a, R##b)) -#define TEST_ADD (t, a, b) (PPC_INST_ADD | ___PPC_RT(t) | \ +#define TEST_LXVD2X (s, a, b) ppc_inst(PPC_INST_LXVD2X | VSX_XX1((s), R##a, R##b)) +#define TEST_STXVD2X (s, a, b) ppc_inst(PPC_INST_STXVD2X | VSX_XX1((s), R##a, R##b)) +#define TEST_ADD (t, a, b) ppc_inst(PPC_INST_ADD | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_ADD_DOT (t, a, b) (PPC_INST_ADD | ___PPC_RT(t) | \ +#define TEST_ADD_DOT (t, a, b) ppc_inst(PPC_INST_ADD | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b) | 0x1) -#define TEST_ADDC (t, a, b) (PPC_INST_ADDC | ___PPC_RT(t) | \ +#define TEST_ADDC (t, a, b) ppc_inst(PPC_INST_ADDC | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_ADDC_DOT (t, a, b) (PPC_INST_ADDC | ___PPC_RT(t) | \ +#define TEST_ADDC_DOT (t, a, b) ppc_inst(PPC_INST_ADDC | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b) | 0x1)#define MAX_SUBTESTS 16
@@ -471,7 +472,7 @@ static struct compute_test compute_tests[] = { .subtests = { { .descr = "R0 = LONG_MAX", - .instr = PPC_INST_NOP, + .instr = ppc_inst(PPC_INST_NOP), .regs = { .gpr[0] = LONG_MAX, }
arch/powerpc/xmon/xmon.c +4 -3
@@ -54,6 +54,7 @@#include <asm/firmware.h> #include <asm/code-patching.h> #include <asm/sections.h> +#include <asm/inst.h> #ifdef CONFIG_PPC64 #include <asm/hvcall.h>
@@ -949,7 +950,7 @@ static void remove_bpts(void)if ((bp->enabled & (BP_TRAP |BP_CIABR )) !=BP_TRAP )continue ;if (mread (bp->address, &instr,4 ) ==4 - && instr == bpinstr + && instr ==ppc_inst (bpinstr) &&patch_instruction ( (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) printf("Couldn't remove breakpoint at %lx\n",
@@ -2845,7 +2846,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, {int nr, dotted;unsigned long first_adr; -unsigned int inst, last_inst =0 ; +unsigned int inst, last_inst =ppc_inst (0 );unsigned char val[4 ]; dotted =0 ;
@@ -2858,7 +2859,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, }break ; } - inst =GETWORD (val); + inst =ppc_inst (GETWORD (val));if (adr > first_adr && inst == last_inst) {if (!dotted) {printf (" ...\n" );
Signature · 1 line
2.17.1
Re: [PATCH v5 04/21] powerpc: Use a macro for creating instructions from u32s
Quoted 101 lines · Jordan Niethe
In preparation for instructions having a more complex data type start using a macro,
ppc_inst(), for making an instruction out of a u32. A macro is used so that instructions can be used as initializer elements. Currently this does nothing, but it will allow for creating a data type that can represent prefixed instructions.Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: - RenamePPC_INST()->ppc_inst().
- Use onepapr_paravirt.c,kgdb.c--- arch/powerpc/include/asm/code-patching.h | 3 +- arch/powerpc/include/asm/inst.h | 11 +++++ arch/powerpc/kernel/align.c | 1 + arch/powerpc/kernel/epapr_paravirt.c | 5 ++- arch/powerpc/kernel/hw_breakpoint.c | 3 +- arch/powerpc/kernel/jump_label.c | 3 +- arch/powerpc/kernel/kgdb.c | 5 ++- arch/powerpc/kernel/kprobes.c | 5 ++- arch/powerpc/kernel/module_64.c | 3 +- arch/powerpc/kernel/optprobes.c | 31 ++++++------- arch/powerpc/kernel/security.c | 9 ++-- arch/powerpc/kernel/trace/ftrace.c | 25 ++++++----- arch/powerpc/kernel/uprobes.c | 1 + arch/powerpc/kvm/emulate_loadstore.c | 2 +- arch/powerpc/lib/code-patching.c | 57 ++++++++++++------------ arch/powerpc/lib/feature-fixups.c | 39 ++++++++-------- arch/powerpc/lib/test_emulate_step.c | 39 ++++++++-------- arch/powerpc/xmon/xmon.c | 7 +-- 18 files changed, 138 insertions(+), 111 deletions(-) create mode 100644 arch/powerpc/include/asm/inst.harch/powerpc/include/asm/code-patching.h +2
-1@@ -11,6 +11,7 @@#include <linux/string.h> #include <linux/kallsyms.h> #include <asm/asm-compat.h> +#include <asm/inst.h> /* Flags for create_branch: * "b" == create_branch(addr, target, 0); @@ -48,7 +49,7 @@ static inline int patch_branch_site(s32 *site, unsigned long target, int flags)static inline int modify_instruction (unsigned int *addr,unsigned int clr,unsigned int set) { -return patch_instruction (addr, (*addr & ~clr) | set); +return patch_instruction (addr,ppc_inst ((*addr & ~clr) | set)); }static inline int modify_instruction_site(s32 *site, unsigned int clr,
unsigned int set)arch/powerpc/include/asm/inst.h new file +11
-0@@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +#ifndef _ASM_INST_H +#define _ASM_INST_H + +/* +* Instruction data type for POWER +*/ + +#define ppc_inst (x) (x) + +#endif /* _ASM_INST_H */ arch/powerpc/kernel/align.c +1
-0@@ -24,6 +24,7 @@#include <asm/disassemble.h> #include <asm/cpu_has_feature.h> #include <asm/sstep.h> +#include <asm/inst.h> struct aligninfo {unsigned char len;arch/powerpc/kernel/epapr_paravirt.c +1
-0@@ -11,6 +11,7 @@#include <asm/cacheflush.h> #include <asm/code-patching.h> #include <asm/machdep.h> +#include <asm/inst.h> #if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 )extern void epapr_ev_idle (void );
arch/powerpc/kernel/epapr_paravirt.c static int __init early_init_dt_scan_epapr(unsigned long · line 44
Quoted 9 lines
arch/powerpc/kernel/epapr_paravirt.c +2
-2@@ -37,9 +38,9 @@ static int __init early_init_dt_scan_epapr(unsigned long node, for (i = 0; i < (len / 4); i++) {u32 inst =be32_to_cpu (insts[i]); -patch_instruction (epapr_hypercall_start + i, inst); +patch_instruction (epapr_hypercall_start + i,ppc_inst (inst));#if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 ) -patch_instruction (epapr_ev_idle_start + i, inst); +patch_instruction (epapr_ev_idle_start + i,ppc_inst (inst));
can we do it once while assigning inst ?
u32 inst = ppc_inst(be32_to_cpu(insts[i]));
-- Bala
Quoted 840 lines
arch/powerpc/kernel/epapr_paravirt.c +0
-0#endif }arch/powerpc/kernel/hw_breakpoint.c +2
-1@@ -24,6 +24,7 @@#include <asm/debug.h> #include <asm/debugfs.h> #include <asm/hvcall.h> +#include <asm/inst.h> #include <linux/uaccess.h> /* @@ -243,7 +244,7 @@ dar_range_overlaps(unsigned long dar, int size, struct arch_hw_breakpoint *info)static bool stepping_handler (struct pt_regs *regs,struct perf_event *bp,struct arch_hw_breakpoint *info) { -unsigned int instr =0 ; +unsigned int instr =ppc_inst (0 );int ret, type, size;struct instruction_op op;arch/powerpc/kernel/hw_breakpoint.c +0
-0unsigned long addr = info->address;arch/powerpc/kernel/jump_label.c +2
-1@@ -6,6 +6,7 @@#include <linux/kernel.h> #include <linux/jump_label.h> #include <asm/code-patching.h> +#include <asm/inst.h> void arch_jump_label_transform (struct jump_entry *entry,enum jump_label_type type)@@ -15,5 +16,5 @@ void arch_jump_label_transform(struct jump_entry *entry,if (type ==JUMP_LABEL_JMP )patch_branch (addr, entry->target,0 );else -patch_instruction (addr,PPC_INST_NOP ); +patch_instruction (addr,ppc_inst (PPC_INST_NOP )); }arch/powerpc/kernel/kgdb.c +3
-2@@ -26,6 +26,7 @@#include <asm/debug.h> #include <asm/code-patching.h> #include <linux/slab.h> +#include <asm/inst.h> /* * This table contains the mapping between PowerPC hardware trap types, and @@ -424,7 +425,7 @@ int kgdb_arch_set_breakpoint(struct kgdb_bkpt *bpt)if (err)return err; - err =patch_instruction (addr,BREAK_INSTR ); + err =patch_instruction (addr,ppc_inst (BREAK_INSTR ));if (err)return -EFAULT ;@@ -439,7 +440,7 @@ int kgdb_arch_remove_breakpoint(struct kgdb_bkpt *bpt)unsigned int instr = *(unsigned int *)bpt->saved_instr;unsigned int *addr = (unsigned int *)bpt->bpt_addr; - err =patch_instruction (addr, instr); + err =patch_instruction (addr,ppc_inst (instr));if (err)return -EFAULT ;arch/powerpc/kernel/kprobes.c +3
-2@@ -23,6 +23,7 @@#include <asm/cacheflush.h> #include <asm/sstep.h> #include <asm/sections.h> +#include <asm/inst.h> #include <linux/uaccess.h> DEFINE_PER_CPU(struct kprobe *, current_kprobe) = NULL;@@ -138,13 +139,13 @@ NOKPROBE_SYMBOL(arch_prepare_kprobe);void arch_arm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,BREAKPOINT_INSTRUCTION ); +patch_instruction (p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); }NOKPROBE_SYMBOL (arch_arm_kprobe);void arch_disarm_kprobe (struct kprobe *p) { -patch_instruction (p->addr, p->opcode); +patch_instruction (p->addr,ppc_inst (p->opcode)); }NOKPROBE_SYMBOL (arch_disarm_kprobe);arch/powerpc/kernel/module_64.c +2
-1@@ -20,6 +20,7 @@#include <linux/sort.h> #include <asm/setup.h> #include <asm/sections.h> +#include <asm/inst.h> /* FIXME: We don't do .init separately. To do this, we'd need to have a separate r2 value in the init and core section, and stub between @@ -506,7 +507,7 @@ static int restore_r2(const char *name, u32 *instruction,struct module *me) * "link" branches and they don't return, so they don't need the r2 * restore afterwards. */ -if (!instr_is_relative_link_branch (*prev_insn)) +if (!instr_is_relative_link_branch (ppc_inst (*prev_insn)))return 1 ;arch/powerpc/kernel/module_64.c +0
-0if (*instruction !=PPC_INST_NOP ) {arch/powerpc/kernel/optprobes.c +5
-4@@ -16,6 +16,7 @@#include <asm/code-patching.h> #include <asm/sstep.h> #include <asm/ppc-opcode.h> +#include <asm/inst.h> #define TMPL_CALL_HDLR_IDX \ (optprobe_template_call_handler - optprobe_template_entry)@@ -147,13 +148,13 @@ void arch_remove_optimized_kprobe(struct optimized_kprobe *op)void patch_imm32_load_insns (unsigned int val,kprobe_opcode_t *addr) {/* addis r4,0,(insn)@h */ -patch_instruction (addr,PPC_INST_ADDIS |___PPC_RT (4 ) | - ((val >>16 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (4 ) | + ((val >>16 ) &0xffff ))); addr++;/* ori r4,r4,(insn)@l */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (4 ) | -___PPC_RS (4 ) | (val &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (4 ) | +___PPC_RS (4 ) | (val &0xffff ))); }/*
arch/powerpc/kernel/optprobes.c +10
-10@@ -163,28 +164,28 @@ void patch_imm32_load_insns(unsigned int val, kprobe_opcode_t *addr)void patch_imm64_load_insns (unsigned long val,kprobe_opcode_t *addr) {/* lis r3,(op)@highest */ -patch_instruction (addr,PPC_INST_ADDIS |___PPC_RT (3 ) | - ((val >>48 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (3 ) | + ((val >>48 ) &0xffff ))); addr++;/* ori r3,r3,(op)@higher */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (3 ) | -___PPC_RS (3 ) | ((val >>32 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +___PPC_RS (3 ) | ((val >>32 ) &0xffff ))); addr++;/* rldicr r3,r3,32,31 */ -patch_instruction (addr,PPC_INST_RLDICR |___PPC_RA (3 ) | -___PPC_RS (3 ) |__PPC_SH64 (32 ) |__PPC_ME64 (31 )); +patch_instruction (addr,ppc_inst (PPC_INST_RLDICR |___PPC_RA (3 ) | +___PPC_RS (3 ) |__PPC_SH64 (32 ) |__PPC_ME64 (31 ))); addr++;/* oris r3,r3,(op)@h */ -patch_instruction (addr,PPC_INST_ORIS |___PPC_RA (3 ) | -___PPC_RS (3 ) | ((val >>16 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORIS |___PPC_RA (3 ) | +___PPC_RS (3 ) | ((val >>16 ) &0xffff ))); addr++;/* ori r3,r3,(op)@l */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (3 ) | -___PPC_RS (3 ) | (val &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +___PPC_RS (3 ) | (val &0xffff ))); }int arch_prepare_optimized_kprobe(struct
optimized_kprobe*op, struct kprobe
*p)arch/powerpc/kernel/optprobes.c +1
-1@@ -230,7 +231,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) size = (TMPL_END_IDX *sizeof (kprobe_opcode_t)) /sizeof (int );pr_devel ("Copying template to %p, size %lu\n" , buff, size);for (i =0 ; i < size; i++) { - rc =patch_instruction (buff + i, *(optprobe_template_entry + i)); + rc =patch_instruction (buff + i,ppc_inst (*(optprobe_template_entry + i)));arch/powerpc/kernel/optprobes.c +0
-0if (rc <0 ) goto error; }arch/powerpc/kernel/security.c +3
-2@@ -14,6 +14,7 @@#include <asm/debugfs.h> #include <asm/security_features.h> #include <asm/setup.h> +#include <asm/inst.h> u64 powerpc_security_features__read_mostly =SEC_FTR_DEFAULT ;@@ -403,9 +404,9 @@ static void toggle_count_cache_flush(bool enable) enable = false;if (!enable) { -patch_instruction_site (&patch__call_flush_count_cache, PPC_INST_NOP); +patch_instruction_site (&patch__call_flush_count_cache,ppc_inst (PPC_INST_NOP ));#ifdef CONFIG_KVM_BOOK3S_HV_POSSIBLE -patch_instruction_site (&patch__call_kvm_flush_link_stack, PPC_INST_NOP); + patch_instruction_site(&patch__call_kvm_flush_link_stack,
ppc_inst(PPC_INST_NOP));
#endifarch/powerpc/kernel/security.c +1
-1pr_info ("link-stack-flush: software flush disabled.\n" ); link_stack_flush_enabled = false;@@ -428,7 +429,7 @@ static void toggle_count_cache_flush(bool enable)// If we just need to flush the link stack, patch an early return if (!security_ftr_enabled (SEC_FTR_FLUSH_COUNT_CACHE )) { -patch_instruction_site (&patch__flush_link_stack_return, PPC_INST_BLR); +patch_instruction_site (&patch__flush_link_stack_return,ppc_inst (PPC_INST_BLR ));no_count_cache_flush ();arch/powerpc/kernel/security.c +1
-1return ; }@@ -439,7 +440,7 @@ static void toggle_count_cache_flush(bool enable)return ; } -patch_instruction_site (&patch__flush_count_cache_return,PPC_INST_BLR ); +patch_instruction_site (&patch__flush_count_cache_return,ppc_inst (PPC_INST_BLR )); count_cache_flush_type =COUNT_CACHE_FLUSH_HW ; pr_info("count-cache-flush: hardware assisted flush sequenceenabled\n");
}arch/powerpc/kernel/trace/ftrace.c +7
-6@@ -27,6 +27,7 @@#include <asm/code-patching.h> #include <asm/ftrace.h> #include <asm/syscall.h> +#include <asm/inst.h> #ifdef CONFIG_DYNAMIC_FTRACE @@ -161,7 +162,7 @@ __ftrace_make_nop(struct module *mod,#ifdef CONFIG_MPROFILE_KERNEL /* When using -mkernel_profile there is no load to jump over */ - pop =PPC_INST_NOP ; + pop =ppc_inst (PPC_INST_NOP );if (probe_kernel_read (&op, (void *)(ip -4 ),4 )) {pr_err ("Fetching instruction at %lx failed.\n" , ip -4 );@@ -169,7 +170,7 @@ __ftrace_make_nop(struct module *mod, }/* We expect either a mflr r0, or a std r0, LRSAVE(r1) */ -if (op !=PPC_INST_MFLR && op !=PPC_INST_STD_LR ) { +if (op !=ppc_inst (PPC_INST_MFLR ) && op !=ppc_inst (PPC_INST_STD_LR )) {pr_err ("Unexpected instruction %08x around bl _mcount\n" , op);return -EINVAL ; }@@ -188,7 +189,7 @@ __ftrace_make_nop(struct module *mod,* Use a b +8 to jump over the load. */ - pop =PPC_INST_BRANCH |8 ;/* b +8 */ + pop =ppc_inst (PPC_INST_BRANCH |8 );/* b +8 */ /* * Check what is in the next instruction. We can see ld r2,40(r1), but @@ -199,7 +200,7 @@ __ftrace_make_nop(struct module *mod,return -EFAULT ; } -if (op !=PPC_INST_LD_TOC ) { +if (op !=ppc_inst (PPC_INST_LD_TOC )) {pr_err ("Expected %08x found %08x\n" ,PPC_INST_LD_TOC , op);return -EINVAL ; }@@ -275,7 +276,7 @@ __ftrace_make_nop(struct module *mod,return -EINVAL ; } - op =PPC_INST_NOP ; + op =ppc_inst (PPC_INST_NOP );if (patch_instruction ((unsigned int *)ip, op))return -EPERM ;@@ -420,7 +421,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr) } } -if (patch_instruction ((unsigned int *)ip,PPC_INST_NOP )) { +if (patch_instruction ((unsigned int *)ip,ppc_inst (PPC_INST_NOP ))) {pr_err ("Patching NOP failed.\n" );return -EPERM ;arch/powerpc/kernel/trace/ftrace.c +2
-2}@@ -442,7 +443,7 @@ int ftrace_make_nop(struct module *mod,if (test_24bit_addr (ip, addr)) {/* within range */ old =ftrace_call_replace (ip, addr,1 ); - new =PPC_INST_NOP ; + new =ppc_inst (PPC_INST_NOP );return ftrace_modify_code (ip, old, new); }else if (core_kernel_text (ip))return __ftrace_make_nop_kernel (rec, addr);@@ -496,7 +497,7 @@ expected_nop_sequence(void *ip, unsigned int op0,unsigned int op1) * The load offset is different depending on the ABI. For simplicity * just mask it out when doing the compare. */ -if ((op0 !=0x48000008 ) || ((op1 &0xffff0000 ) !=0xe8410000 )) +if ((op0 !=ppc_inst (0x48000008 )) || ((op1 &0xffff0000 ) !=0xe8410000 ))return 0 ;arch/powerpc/kernel/trace/ftrace.c +2
-2return 1 ; }@@ -505,7 +506,7 @@ static int expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1) {/* look for patched "NOP" on ppc64 with -mprofile-kernel */ -if (op0 !=PPC_INST_NOP ) +if (op0 !=ppc_inst (PPC_INST_NOP ))return 0 ;return 1 ; }@@ -588,7 +589,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ;/* It should be pointing to a nop */ -if (op !=PPC_INST_NOP ) { +if (op !=ppc_inst (PPC_INST_NOP )) {pr_err ("Expected NOP but have %x\n" , op);return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -645,7 +646,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ; } -if (op !=PPC_INST_NOP ) { +if (op !=ppc_inst (PPC_INST_NOP )) {pr_err ("Unexpected call sequence at %p: %x\n" , ip, op);return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -676,7 +677,7 @@ int ftrace_make_call(struct dyn_ftrace *rec, unsignedlong addr) */ if (test_24bit_addr (ip, addr)) {/* within range */ - old =PPC_INST_NOP ; + old =ppc_inst (PPC_INST_NOP ); new =ftrace_call_replace (ip, addr,1 );return ftrace_modify_code (ip, old, new);arch/powerpc/kernel/trace/ftrace.c +0
-0}else if (core_kernel_text (ip))arch/powerpc/kernel/uprobes.c +1
-0@@ -14,6 +14,7 @@#include <linux/kdebug.h> #include <asm/sstep.h> +#include <asm/inst.h> #define UPROBE_TRAP_NR UINT_MAXarch/powerpc/kvm/emulate_loadstore.c +1
-1@@ -95,7 +95,7 @@ int kvmppc_emulate_loadstore(struct kvm_vcpu *vcpu) emulated =EMULATE_FAIL ; vcpu->arch.regs.msr = vcpu->arch.shared->msr; -if (analyse_instr (&op, &vcpu->arch.regs, inst) ==0 ) { +if (analyse_instr (&op, &vcpu->arch.regs,ppc_inst (inst)) ==0 ) {int type = op.type &INSTR_TYPE_MASK ;int size =GETSIZE (op.type);arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index4af564aeedf1..fdf0d6ea3575100644arch/powerpc/lib/code-patching.c +29
-28@@ -17,6 +17,7 @@#include <asm/page.h> #include <asm/code-patching.h> #include <asm/setup.h> +#include <asm/inst.h> static int __patch_instruction (unsigned int *exec_addr,unsigned int instr,unsigned int *patch_addr)@@ -413,37 +414,37 @@ static void __init test_branch_iform(void) addr = (unsigned long )&instr;/* The simplest case, branch to self, no flags */ -check (instr_is_branch_iform (0x48000000 )); +check (instr_is_branch_iform (ppc_inst (0x48000000 )));/* All bits of target set, and flags */ -check (instr_is_branch_iform (0x4bffffff )); +check (instr_is_branch_iform (ppc_inst (0x4bffffff )));/* High bit of opcode set, which is wrong */ -check (!instr_is_branch_iform (0xcbffffff )); +check (!instr_is_branch_iform (ppc_inst (0xcbffffff )));/* Middle bits of opcode set, which is wrong */ -check (!instr_is_branch_iform (0x7bffffff )); +check (!instr_is_branch_iform (ppc_inst (0x7bffffff )));/* Simplest case, branch to self with link */ -check (instr_is_branch_iform (0x48000001 )); +check (instr_is_branch_iform (ppc_inst (0x48000001 )));/* All bits of targets set */ -check (instr_is_branch_iform (0x4bfffffd )); +check (instr_is_branch_iform (ppc_inst (0x4bfffffd )));/* Some bits of targets set */ -check (instr_is_branch_iform (0x4bff00fd )); +check (instr_is_branch_iform (ppc_inst (0x4bff00fd )));/* Must be a valid branch to start with */ -check (!instr_is_branch_iform (0x7bfffffd )); +check (!instr_is_branch_iform (ppc_inst (0x7bfffffd )));/* Absolute branch to 0x100 */ - instr =0x48000103 ; + instr =ppc_inst (0x48000103 );check (instr_is_branch_to_addr (&instr,0x100 ));/* Absolute branch to 0x420fc */ - instr =0x480420ff ; + instr =ppc_inst (0x480420ff );check (instr_is_branch_to_addr (&instr,0x420fc ));/* Maximum positive relative branch, + 20MB - 4B */ - instr =0x49fffffc ; + instr =ppc_inst (0x49fffffc );check (instr_is_branch_to_addr (&instr, addr +0x1FFFFFC ));/* Smallest negative relative branch, - 4B */ - instr =0x4bfffffc ; + instr =ppc_inst (0x4bfffffc );check (instr_is_branch_to_addr (&instr, addr -4 ));/* Largest negative relative branch, - 32 MB */ - instr =0x4a000000 ; + instr =ppc_inst (0x4a000000 );check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Branch to self, with link */ @@ -477,7 +478,7 @@ static void __init test_branch_iform(void)/* Check flags are masked correctly */ err =create_branch (&instr, &instr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==0x48000000 ); +check (instr ==ppc_inst (0x48000000 )); }static void __init test_create_function_call (void )@@ -504,28 +505,28 @@ static void __init test_branch_bform(void) addr = (unsigned long )iptr;/* The simplest case, branch to self, no flags */ -check (instr_is_branch_bform (0x40000000 )); +check (instr_is_branch_bform (ppc_inst (0x40000000 )));/* All bits of target set, and flags */ -check (instr_is_branch_bform (0x43ffffff )); +check (instr_is_branch_bform (ppc_inst (0x43ffffff )));/* High bit of opcode set, which is wrong */ -check (!instr_is_branch_bform (0xc3ffffff )); +check (!instr_is_branch_bform (ppc_inst (0xc3ffffff )));/* Middle bits of opcode set, which is wrong */ -check (!instr_is_branch_bform (0x7bffffff )); +check (!instr_is_branch_bform (ppc_inst (0x7bffffff )));/* Absolute conditional branch to 0x100 */ - instr =0x43ff0103 ; + instr =ppc_inst (0x43ff0103 );check (instr_is_branch_to_addr (&instr,0x100 ));/* Absolute conditional branch to 0x20fc */ - instr =0x43ff20ff ; + instr =ppc_inst (0x43ff20ff );check (instr_is_branch_to_addr (&instr,0x20fc ));/* Maximum positive relative conditional branch, + 32 KB - 4B */ - instr =0x43ff7ffc ; + instr =ppc_inst (0x43ff7ffc );check (instr_is_branch_to_addr (&instr, addr +0x7FFC ));/* Smallest negative relative conditional branch, - 4B */ - instr =0x43fffffc ; + instr =ppc_inst (0x43fffffc );check (instr_is_branch_to_addr (&instr, addr -4 ));/* Largest negative relative conditional branch, - 32 KB */ - instr =0x43ff8000 ; + instr =ppc_inst (0x43ff8000 );check (instr_is_branch_to_addr (&instr, addr -0x8000 ));/* All condition code bits set & link */ @@ -562,7 +563,7 @@ static void __init test_branch_bform(void)/* Check flags are masked correctly */ err =create_cond_branch (&instr, iptr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==0x43FF0000 ); +check (instr ==ppc_inst (0x43FF0000 )); }static void __init test_translate_branch (void )@@ -596,7 +597,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x4a000000 ); +check (*q ==ppc_inst (0x4a000000 ));/* Maximum positive case, move x to x - 32 MB + 4 */ p = buf +0x2000000 ;@@ -607,7 +608,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x49fffffc ); +check (*q ==ppc_inst (0x49fffffc ));/* Jump to x + 16 MB moved to x + 20 MB */ p = buf;@@ -653,7 +654,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x43ff8000 ); +check (*q ==ppc_inst (0x43ff8000 ));/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ;@@ -665,7 +666,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x43ff7ffc ); +check (*q ==ppc_inst (0x43ff7ffc ));/* Jump to x + 12 KB moved to x + 20 KB */ p = buf;arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
indexb129d7b4e7dd..6e7479b8887a100644arch/powerpc/lib/feature-fixups.c +2
-1@@ -21,6 +21,7 @@#include <asm/setup.h> #include <asm/security_features.h> #include <asm/firmware.h> +#include <asm/inst.h> struct fixup_entry {unsigned long mask;@@ -89,7 +90,7 @@ static int patch_feature_section(unsigned long value, struct fixup_entry *fcur) }for (; dest < end; dest++) -raw_patch_instruction (dest,PPC_INST_NOP ); +raw_patch_instruction (dest,ppc_inst (PPC_INST_NOP ));return 0 ;}
arch/powerpc/lib/feature-fixups.c +3
-3@@ -146,15 +147,15 @@ static void do_stf_entry_barrier_fixups(enum stf_barrier_type types) pr_devel("patching dest %lx\n", (unsigned long)dest); -patch_instruction (dest, instrs[0 ]); +patch_instruction (dest,ppc_inst (instrs[0 ]));if (types &STF_BARRIER_FALLBACK )patch_branch (dest +1 , (unsigned long )&stf_barrier_fallback,BRANCH_SET_LINK );else -patch_instruction (dest +1 , instrs[1 ]); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); -patch_instruction (dest +2 , instrs[2 ]); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); }printk(KERN_DEBUG "stf-barrier: patched %d entry locations (%s
barrier)\n", i,arch/powerpc/lib/feature-fixups.c +6
-6@@ -207,12 +208,12 @@ static void do_stf_exit_barrier_fixups(enum stf_barrier_type types) pr_devel("patching dest %lx\n", (unsigned long)dest); -patch_instruction (dest, instrs[0 ]); -patch_instruction (dest +1 , instrs[1 ]); -patch_instruction (dest +2 , instrs[2 ]); -patch_instruction (dest +3 , instrs[3 ]); -patch_instruction (dest +4 , instrs[4 ]); -patch_instruction (dest +5 , instrs[5 ]); +patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); +patch_instruction (dest +3 ,ppc_inst (instrs[3 ])); +patch_instruction (dest +4 ,ppc_inst (instrs[4 ])); +patch_instruction (dest +5 ,ppc_inst (instrs[5 ])); } printk(KERN_DEBUG "stf-barrier: patched %d exit locations (%sbarrier)\n", i,
arch/powerpc/lib/feature-fixups.c +4
-4(types == STF_BARRIER_NONE) ? "no" :@@ -260,9 +261,9 @@ void do_rfi_flush_fixups(enum l1d_flush_type types)pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instrs[0 ]); -patch_instruction (dest +1 , instrs[1 ]); -patch_instruction (dest +2 , instrs[2 ]); +patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); } printk(KERN_DEBUG "rfi-flush: patched %d locations (%s flush)\n", i,@@ -295,7 +296,7 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instr); +patch_instruction (dest,ppc_inst (instr)); }arch/powerpc/lib/feature-fixups.c +2
-2printk (KERN_DEBUG "barrier-nospec: patched %d locations\n" , i);@@ -338,8 +339,8 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instr[0 ]); -patch_instruction (dest +1 , instr[1 ]); +patch_instruction (dest,ppc_inst (instr[0 ])); +patch_instruction (dest +1 ,ppc_inst (instr[1 ])); }arch/powerpc/lib/feature-fixups.c +3
-3printk (KERN_DEBUG "barrier-nospec: patched %d locations\n" , i);@@ -353,7 +354,7 @@ static void patch_btb_flush_section(long *curr) end = (void *)curr + *(curr +1 );for (; start < end; start++) {pr_devel ("patching dest %lx\n" , (unsigned long )start); -patch_instruction (start,PPC_INST_NOP ); +patch_instruction (start,ppc_inst (PPC_INST_NOP )); } }@@ -382,7 +383,7 @@ void do_lwsync_fixups(unsigned long value, void *fixup_start, void *fixup_end)for (; start < end; start++) { dest = (void *)start + *start; -raw_patch_instruction (dest,PPC_INST_LWSYNC ); +raw_patch_instruction (dest,ppc_inst (PPC_INST_LWSYNC )); } }@@ -400,7 +401,7 @@ static void do_final_fixups(void) length = (__end_interrupts - _stext) /sizeof (int );while (length--) { -raw_patch_instruction (dest, *src); +raw_patch_instruction (dest,ppc_inst (*src)); src++; dest++; }arch/powerpc/lib/test_emulate_step.c +14
-15@@ -11,6 +11,7 @@#include <asm/sstep.h> #include <asm/ppc-opcode.h> #include <asm/code-patching.h> +#include <asm/inst.h> #define IMM_L (i) ((uintptr_t)(i) & 0xffff)@@ -18,40 +19,40 @@* Defined with TEST_ prefix so it does not conflict with other * definitions. */ -#define TEST_LD (r, base, i) (PPC_INST_LD | ___PPC_RT(r) | \ +#define TEST_LD (r, base, i) ppc_inst(PPC_INST_LD | ___PPC_RT(r) | \ ___PPC_RA(base) | IMM_L(i)) -#define TEST_LWZ (r, base, i) (PPC_INST_LWZ | ___PPC_RT(r) | \ +#define TEST_LWZ (r, base, i) ppc_inst(PPC_INST_LWZ | ___PPC_RT(r) | \ ___PPC_RA(base) | IMM_L(i)) -#define TEST_LWZX (t, a, b) (PPC_INST_LWZX | ___PPC_RT(t) | \ +#define TEST_LWZX (t, a, b) ppc_inst(PPC_INST_LWZX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STD (r, base, i) (PPC_INST_STD | ___PPC_RS(r) | \ +#define TEST_STD (r, base, i) ppc_inst(PPC_INST_STD | ___PPC_RS(r) | \ ___PPC_RA(base) | ((i) & 0xfffc)) -#define TEST_LDARX (t, a, b, eh) (PPC_INST_LDARX | ___PPC_RT(t) | \ +#define TEST_LDARX (t, a, b, eh) ppc_inst(PPC_INST_LDARX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b) | \ __PPC_EH(eh)) -#define TEST_STDCX (s, a, b) (PPC_INST_STDCX | ___PPC_RS(s) | \ +#define TEST_STDCX (s, a, b) ppc_inst(PPC_INST_STDCX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LFSX (t, a, b) (PPC_INST_LFSX | ___PPC_RT(t) | \ +#define TEST_LFSX (t, a, b) ppc_inst(PPC_INST_LFSX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STFSX (s, a, b) (PPC_INST_STFSX | ___PPC_RS(s) | \ +#define TEST_STFSX (s, a, b) ppc_inst(PPC_INST_STFSX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LFDX (t, a, b) (PPC_INST_LFDX | ___PPC_RT(t) | \ +#define TEST_LFDX (t, a, b) ppc_inst(PPC_INST_LFDX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STFDX (s, a, b) (PPC_INST_STFDX | ___PPC_RS(s) | \ +#define TEST_STFDX (s, a, b) ppc_inst(PPC_INST_STFDX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LVX (t, a, b) (PPC_INST_LVX | ___PPC_RT(t) | \ +#define TEST_LVX (t, a, b) ppc_inst(PPC_INST_LVX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STVX (s, a, b) (PPC_INST_STVX | ___PPC_RS(s) | \ +#define TEST_STVX (s, a, b) ppc_inst(PPC_INST_STVX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LXVD2X (s, a, b) (PPC_INST_LXVD2X | VSX_XX1((s), R##a, R##b)) -#define TEST_STXVD2X (s, a, b) (PPC_INST_STXVD2X | VSX_XX1((s), R##a, R##b)) -#define TEST_ADD (t, a, b) (PPC_INST_ADD | ___PPC_RT(t) | \ +#define TEST_LXVD2X (s, a, b) ppc_inst(PPC_INST_LXVD2X | VSX_XX1((s), R##a,R##b))
+#defineTEST_STXVD2X(s, a, b)ppc_inst(PPC_INST_STXVD2X |VSX_XX1((s), R##a, R##b))
+#defineTEST_ADD(t, a, b)ppc_inst(PPC_INST_ADD |___PPC_RT(t)|
\arch/powerpc/lib/test_emulate_step.c +0
-1___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_ADD_DOT (t, a, b) (PPC_INST_ADD | ___PPC_RT(t) |\
+#defineTEST_ADD_DOT(t, a, b)ppc_inst(PPC_INST_ADD |___PPC_RT(t)|\arch/powerpc/lib/test_emulate_step.c +1
-1___PPC_RA(a) | ___PPC_RB(b) | 0x1) -#define TEST_ADDC (t, a, b) (PPC_INST_ADDC | ___PPC_RT(t) | \ +#define TEST_ADDC (t, a, b) ppc_inst(PPC_INST_ADDC | ___PPC_RT(t) |\
arch/powerpc/lib/test_emulate_step.c +0
-1___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_ADDC_DOT (t, a, b) (PPC_INST_ADDC | ___PPC_RT(t) |\
+#defineTEST_ADDC_DOT(t, a, b)ppc_inst(PPC_INST_ADDC |___PPC_RT(t)|\arch/powerpc/lib/test_emulate_step.c +1
-1___PPC_RA(a) | ___PPC_RB(b) | 0x1)#define MAX_SUBTESTS 16@@ -471,7 +472,7 @@ static struct compute_test compute_tests[] = { .subtests = { { .descr = "R0 = LONG_MAX", - .instr = PPC_INST_NOP, + .instr = ppc_inst(PPC_INST_NOP), .regs = { .gpr[0] = LONG_MAX, }arch/powerpc/xmon/xmon.c +3
-2@@ -54,6 +54,7 @@#include <asm/firmware.h> #include <asm/code-patching.h> #include <asm/sections.h> +#include <asm/inst.h> #ifdef CONFIG_PPC64 #include <asm/hvcall.h> @@ -949,7 +950,7 @@ static void remove_bpts(void)if ((bp->enabled & (BP_TRAP |BP_CIABR )) !=BP_TRAP )continue ;if (mread (bp->address, &instr,4 ) ==4 - && instr == bpinstr + && instr ==ppc_inst (bpinstr) &&patch_instruction ( (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) printf("Couldn't remove breakpoint at %lx\n",@@ -2845,7 +2846,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, {int nr, dotted;unsigned long first_adr; -unsigned int inst, last_inst =0 ; +unsigned int inst, last_inst =ppc_inst (0 );unsigned char val[4 ];arch/powerpc/xmon/xmon.c +1
-1dotted =0 ;@@ -2858,7 +2859,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, }break ; } - inst =GETWORD (val); + inst =ppc_inst (GETWORD (val));if (adr > first_adr && inst == last_inst) {if (!dotted) {
printf(" ...\n");
Re: [PATCH v5 04/21] powerpc: Use a macro for creating instructions from u32s
Quoted 116 lines · Balamuruhan S
Quoted 101 lines · Jordan Niethe
In preparation for instructions having a more complex data type start using a macro,
ppc_inst(), for making an instruction out of a u32. A macro is used so that instructions can be used as initializer elements. Currently this does nothing, but it will allow for creating a data type that can represent prefixed instructions.Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: - RenamePPC_INST()->ppc_inst().
- Use onepapr_paravirt.c,kgdb.c--- arch/powerpc/include/asm/code-patching.h | 3 +- arch/powerpc/include/asm/inst.h | 11 +++++ arch/powerpc/kernel/align.c | 1 + arch/powerpc/kernel/epapr_paravirt.c | 5 ++- arch/powerpc/kernel/hw_breakpoint.c | 3 +- arch/powerpc/kernel/jump_label.c | 3 +- arch/powerpc/kernel/kgdb.c | 5 ++- arch/powerpc/kernel/kprobes.c | 5 ++- arch/powerpc/kernel/module_64.c | 3 +- arch/powerpc/kernel/optprobes.c | 31 ++++++------- arch/powerpc/kernel/security.c | 9 ++-- arch/powerpc/kernel/trace/ftrace.c | 25 ++++++----- arch/powerpc/kernel/uprobes.c | 1 + arch/powerpc/kvm/emulate_loadstore.c | 2 +- arch/powerpc/lib/code-patching.c | 57 ++++++++++++------------ arch/powerpc/lib/feature-fixups.c | 39 ++++++++-------- arch/powerpc/lib/test_emulate_step.c | 39 ++++++++-------- arch/powerpc/xmon/xmon.c | 7 +-- 18 files changed, 138 insertions(+), 111 deletions(-) create mode 100644 arch/powerpc/include/asm/inst.harch/powerpc/include/asm/code-patching.h +2
-1@@ -11,6 +11,7 @@#include <linux/string.h> #include <linux/kallsyms.h> #include <asm/asm-compat.h> +#include <asm/inst.h> /* Flags for create_branch: * "b" == create_branch(addr, target, 0); @@ -48,7 +49,7 @@ static inline int patch_branch_site(s32 *site, unsigned long target, int flags)static inline int modify_instruction (unsigned int *addr,unsigned int clr,unsigned int set) { -return patch_instruction (addr, (*addr & ~clr) | set); +return patch_instruction (addr,ppc_inst ((*addr & ~clr) | set)); }static inline int modify_instruction_site(s32 *site, unsigned int clr,
unsigned int set)arch/powerpc/include/asm/inst.h new file +11
-0@@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +#ifndef _ASM_INST_H +#define _ASM_INST_H + +/* +* Instruction data type for POWER +*/ + +#define ppc_inst (x) (x) + +#endif /* _ASM_INST_H */ arch/powerpc/kernel/align.c +1
-0@@ -24,6 +24,7 @@#include <asm/disassemble.h> #include <asm/cpu_has_feature.h> #include <asm/sstep.h> +#include <asm/inst.h> struct aligninfo {unsigned char len;arch/powerpc/kernel/epapr_paravirt.c +1
-0@@ -11,6 +11,7 @@#include <asm/cacheflush.h> #include <asm/code-patching.h> #include <asm/machdep.h> +#include <asm/inst.h> #if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 )extern void epapr_ev_idle (void );arch/powerpc/kernel/epapr_paravirt.c static int __init early_init_dt_scan_epapr(unsigned long · line 44
Quoted 9 lines
arch/powerpc/kernel/epapr_paravirt.c +2
-2@@ -37,9 +38,9 @@ static int __init early_init_dt_scan_epapr(unsigned long node, for (i = 0; i < (len / 4); i++) {u32 inst =be32_to_cpu (insts[i]); -patch_instruction (epapr_hypercall_start + i, inst); +patch_instruction (epapr_hypercall_start + i,ppc_inst (inst));#if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 ) -patch_instruction (epapr_ev_idle_start + i, inst); +patch_instruction (epapr_ev_idle_start + i,ppc_inst (inst));can we do it once while assigning inst ?
Quoted 1 line
u32 inst = ppc_inst(be32_to_cpu(insts[i]));
Yeah that would be better.
Quoted 844 lines
-- Bala
Quoted 840 lines
arch/powerpc/kernel/epapr_paravirt.c +0
-0#endif }arch/powerpc/kernel/hw_breakpoint.c +2
-1@@ -24,6 +24,7 @@#include <asm/debug.h> #include <asm/debugfs.h> #include <asm/hvcall.h> +#include <asm/inst.h> #include <linux/uaccess.h> /* @@ -243,7 +244,7 @@ dar_range_overlaps(unsigned long dar, int size, struct arch_hw_breakpoint *info)static bool stepping_handler (struct pt_regs *regs,struct perf_event *bp,struct arch_hw_breakpoint *info) { -unsigned int instr =0 ; +unsigned int instr =ppc_inst (0 );int ret, type, size;struct instruction_op op;unsigned long addr = info->address;arch/powerpc/kernel/jump_label.c +2
-1@@ -6,6 +6,7 @@#include <linux/kernel.h> #include <linux/jump_label.h> #include <asm/code-patching.h> +#include <asm/inst.h> void arch_jump_label_transform (struct jump_entry *entry,enum jump_label_type type)@@ -15,5 +16,5 @@ void arch_jump_label_transform(struct jump_entry *entry,if (type ==JUMP_LABEL_JMP )patch_branch (addr, entry->target,0 );else -patch_instruction (addr,PPC_INST_NOP ); +patch_instruction (addr,ppc_inst (PPC_INST_NOP )); }arch/powerpc/kernel/kgdb.c +3
-2@@ -26,6 +26,7 @@#include <asm/debug.h> #include <asm/code-patching.h> #include <linux/slab.h> +#include <asm/inst.h> /* * This table contains the mapping between PowerPC hardware trap types, and @@ -424,7 +425,7 @@ int kgdb_arch_set_breakpoint(struct kgdb_bkpt *bpt)if (err)return err; - err =patch_instruction (addr,BREAK_INSTR ); + err =patch_instruction (addr,ppc_inst (BREAK_INSTR ));if (err)return -EFAULT ;@@ -439,7 +440,7 @@ int kgdb_arch_remove_breakpoint(struct kgdb_bkpt *bpt)unsigned int instr = *(unsigned int *)bpt->saved_instr;unsigned int *addr = (unsigned int *)bpt->bpt_addr; - err =patch_instruction (addr, instr); + err =patch_instruction (addr,ppc_inst (instr));if (err)return -EFAULT ;arch/powerpc/kernel/kprobes.c +3
-2@@ -23,6 +23,7 @@#include <asm/cacheflush.h> #include <asm/sstep.h> #include <asm/sections.h> +#include <asm/inst.h> #include <linux/uaccess.h> DEFINE_PER_CPU(struct kprobe *, current_kprobe) = NULL;@@ -138,13 +139,13 @@ NOKPROBE_SYMBOL(arch_prepare_kprobe);void arch_arm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,BREAKPOINT_INSTRUCTION ); +patch_instruction (p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); }NOKPROBE_SYMBOL (arch_arm_kprobe);void arch_disarm_kprobe (struct kprobe *p) { -patch_instruction (p->addr, p->opcode); +patch_instruction (p->addr,ppc_inst (p->opcode)); }NOKPROBE_SYMBOL (arch_disarm_kprobe);arch/powerpc/kernel/module_64.c +2
-1@@ -20,6 +20,7 @@#include <linux/sort.h> #include <asm/setup.h> #include <asm/sections.h> +#include <asm/inst.h> /* FIXME: We don't do .init separately. To do this, we'd need to have a separate r2 value in the init and core section, and stub between @@ -506,7 +507,7 @@ static int restore_r2(const char *name, u32 *instruction,struct module *me) * "link" branches and they don't return, so they don't need the r2 * restore afterwards. */ -if (!instr_is_relative_link_branch (*prev_insn)) +if (!instr_is_relative_link_branch (ppc_inst (*prev_insn)))return 1 ;if (*instruction != PPC_INST_NOP) {arch/powerpc/kernel/optprobes.c +5
-4@@ -16,6 +16,7 @@#include <asm/code-patching.h> #include <asm/sstep.h> #include <asm/ppc-opcode.h> +#include <asm/inst.h> #define TMPL_CALL_HDLR_IDX \ (optprobe_template_call_handler - optprobe_template_entry)@@ -147,13 +148,13 @@ void arch_remove_optimized_kprobe(struct optimized_kprobe *op)void patch_imm32_load_insns (unsigned int val,kprobe_opcode_t *addr) {/* addis r4,0,(insn)@h */ -patch_instruction (addr,PPC_INST_ADDIS |___PPC_RT (4 ) | - ((val >>16 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (4 ) | + ((val >>16 ) &0xffff ))); addr++;/* ori r4,r4,(insn)@l */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (4 ) | -___PPC_RS (4 ) | (val &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (4 ) | +___PPC_RS (4 ) | (val &0xffff ))); }/*
arch/powerpc/kernel/optprobes.c +10
-10@@ -163,28 +164,28 @@ void patch_imm32_load_insns(unsigned int val, kprobe_opcode_t *addr)void patch_imm64_load_insns (unsigned long val,kprobe_opcode_t *addr) {/* lis r3,(op)@highest */ -patch_instruction (addr,PPC_INST_ADDIS |___PPC_RT (3 ) | - ((val >>48 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (3 ) | + ((val >>48 ) &0xffff ))); addr++;/* ori r3,r3,(op)@higher */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (3 ) | -___PPC_RS (3 ) | ((val >>32 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +___PPC_RS (3 ) | ((val >>32 ) &0xffff ))); addr++;/* rldicr r3,r3,32,31 */ -patch_instruction (addr,PPC_INST_RLDICR |___PPC_RA (3 ) | -___PPC_RS (3 ) |__PPC_SH64 (32 ) |__PPC_ME64 (31 )); +patch_instruction (addr,ppc_inst (PPC_INST_RLDICR |___PPC_RA (3 ) | +___PPC_RS (3 ) |__PPC_SH64 (32 ) |__PPC_ME64 (31 ))); addr++;/* oris r3,r3,(op)@h */ -patch_instruction (addr,PPC_INST_ORIS |___PPC_RA (3 ) | -___PPC_RS (3 ) | ((val >>16 ) &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORIS |___PPC_RA (3 ) | +___PPC_RS (3 ) | ((val >>16 ) &0xffff ))); addr++;/* ori r3,r3,(op)@l */ -patch_instruction (addr,PPC_INST_ORI |___PPC_RA (3 ) | -___PPC_RS (3 ) | (val &0xffff )); +patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +___PPC_RS (3 ) | (val &0xffff ))); }int arch_prepare_optimized_kprobe(struct
optimized_kprobe*op, struct kprobe
*p)arch/powerpc/kernel/optprobes.c +1
-1@@ -230,7 +231,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) size = (TMPL_END_IDX *sizeof (kprobe_opcode_t)) /sizeof (int );pr_devel ("Copying template to %p, size %lu\n" , buff, size);for (i =0 ; i < size; i++) { - rc =patch_instruction (buff + i, *(optprobe_template_entry + i)); + rc =patch_instruction (buff + i,ppc_inst (*(optprobe_template_entry + i)));if (rc < 0) goto error; }arch/powerpc/kernel/security.c +3
-2@@ -14,6 +14,7 @@#include <asm/debugfs.h> #include <asm/security_features.h> #include <asm/setup.h> +#include <asm/inst.h> u64 powerpc_security_features__read_mostly =SEC_FTR_DEFAULT ;@@ -403,9 +404,9 @@ static void toggle_count_cache_flush(bool enable) enable = false;if (!enable) { -patch_instruction_site (&patch__call_flush_count_cache, PPC_INST_NOP); +patch_instruction_site (&patch__call_flush_count_cache,ppc_inst (PPC_INST_NOP ));#ifdef CONFIG_KVM_BOOK3S_HV_POSSIBLE -patch_instruction_site (&patch__call_kvm_flush_link_stack, PPC_INST_NOP); + patch_instruction_site(&patch__call_kvm_flush_link_stack,
ppc_inst(PPC_INST_NOP));#endif pr_info("link-stack-flush: software flush disabled.\n"); link_stack_flush_enabled = false;arch/powerpc/kernel/security.c +1
-1@@ -428,7 +429,7 @@ static void toggle_count_cache_flush(bool enable)// If we just need to flush the link stack, patch an early return if (!security_ftr_enabled (SEC_FTR_FLUSH_COUNT_CACHE )) { -patch_instruction_site (&patch__flush_link_stack_return, PPC_INST_BLR); +patch_instruction_site (&patch__flush_link_stack_return,ppc_inst (PPC_INST_BLR ));no_count_cache_flush ();return; }arch/powerpc/kernel/security.c +1
-1@@ -439,7 +440,7 @@ static void toggle_count_cache_flush(bool enable)return ; } -patch_instruction_site (&patch__flush_count_cache_return,PPC_INST_BLR ); +patch_instruction_site (&patch__flush_count_cache_return,ppc_inst (PPC_INST_BLR )); count_cache_flush_type =COUNT_CACHE_FLUSH_HW ; pr_info("count-cache-flush: hardware assisted flush sequenceenabled\n");
}arch/powerpc/kernel/trace/ftrace.c +7
-6@@ -27,6 +27,7 @@#include <asm/code-patching.h> #include <asm/ftrace.h> #include <asm/syscall.h> +#include <asm/inst.h> #ifdef CONFIG_DYNAMIC_FTRACE @@ -161,7 +162,7 @@ __ftrace_make_nop(struct module *mod,#ifdef CONFIG_MPROFILE_KERNEL /* When using -mkernel_profile there is no load to jump over */ - pop =PPC_INST_NOP ; + pop =ppc_inst (PPC_INST_NOP );if (probe_kernel_read (&op, (void *)(ip -4 ),4 )) {pr_err ("Fetching instruction at %lx failed.\n" , ip -4 );@@ -169,7 +170,7 @@ __ftrace_make_nop(struct module *mod, }/* We expect either a mflr r0, or a std r0, LRSAVE(r1) */ -if (op !=PPC_INST_MFLR && op !=PPC_INST_STD_LR ) { +if (op !=ppc_inst (PPC_INST_MFLR ) && op !=ppc_inst (PPC_INST_STD_LR )) {pr_err ("Unexpected instruction %08x around bl _mcount\n" , op);return -EINVAL ; }@@ -188,7 +189,7 @@ __ftrace_make_nop(struct module *mod,* Use a b +8 to jump over the load. */ - pop =PPC_INST_BRANCH |8 ;/* b +8 */ + pop =ppc_inst (PPC_INST_BRANCH |8 );/* b +8 */ /* * Check what is in the next instruction. We can see ld r2,40(r1), but @@ -199,7 +200,7 @@ __ftrace_make_nop(struct module *mod,return -EFAULT ; } -if (op !=PPC_INST_LD_TOC ) { +if (op !=ppc_inst (PPC_INST_LD_TOC )) {pr_err ("Expected %08x found %08x\n" ,PPC_INST_LD_TOC , op);return -EINVAL ; }@@ -275,7 +276,7 @@ __ftrace_make_nop(struct module *mod,return -EINVAL ; } - op =PPC_INST_NOP ; + op =ppc_inst (PPC_INST_NOP );if (patch_instruction ((unsigned int *)ip, op))return -EPERM ;@@ -420,7 +421,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr) } } -if (patch_instruction ((unsigned int *)ip,PPC_INST_NOP )) { +if (patch_instruction ((unsigned int *)ip,ppc_inst (PPC_INST_NOP ))) {pr_err ("Patching NOP failed.\n" );return -EPERM ;}arch/powerpc/kernel/trace/ftrace.c +2
-2@@ -442,7 +443,7 @@ int ftrace_make_nop(struct module *mod,if (test_24bit_addr (ip, addr)) {/* within range */ old =ftrace_call_replace (ip, addr,1 ); - new =PPC_INST_NOP ; + new =ppc_inst (PPC_INST_NOP );return ftrace_modify_code (ip, old, new); }else if (core_kernel_text (ip))return __ftrace_make_nop_kernel (rec, addr);@@ -496,7 +497,7 @@ expected_nop_sequence(void *ip, unsigned int op0,unsigned int op1) * The load offset is different depending on the ABI. For simplicity * just mask it out when doing the compare. */ -if ((op0 !=0x48000008 ) || ((op1 &0xffff0000 ) !=0xe8410000 )) +if ((op0 !=ppc_inst (0x48000008 )) || ((op1 &0xffff0000 ) !=0xe8410000 ))return 0 ;return 1;}
arch/powerpc/kernel/trace/ftrace.c +2
-2@@ -505,7 +506,7 @@ static int expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1) {/* look for patched "NOP" on ppc64 with -mprofile-kernel */ -if (op0 !=PPC_INST_NOP ) +if (op0 !=ppc_inst (PPC_INST_NOP ))return 0 ;return 1 ; }@@ -588,7 +589,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ;/* It should be pointing to a nop */ -if (op !=PPC_INST_NOP ) { +if (op !=ppc_inst (PPC_INST_NOP )) {pr_err ("Expected NOP but have %x\n" , op);return -EINVAL ;}arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -645,7 +646,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ; } -if (op !=PPC_INST_NOP ) { +if (op !=ppc_inst (PPC_INST_NOP )) {pr_err ("Unexpected call sequence at %p: %x\n" , ip, op);return -EINVAL ;}arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -676,7 +677,7 @@ int ftrace_make_call(struct dyn_ftrace *rec, unsignedlong addr) */ if (test_24bit_addr (ip, addr)) {/* within range */ - old =PPC_INST_NOP ; + old =ppc_inst (PPC_INST_NOP ); new =ftrace_call_replace (ip, addr,1 );return ftrace_modify_code (ip, old, new);} else if (core_kernel_text(ip))arch/powerpc/kernel/uprobes.c +1
-0@@ -14,6 +14,7 @@#include <linux/kdebug.h> #include <asm/sstep.h> +#include <asm/inst.h> #define UPROBE_TRAP_NR UINT_MAXarch/powerpc/kvm/emulate_loadstore.c +1
-1@@ -95,7 +95,7 @@ int kvmppc_emulate_loadstore(struct kvm_vcpu *vcpu) emulated =EMULATE_FAIL ; vcpu->arch.regs.msr = vcpu->arch.shared->msr; -if (analyse_instr (&op, &vcpu->arch.regs, inst) ==0 ) { +if (analyse_instr (&op, &vcpu->arch.regs,ppc_inst (inst)) ==0 ) {int type = op.type &INSTR_TYPE_MASK ;int size =GETSIZE (op.type);arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index4af564aeedf1..fdf0d6ea3575100644arch/powerpc/lib/code-patching.c +29
-28@@ -17,6 +17,7 @@#include <asm/page.h> #include <asm/code-patching.h> #include <asm/setup.h> +#include <asm/inst.h> static int __patch_instruction (unsigned int *exec_addr,unsigned int instr,unsigned int *patch_addr)@@ -413,37 +414,37 @@ static void __init test_branch_iform(void) addr = (unsigned long )&instr;/* The simplest case, branch to self, no flags */ -check (instr_is_branch_iform (0x48000000 )); +check (instr_is_branch_iform (ppc_inst (0x48000000 )));/* All bits of target set, and flags */ -check (instr_is_branch_iform (0x4bffffff )); +check (instr_is_branch_iform (ppc_inst (0x4bffffff )));/* High bit of opcode set, which is wrong */ -check (!instr_is_branch_iform (0xcbffffff )); +check (!instr_is_branch_iform (ppc_inst (0xcbffffff )));/* Middle bits of opcode set, which is wrong */ -check (!instr_is_branch_iform (0x7bffffff )); +check (!instr_is_branch_iform (ppc_inst (0x7bffffff )));/* Simplest case, branch to self with link */ -check (instr_is_branch_iform (0x48000001 )); +check (instr_is_branch_iform (ppc_inst (0x48000001 )));/* All bits of targets set */ -check (instr_is_branch_iform (0x4bfffffd )); +check (instr_is_branch_iform (ppc_inst (0x4bfffffd )));/* Some bits of targets set */ -check (instr_is_branch_iform (0x4bff00fd )); +check (instr_is_branch_iform (ppc_inst (0x4bff00fd )));/* Must be a valid branch to start with */ -check (!instr_is_branch_iform (0x7bfffffd )); +check (!instr_is_branch_iform (ppc_inst (0x7bfffffd )));/* Absolute branch to 0x100 */ - instr =0x48000103 ; + instr =ppc_inst (0x48000103 );check (instr_is_branch_to_addr (&instr,0x100 ));/* Absolute branch to 0x420fc */ - instr =0x480420ff ; + instr =ppc_inst (0x480420ff );check (instr_is_branch_to_addr (&instr,0x420fc ));/* Maximum positive relative branch, + 20MB - 4B */ - instr =0x49fffffc ; + instr =ppc_inst (0x49fffffc );check (instr_is_branch_to_addr (&instr, addr +0x1FFFFFC ));/* Smallest negative relative branch, - 4B */ - instr =0x4bfffffc ; + instr =ppc_inst (0x4bfffffc );check (instr_is_branch_to_addr (&instr, addr -4 ));/* Largest negative relative branch, - 32 MB */ - instr =0x4a000000 ; + instr =ppc_inst (0x4a000000 );check (instr_is_branch_to_addr (&instr, addr -0x2000000 ));/* Branch to self, with link */ @@ -477,7 +478,7 @@ static void __init test_branch_iform(void)/* Check flags are masked correctly */ err =create_branch (&instr, &instr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==0x48000000 ); +check (instr ==ppc_inst (0x48000000 )); }static void __init test_create_function_call (void )@@ -504,28 +505,28 @@ static void __init test_branch_bform(void) addr = (unsigned long )iptr;/* The simplest case, branch to self, no flags */ -check (instr_is_branch_bform (0x40000000 )); +check (instr_is_branch_bform (ppc_inst (0x40000000 )));/* All bits of target set, and flags */ -check (instr_is_branch_bform (0x43ffffff )); +check (instr_is_branch_bform (ppc_inst (0x43ffffff )));/* High bit of opcode set, which is wrong */ -check (!instr_is_branch_bform (0xc3ffffff )); +check (!instr_is_branch_bform (ppc_inst (0xc3ffffff )));/* Middle bits of opcode set, which is wrong */ -check (!instr_is_branch_bform (0x7bffffff )); +check (!instr_is_branch_bform (ppc_inst (0x7bffffff )));/* Absolute conditional branch to 0x100 */ - instr =0x43ff0103 ; + instr =ppc_inst (0x43ff0103 );check (instr_is_branch_to_addr (&instr,0x100 ));/* Absolute conditional branch to 0x20fc */ - instr =0x43ff20ff ; + instr =ppc_inst (0x43ff20ff );check (instr_is_branch_to_addr (&instr,0x20fc ));/* Maximum positive relative conditional branch, + 32 KB - 4B */ - instr =0x43ff7ffc ; + instr =ppc_inst (0x43ff7ffc );check (instr_is_branch_to_addr (&instr, addr +0x7FFC ));/* Smallest negative relative conditional branch, - 4B */ - instr =0x43fffffc ; + instr =ppc_inst (0x43fffffc );check (instr_is_branch_to_addr (&instr, addr -4 ));/* Largest negative relative conditional branch, - 32 KB */ - instr =0x43ff8000 ; + instr =ppc_inst (0x43ff8000 );check (instr_is_branch_to_addr (&instr, addr -0x8000 ));/* All condition code bits set & link */ @@ -562,7 +563,7 @@ static void __init test_branch_bform(void)/* Check flags are masked correctly */ err =create_cond_branch (&instr, iptr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==0x43FF0000 ); +check (instr ==ppc_inst (0x43FF0000 )); }static void __init test_translate_branch (void )@@ -596,7 +597,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x4a000000 ); +check (*q ==ppc_inst (0x4a000000 ));/* Maximum positive case, move x to x - 32 MB + 4 */ p = buf +0x2000000 ;@@ -607,7 +608,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x49fffffc ); +check (*q ==ppc_inst (0x49fffffc ));/* Jump to x + 16 MB moved to x + 20 MB */ p = buf;@@ -653,7 +654,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x43ff8000 ); +check (*q ==ppc_inst (0x43ff8000 ));/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ;@@ -665,7 +666,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==0x43ff7ffc ); +check (*q ==ppc_inst (0x43ff7ffc ));/* Jump to x + 12 KB moved to x + 20 KB */ p = buf;arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
indexb129d7b4e7dd..6e7479b8887a100644arch/powerpc/lib/feature-fixups.c +2
-1@@ -21,6 +21,7 @@#include <asm/setup.h> #include <asm/security_features.h> #include <asm/firmware.h> +#include <asm/inst.h> struct fixup_entry {unsigned long mask;@@ -89,7 +90,7 @@ static int patch_feature_section(unsigned long value, struct fixup_entry *fcur) }for (; dest < end; dest++) -raw_patch_instruction (dest,PPC_INST_NOP ); +raw_patch_instruction (dest,ppc_inst (PPC_INST_NOP ));return 0 ;}
arch/powerpc/lib/feature-fixups.c +3
-3@@ -146,15 +147,15 @@ static void do_stf_entry_barrier_fixups(enum stf_barrier_type types) pr_devel("patching dest %lx\n", (unsigned long)dest); -patch_instruction (dest, instrs[0 ]); +patch_instruction (dest,ppc_inst (instrs[0 ]));if (types &STF_BARRIER_FALLBACK )patch_branch (dest +1 , (unsigned long )&stf_barrier_fallback,BRANCH_SET_LINK );else -patch_instruction (dest +1 , instrs[1 ]); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); -patch_instruction (dest +2 , instrs[2 ]); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); }printk(KERN_DEBUG "stf-barrier: patched %d entry locations (%s
barrier)\n", i,arch/powerpc/lib/feature-fixups.c +6
-6@@ -207,12 +208,12 @@ static void do_stf_exit_barrier_fixups(enum stf_barrier_type types) pr_devel("patching dest %lx\n", (unsigned long)dest); -patch_instruction (dest, instrs[0 ]); -patch_instruction (dest +1 , instrs[1 ]); -patch_instruction (dest +2 , instrs[2 ]); -patch_instruction (dest +3 , instrs[3 ]); -patch_instruction (dest +4 , instrs[4 ]); -patch_instruction (dest +5 , instrs[5 ]); +patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); +patch_instruction (dest +3 ,ppc_inst (instrs[3 ])); +patch_instruction (dest +4 ,ppc_inst (instrs[4 ])); +patch_instruction (dest +5 ,ppc_inst (instrs[5 ])); } printk(KERN_DEBUG "stf-barrier: patched %d exit locations (%sbarrier)\n", i,
(types == STF_BARRIER_NONE) ? "no" :arch/powerpc/lib/feature-fixups.c +4
-4@@ -260,9 +261,9 @@ void do_rfi_flush_fixups(enum l1d_flush_type types)pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instrs[0 ]); -patch_instruction (dest +1 , instrs[1 ]); -patch_instruction (dest +2 , instrs[2 ]); +patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); } printk(KERN_DEBUG "rfi-flush: patched %d locations (%s flush)\n", i,@@ -295,7 +296,7 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instr); +patch_instruction (dest,ppc_inst (instr)); }printk(KERN_DEBUG "barrier-nospec: patched %d locations\n", i);arch/powerpc/lib/feature-fixups.c +2
-2@@ -338,8 +339,8 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest, instr[0 ]); -patch_instruction (dest +1 , instr[1 ]); +patch_instruction (dest,ppc_inst (instr[0 ])); +patch_instruction (dest +1 ,ppc_inst (instr[1 ])); }printk(KERN_DEBUG "barrier-nospec: patched %d locations\n", i);arch/powerpc/lib/feature-fixups.c +3
-3@@ -353,7 +354,7 @@ static void patch_btb_flush_section(long *curr) end = (void *)curr + *(curr +1 );for (; start < end; start++) {pr_devel ("patching dest %lx\n" , (unsigned long )start); -patch_instruction (start,PPC_INST_NOP ); +patch_instruction (start,ppc_inst (PPC_INST_NOP )); } }@@ -382,7 +383,7 @@ void do_lwsync_fixups(unsigned long value, void *fixup_start, void *fixup_end)for (; start < end; start++) { dest = (void *)start + *start; -raw_patch_instruction (dest,PPC_INST_LWSYNC ); +raw_patch_instruction (dest,ppc_inst (PPC_INST_LWSYNC )); } }@@ -400,7 +401,7 @@ static void do_final_fixups(void) length = (__end_interrupts - _stext) /sizeof (int );while (length--) { -raw_patch_instruction (dest, *src); +raw_patch_instruction (dest,ppc_inst (*src)); src++; dest++; }arch/powerpc/lib/test_emulate_step.c +14
-15@@ -11,6 +11,7 @@#include <asm/sstep.h> #include <asm/ppc-opcode.h> #include <asm/code-patching.h> +#include <asm/inst.h> #define IMM_L (i) ((uintptr_t)(i) & 0xffff)@@ -18,40 +19,40 @@* Defined with TEST_ prefix so it does not conflict with other * definitions. */ -#define TEST_LD (r, base, i) (PPC_INST_LD | ___PPC_RT(r) | \ +#define TEST_LD (r, base, i) ppc_inst(PPC_INST_LD | ___PPC_RT(r) | \ ___PPC_RA(base) | IMM_L(i)) -#define TEST_LWZ (r, base, i) (PPC_INST_LWZ | ___PPC_RT(r) | \ +#define TEST_LWZ (r, base, i) ppc_inst(PPC_INST_LWZ | ___PPC_RT(r) | \ ___PPC_RA(base) | IMM_L(i)) -#define TEST_LWZX (t, a, b) (PPC_INST_LWZX | ___PPC_RT(t) | \ +#define TEST_LWZX (t, a, b) ppc_inst(PPC_INST_LWZX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STD (r, base, i) (PPC_INST_STD | ___PPC_RS(r) | \ +#define TEST_STD (r, base, i) ppc_inst(PPC_INST_STD | ___PPC_RS(r) | \ ___PPC_RA(base) | ((i) & 0xfffc)) -#define TEST_LDARX (t, a, b, eh) (PPC_INST_LDARX | ___PPC_RT(t) | \ +#define TEST_LDARX (t, a, b, eh) ppc_inst(PPC_INST_LDARX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b) | \ __PPC_EH(eh)) -#define TEST_STDCX (s, a, b) (PPC_INST_STDCX | ___PPC_RS(s) | \ +#define TEST_STDCX (s, a, b) ppc_inst(PPC_INST_STDCX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LFSX (t, a, b) (PPC_INST_LFSX | ___PPC_RT(t) | \ +#define TEST_LFSX (t, a, b) ppc_inst(PPC_INST_LFSX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STFSX (s, a, b) (PPC_INST_STFSX | ___PPC_RS(s) | \ +#define TEST_STFSX (s, a, b) ppc_inst(PPC_INST_STFSX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LFDX (t, a, b) (PPC_INST_LFDX | ___PPC_RT(t) | \ +#define TEST_LFDX (t, a, b) ppc_inst(PPC_INST_LFDX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STFDX (s, a, b) (PPC_INST_STFDX | ___PPC_RS(s) | \ +#define TEST_STFDX (s, a, b) ppc_inst(PPC_INST_STFDX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LVX (t, a, b) (PPC_INST_LVX | ___PPC_RT(t) | \ +#define TEST_LVX (t, a, b) ppc_inst(PPC_INST_LVX | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_STVX (s, a, b) (PPC_INST_STVX | ___PPC_RS(s) | \ +#define TEST_STVX (s, a, b) ppc_inst(PPC_INST_STVX | ___PPC_RS(s) | \ ___PPC_RA(a) | ___PPC_RB(b)) -#define TEST_LXVD2X (s, a, b) (PPC_INST_LXVD2X | VSX_XX1((s), R##a, R##b)) -#define TEST_STXVD2X (s, a, b) (PPC_INST_STXVD2X | VSX_XX1((s), R##a, R##b)) -#define TEST_ADD (t, a, b) (PPC_INST_ADD | ___PPC_RT(t) | \ +#define TEST_LXVD2X (s, a, b) ppc_inst(PPC_INST_LXVD2X | VSX_XX1((s), R##a,R##b))
+#defineTEST_STXVD2X(s, a, b)ppc_inst(PPC_INST_STXVD2X |VSX_XX1((s), R##a, R##b))
+#defineTEST_ADD(t, a, b)ppc_inst(PPC_INST_ADD |___PPC_RT(t)|\ ___PPC_RA(a) | ___PPC_RB(b))-#define
TEST_ADD_DOT(t, a, b)(PPC_INST_ADD|___PPC_RT(t)|
\arch/powerpc/lib/test_emulate_step.c +2
-1+#define TEST_ADD_DOT (t, a, b) ppc_inst(PPC_INST_ADD | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b) | 0x1) -#define TEST_ADDC (t, a, b) (PPC_INST_ADDC | ___PPC_RT(t) | \ +#define TEST_ADDC (t, a, b) ppc_inst(PPC_INST_ADDC | ___PPC_RT(t) |\ ___PPC_RA(a) | ___PPC_RB(b))-#define
TEST_ADDC_DOT(t, a, b)(PPC_INST_ADDC|___PPC_RT(t)|
\arch/powerpc/lib/test_emulate_step.c +2
-1+#define TEST_ADDC_DOT (t, a, b) ppc_inst(PPC_INST_ADDC | ___PPC_RT(t) | \ ___PPC_RA(a) | ___PPC_RB(b) | 0x1)#define MAX_SUBTESTS 16@@ -471,7 +472,7 @@ static struct compute_test compute_tests[] = { .subtests = { { .descr = "R0 = LONG_MAX", - .instr = PPC_INST_NOP, + .instr = ppc_inst(PPC_INST_NOP), .regs = { .gpr[0] = LONG_MAX, }arch/powerpc/xmon/xmon.c +3
-2@@ -54,6 +54,7 @@#include <asm/firmware.h> #include <asm/code-patching.h> #include <asm/sections.h> +#include <asm/inst.h> #ifdef CONFIG_PPC64 #include <asm/hvcall.h> @@ -949,7 +950,7 @@ static void remove_bpts(void)if ((bp->enabled & (BP_TRAP |BP_CIABR )) !=BP_TRAP )continue ;if (mread (bp->address, &instr,4 ) ==4 - && instr == bpinstr + && instr ==ppc_inst (bpinstr) &&patch_instruction ( (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) printf("Couldn't remove breakpoint at %lx\n",@@ -2845,7 +2846,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, {int nr, dotted;unsigned long first_adr; -unsigned int inst, last_inst =0 ; +unsigned int inst, last_inst =ppc_inst (0 );unsigned char val[4 ];dotted = 0;arch/powerpc/xmon/xmon.c +1
-1@@ -2858,7 +2859,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, }break ; } - inst =GETWORD (val); + inst =ppc_inst (GETWORD (val));if (adr > first_adr && inst == last_inst) {if (!dotted) {printf(" ...\n");
PATCH v5 5/21 powerpc: Use a function for getting the instruction op code
In reply to Jordan NietheIn preparation for using a data type for instructions that can not be directly used with the '>>' operator use a function for getting the op code of an instruction.
---
v4: New to series
--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/lib/code-patching.c | 4 ++-- 3 files changed, 8 insertions(+), 3 deletions(-)
arch/powerpc/include/asm/inst.h +5 -0
@@ -8,4 +8,9 @@#define ppc_inst (x) (x) +static inline int ppc_inst_opcode (u32 x) +{ +return x >>26 ; +} +#endif /* _ASM_INST_H */
arch/powerpc/kernel/align.c +1 -1
@@ -314,7 +314,7 @@ int fix_alignment(struct pt_regs *regs) }#ifdef CONFIG_SPE -if ((instr >>26 ) ==0x4 ) { +if (ppc_inst_opcode (instr) ==0x4 ) {int reg = (instr >>21 ) &0x1f ;PPC_WARN_ALIGNMENT (spe, regs);return emulate_spe (regs, reg, instr);
arch/powerpc/lib/code-patching.c +2 -2
@@ -231,7 +231,7 @@ bool is_offset_in_branch_range(long offset)*/ bool is_conditional_branch (unsigned int instr) { -unsigned int opcode = instr >>26 ; +unsigned int opcode =ppc_inst_opcode (instr);if (opcode ==16 )/* bc, bca, bcl, bcla */ return true;
@@ -289,7 +289,7 @@ int create_cond_branch(unsigned int *instr, const unsigned int *addr,static unsigned int branch_opcode (unsigned int instr) { -return (instr >>26 ) &0x3F ; +return ppc_inst_opcode (instr) &0x3F ; }static int instr_is_branch_iform (unsigned int instr)
Signature · 1 line
2.17.1
Re: [PATCH v5 05/21] powerpc: Use a function for getting the instruction op code
Le 06/04/2020 à 10:09, Jordan Niethe a écrit :
Quoted 11 lines
In preparation for using a data type for instructions that can not be directly used with the '>>' operator use a function for getting the op code of an instruction.
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/lib/code-patching.c | 4 ++--
What about store_updates_sp() in mm/fault.c ?
Christophe
Quoted 52 lines
3 files changed, 8 insertions(+), 3 deletions(-)arch/powerpc/include/asm/inst.h +5
-0@@ -8,4 +8,9 @@#define ppc_inst (x) (x) +static inline int ppc_inst_opcode (u32 x) +{ +return x >>26 ; +} +#endif /* _ASM_INST_H */ arch/powerpc/kernel/align.c +1
-1@@ -314,7 +314,7 @@ int fix_alignment(struct pt_regs *regs) }#ifdef CONFIG_SPE -if ((instr >>26 ) ==0x4 ) { +if (ppc_inst_opcode (instr) ==0x4 ) {int reg = (instr >>21 ) &0x1f ;PPC_WARN_ALIGNMENT (spe, regs);return emulate_spe (regs, reg, instr);arch/powerpc/lib/code-patching.c +2
-2@@ -231,7 +231,7 @@ bool is_offset_in_branch_range(long offset)*/ bool is_conditional_branch (unsigned int instr) { -unsigned int opcode = instr >>26 ; +unsigned int opcode =ppc_inst_opcode (instr);if (opcode ==16 )/* bc, bca, bcl, bcla */ return true;@@ -289,7 +289,7 @@ int create_cond_branch(unsigned int *instr, const unsigned int *addr,static unsigned int branch_opcode (unsigned int instr) { -return (instr >>26 ) &0x3F ; +return ppc_inst_opcode (instr) &0x3F ; }static int instr_is_branch_iform (unsigned int instr)
Re: [PATCH v5 05/21] powerpc: Use a function for getting the instruction op code
Quoted 16 lines · Christophe Leroy
Quoted 11 lines · Jordan Niethe
In preparation for using a data type for instructions that can not be directly used with the '>>' operator use a function for getting the op code of an instruction.
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/lib/code-patching.c | 4 ++--
Quoted 1 line
What about
store_updates_sp()inmm/fault.c?
True. An early revision of this series used analyse_instr() there, which ended up causing issues. But it still can use the instruction data type. I will change that.
Quoted 55 lines
Christophe
Quoted 52 lines
3 files changed, 8 insertions(+), 3 deletions(-)arch/powerpc/include/asm/inst.h +5
-0@@ -8,4 +8,9 @@#define ppc_inst (x) (x) +static inline int ppc_inst_opcode (u32 x) +{ +return x >>26 ; +} +#endif /* _ASM_INST_H */ arch/powerpc/kernel/align.c +1
-1@@ -314,7 +314,7 @@ int fix_alignment(struct pt_regs *regs) }#ifdef CONFIG_SPE -if ((instr >>26 ) ==0x4 ) { +if (ppc_inst_opcode (instr) ==0x4 ) {int reg = (instr >>21 ) &0x1f ;PPC_WARN_ALIGNMENT (spe, regs);return emulate_spe (regs, reg, instr);arch/powerpc/lib/code-patching.c +2
-2@@ -231,7 +231,7 @@ bool is_offset_in_branch_range(long offset)*/ bool is_conditional_branch (unsigned int instr) { -unsigned int opcode = instr >>26 ; +unsigned int opcode =ppc_inst_opcode (instr);if (opcode ==16 )/* bc, bca, bcl, bcla */ return true;@@ -289,7 +289,7 @@ int create_cond_branch(unsigned int *instr, const unsigned int *addr,static unsigned int branch_opcode (unsigned int instr) { -return (instr >>26 ) &0x3F ; +return ppc_inst_opcode (instr) &0x3F ; }static int instr_is_branch_iform (unsigned int instr)
Re: [PATCH v5 05/21] powerpc: Use a function for getting the instruction op code
In reply to Jordan NietheQuoted 3 lines · Jordan Niethe
In preparation for using a data type for instructions that can not be directly used with the '>>' operator use a function for getting the op code of an instruction.
vecemu.c and sstep.c will need ppc_inst_opcode().
-- Bala
Quoted 62 lines
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/lib/code-patching.c | 4 ++-- 3 files changed, 8 insertions(+), 3 deletions(-)arch/powerpc/include/asm/inst.h +5
-0@@ -8,4 +8,9 @@#define ppc_inst (x) (x) +static inline int ppc_inst_opcode (u32 x) +{ +return x >>26 ; +} +#endif /* _ASM_INST_H */ arch/powerpc/kernel/align.c +1
-1@@ -314,7 +314,7 @@ int fix_alignment(struct pt_regs *regs) }#ifdef CONFIG_SPE -if ((instr >>26 ) ==0x4 ) { +if (ppc_inst_opcode (instr) ==0x4 ) {int reg = (instr >>21 ) &0x1f ;PPC_WARN_ALIGNMENT (spe, regs);return emulate_spe (regs, reg, instr);arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
indexfdf0d6ea3575..099a515202aa100644arch/powerpc/lib/code-patching.c +2
-2@@ -231,7 +231,7 @@ bool is_offset_in_branch_range(long offset)*/ bool is_conditional_branch (unsigned int instr) { -unsigned int opcode = instr >>26 ; +unsigned int opcode =ppc_inst_opcode (instr);if (opcode ==16 )/* bc, bca, bcl, bcla */ return true;@@ -289,7 +289,7 @@ int create_cond_branch(unsigned int *instr, constunsigned int *addr, static unsigned int branch_opcode(unsigned int instr) { -return (instr >>26 ) &0x3F ; + return ppc_inst_opcode(instr) & 0x3F; }static int
instr_is_branch_iform(unsigned int instr)
Re: [PATCH v5 05/21] powerpc: Use a function for getting the instruction op code
Quoted 7 lines · Balamuruhan S
Quoted 3 lines · Jordan Niethe
In preparation for using a data type for instructions that can not be directly used with the '>>' operator use a function for getting the op code of an instruction.
vecemu.candsstep.cwill needppc_inst_opcode().
Sorry, I forget you pointed those files out before. I added other things to them but then I forgot to add this. Will do for next time.
Quoted 66 lines
-- Bala
Quoted 62 lines
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/lib/code-patching.c | 4 ++-- 3 files changed, 8 insertions(+), 3 deletions(-)arch/powerpc/include/asm/inst.h +5
-0@@ -8,4 +8,9 @@#define ppc_inst (x) (x) +static inline int ppc_inst_opcode (u32 x) +{ +return x >>26 ; +} +#endif /* _ASM_INST_H */ arch/powerpc/kernel/align.c +1
-1@@ -314,7 +314,7 @@ int fix_alignment(struct pt_regs *regs) }#ifdef CONFIG_SPE -if ((instr >>26 ) ==0x4 ) { +if (ppc_inst_opcode (instr) ==0x4 ) {int reg = (instr >>21 ) &0x1f ;PPC_WARN_ALIGNMENT (spe, regs);return emulate_spe (regs, reg, instr);arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
indexfdf0d6ea3575..099a515202aa100644arch/powerpc/lib/code-patching.c +2
-2@@ -231,7 +231,7 @@ bool is_offset_in_branch_range(long offset)*/ bool is_conditional_branch (unsigned int instr) { -unsigned int opcode = instr >>26 ; +unsigned int opcode =ppc_inst_opcode (instr);if (opcode ==16 )/* bc, bca, bcl, bcla */ return true;@@ -289,7 +289,7 @@ int create_cond_branch(unsigned int *instr, constunsigned int *addr, static unsigned int branch_opcode(unsigned int instr) { -return (instr >>26 ) &0x3F ; + return ppc_inst_opcode(instr) & 0x3F; }static int
instr_is_branch_iform(unsigned int instr)
Re: [PATCH v5 05/21] powerpc: Use a function for getting the instruction op code
In reply to Jordan NietheHi!
arch/powerpc/include/asm/inst.h line 14
Quoted 4 lines · Jordan Niethe
arch/powerpc/include/asm/inst.h +4
-0+static inline int ppc_inst_opcode (u32 x) +{ +return x >>26 ; +}
Maybe you should have "primary opcode" in this function name?
Segher
Re: [PATCH v5 05/21] powerpc: Use a function for getting the instruction op code
Quoted 10 lines · Segher Boessenkool
Hi!
arch/powerpc/include/asm/inst.h line 14
Quoted 4 lines · Jordan Niethe
arch/powerpc/include/asm/inst.h +4
-0+static inline int ppc_inst_opcode (u32 x) +{ +return x >>26 ; +}Maybe you should have "primary opcode" in this function name?
Thanks, that is a good idea.
Quoted 3 lines
Segher
PATCH v5 6/21 powerpc: Use an accessor for instructions
In reply to Jordan NietheIn preparation for introducing a more complicated instruction type to accomodate prefixed instructions use an accessor for getting an instruction as a u32. Currently this does nothing.
---
v4: New to series
v5: Remove references to 'word' instructions
--- arch/powerpc/include/asm/inst.h | 5 + arch/powerpc/include/asm/sstep.h | 6 +- arch/powerpc/kernel/align.c | 4 +- arch/powerpc/kernel/kprobes.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 22 +-- arch/powerpc/kernel/vecemu.c | 17 +- arch/powerpc/lib/code-patching.c | 18 +- arch/powerpc/lib/sstep.c | 270 ++++++++++++++------------- arch/powerpc/lib/test_emulate_step.c | 6 +- arch/powerpc/xmon/xmon.c | 4 +- 10 files changed, 182 insertions(+), 172 deletions(-)
arch/powerpc/include/asm/inst.h +5 -0
@@ -8,6 +8,11 @@#define ppc_inst (x) (x) +static inline u32 ppc_inst_val (u32 x) +{ +return x; +} +static inline int ppc_inst_opcode (u32 x) {return x >>26 ;
arch/powerpc/include/asm/sstep.h +3 -3
@@ -15,9 +15,9 @@ struct pt_regs;* Note that IS_MTMSRD returns true for both an mtmsr (32-bit) * and an mtmsrd (64-bit). */ -#define IS_MTMSRD (instr) (((instr) & 0xfc0007be) == 0x7c000124) -#define IS_RFID (instr) (((instr) & 0xfc0007fe) == 0x4c000024) -#define IS_RFI (instr) (((instr) & 0xfc0007fe) == 0x4c000064) +#define IS_MTMSRD (instr) ((ppc_inst_val(instr) & 0xfc0007be) == 0x7c000124) +#define IS_RFID (instr) ((ppc_inst_val(instr) & 0xfc0007fe) == 0x4c000024) +#define IS_RFI (instr) ((ppc_inst_val(instr) & 0xfc0007fe) == 0x4c000064)enum instruction_type {COMPUTE ,/* arith/logical/CR op, etc. */
arch/powerpc/kernel/align.c +2 -2
@@ -315,7 +315,7 @@ int fix_alignment(struct pt_regs *regs)#ifdef CONFIG_SPE if (ppc_inst_opcode (instr) ==0x4 ) { -int reg = (instr >>21 ) &0x1f ; +int reg = (ppc_inst_val (instr) >>21 ) &0x1f ;PPC_WARN_ALIGNMENT (spe, regs);return emulate_spe (regs, reg, instr); }
@@ -332,7 +332,7 @@ int fix_alignment(struct pt_regs *regs)* when pasting to a co-processor. Furthermore, paste_last is the * synchronisation point for preceding copy/paste sequences. */ -if ((instr &0xfc0006fe ) == (PPC_INST_COPY &0xfc0006fe )) +if ((ppc_inst_val (instr) &0xfc0006fe ) == (PPC_INST_COPY &0xfc0006fe ))return -EIO ; r =analyse_instr (&op, regs, instr);
arch/powerpc/kernel/kprobes.c +1 -1
@@ -234,7 +234,7 @@ static int try_to_emulate(struct kprobe *p, struct pt_regs *regs)* So, we should never get here... but, its still * good to catch them, just in case... */ -printk ("Can't step on instruction %x\n" , insn); +printk ("Can't step on instruction %x\n" ,ppc_inst_val (insn));BUG (); }else {/*
arch/powerpc/kernel/trace/ftrace.c +11 -11
@@ -74,7 +74,7 @@ ftrace_modify_code(unsigned long ip, unsigned int old, unsigned int new)/* Make sure it is what we expect it to be */ if (replaced != old) {pr_err ("%p: replaced (%#x) != old (%#x)" , - (void *)ip, replaced, old); + (void *)ip,ppc_inst_val (replaced),ppc_inst_val (old));return -EINVAL ; }
@@ -99,19 +99,19 @@ static int test_24bit_addr(unsigned long ip, unsigned long addr)static int is_bl_op (unsigned int op) { -return (op &0xfc000003 ) ==0x48000001 ; +return (ppc_inst_val (op) &0xfc000003 ) ==0x48000001 ; }static int is_b_op (unsigned int op) { -return (op &0xfc000003 ) ==0x48000000 ; +return (ppc_inst_val (op) &0xfc000003 ) ==0x48000000 ; }static unsigned long find_bl_target (unsigned long ip,unsigned int op) {int offset; - offset = (op &0x03fffffc ); + offset = (ppc_inst_val (op) &0x03fffffc );/* make it signed */ if (offset &0x02000000 ) offset |=0xfe000000 ;
@@ -137,7 +137,7 @@ __ftrace_make_nop(struct module *mod,/* Make sure that that this is still a 24bit jump */ if (!is_bl_op (op)) { -pr_err ("Not expected bl: opcode is %x\n" , op); +pr_err ("Not expected bl: opcode is %x\n" ,ppc_inst_val (op));return -EINVAL ; }
@@ -171,7 +171,7 @@ __ftrace_make_nop(struct module *mod,/* We expect either a mflr r0, or a std r0, LRSAVE(r1) */ if (op !=ppc_inst (PPC_INST_MFLR ) && op !=ppc_inst (PPC_INST_STD_LR )) { -pr_err ("Unexpected instruction %08x around bl _mcount\n" , op); +pr_err ("Unexpected instruction %08x around bl _mcount\n" ,ppc_inst_val (op));return -EINVAL ; }#else
@@ -201,7 +201,7 @@ __ftrace_make_nop(struct module *mod, }if (op !=ppc_inst (PPC_INST_LD_TOC )) { -pr_err ("Expected %08x found %08x\n" ,PPC_INST_LD_TOC , op); +pr_err ("Expected %08x found %08x\n" ,PPC_INST_LD_TOC ,ppc_inst_val (op));return -EINVAL ; }#endif /* CONFIG_MPROFILE_KERNEL */
@@ -403,7 +403,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr)/* Make sure that that this is still a 24bit jump */ if (!is_bl_op (op)) { -pr_err ("Not expected bl: opcode is %x\n" , op); +pr_err ("Not expected bl: opcode is %x\n" ,ppc_inst_val (op));return -EINVAL ; }
@@ -497,7 +497,7 @@ expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1)* The load offset is different depending on the ABI. For simplicity * just mask it out when doing the compare. */ -if ((op0 !=ppc_inst (0x48000008 )) || ((op1 &0xffff0000 ) !=0xe8410000 )) +if ((op0 !=ppc_inst (0x48000008 )) || (ppc_inst_val (op1) &0xffff0000 ) !=0xe8410000 )return 0 ;return 1 ; }
@@ -647,7 +647,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr) }if (op !=ppc_inst (PPC_INST_NOP )) { -pr_err ("Unexpected call sequence at %p: %x\n" , ip, op); +pr_err ("Unexpected call sequence at %p: %x\n" , ip,ppc_inst_val (op));return -EINVAL ; }
@@ -726,7 +726,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr,/* Make sure that that this is still a 24bit jump */ if (!is_bl_op (op)) { -pr_err ("Not expected bl: opcode is %x\n" , op); +pr_err ("Not expected bl: opcode is %x\n" ,ppc_inst_val (op));return -EINVAL ; }
arch/powerpc/kernel/vecemu.c +10 -7
@@ -10,6 +10,7 @@#include <asm/processor.h> #include <asm/switch_to.h> #include <linux/uaccess.h> +#include <asm/inst.h> /* Functions in vector.S */ extern void vaddfp (vector128 *dst,vector128 *a,vector128 *b);
@@ -260,21 +261,23 @@ static unsigned int rfin(unsigned int x)int emulate_altivec (struct pt_regs *regs) { -unsigned int instr, i; +unsigned int instr, i, word;unsigned int va, vb, vc, vd;vector128 *vrs;if (get_user (instr, (unsigned int __user *) regs->nip))return -EFAULT ; -if ((instr >>26 ) !=4 ) + + word =ppc_inst_val (instr); +if ((word >>26 ) !=4 )return -EINVAL ;/* not an altivec instruction */ - vd = (instr >>21 ) &0x1f ; - va = (instr >>16 ) &0x1f ; - vb = (instr >>11 ) &0x1f ; - vc = (instr >>6 ) &0x1f ; + vd = (word >>21 ) &0x1f ; + va = (word >>16 ) &0x1f ; + vb = (word >>11 ) &0x1f ; + vc = (word >>6 ) &0x1f ; vrs = current->thread.vr_state.vr; -switch (instr &0x3f ) { +switch (word &0x3f ) {case 10 :switch (vc) {case 0 :/* vaddfp */
arch/powerpc/lib/code-patching.c +9 -9
@@ -236,7 +236,7 @@ bool is_conditional_branch(unsigned int instr)if (opcode ==16 )/* bc, bca, bcl, bcla */ return true;if (opcode ==19 ) { -switch ((instr >>1 ) &0x3ff ) { +switch ((ppc_inst_val (instr) >>1 ) &0x3ff ) {case 16 :/* bclr, bclrl */ case 528 :/* bcctr, bcctrl */ case 560 :/* bctar, bctarl */
@@ -304,7 +304,7 @@ static int instr_is_branch_bform(unsigned int instr)int instr_is_relative_branch (unsigned int instr) { -if (instr &BRANCH_ABSOLUTE ) +if (ppc_inst_val (instr) &BRANCH_ABSOLUTE )return 0 ;return instr_is_branch_iform (instr) ||instr_is_branch_bform (instr);
@@ -312,20 +312,20 @@ int instr_is_relative_branch(unsigned int instr)int instr_is_relative_link_branch (unsigned int instr) { -return instr_is_relative_branch (instr) && (instr &BRANCH_SET_LINK ); +return instr_is_relative_branch (instr) && (ppc_inst_val (instr) &BRANCH_SET_LINK ); }static unsigned long branch_iform_target (const unsigned int *instr) {signed long imm; - imm = *instr &0x3FFFFFC ; + imm =ppc_inst_val (*instr) &0x3FFFFFC ;/* If the top bit of the immediate value is set this is negative */ if (imm &0x2000000 ) imm -=0x4000000 ; -if ((*instr &BRANCH_ABSOLUTE ) ==0 ) +if ((ppc_inst_val (*instr) &BRANCH_ABSOLUTE ) ==0 ) imm += (unsigned long )instr;return (unsigned long )imm;
@@ -335,13 +335,13 @@ static unsigned long branch_bform_target(const unsigned int *instr) {signed long imm; - imm = *instr &0xFFFC ; + imm =ppc_inst_val (*instr) &0xFFFC ;/* If the top bit of the immediate value is set this is negative */ if (imm &0x8000 ) imm -=0x10000 ; -if ((*instr &BRANCH_ABSOLUTE ) ==0 ) +if ((ppc_inst_val (*instr) &BRANCH_ABSOLUTE ) ==0 ) imm += (unsigned long )instr;return (unsigned long )imm;
@@ -372,9 +372,9 @@ int translate_branch(unsigned int *instr, const unsigned int *dest, const unsign target =branch_target (src);if (instr_is_branch_iform (*src)) -return create_branch (instr, dest, target, *src); +return create_branch (instr, dest, target,ppc_inst_val (*src));else if (instr_is_branch_bform (*src)) -return create_cond_branch (instr, dest, target, *src); +return create_cond_branch (instr, dest, target,ppc_inst_val (*src));return 1 ; }
arch/powerpc/lib/sstep.c +136 -134
827 lines not on this page · raw message
arch/powerpc/lib/test_emulate_step.c +3 -3
@@ -846,12 +846,12 @@ static int __init emulate_compute_instr(struct pt_regs *regs, {struct instruction_op op; -if (!regs || !instr) +if (!regs || !ppc_inst_val (instr))return -EINVAL ;if (analyse_instr (&op, regs, instr) !=1 ||GETTYPE (op.type) !=COMPUTE ) { -pr_info ("emulation failed, instruction = 0x%08x\n" , instr); +pr_info ("emulation failed, instruction = 0x%08x\n" ,ppc_inst_val (instr));return -EFAULT ; }
@@ -871,7 +871,7 @@ static int __init execute_compute_instr(struct pt_regs *regs,/* Patch the NOP with the actual instruction */ patch_instruction_site (&patch__exec_instr, instr);if (exec_instr (regs)) { -pr_info ("execution failed, instruction = 0x%08x\n" , instr); +pr_info ("execution failed, instruction = 0x%08x\n" ,ppc_inst_val (instr));return -EFAULT ; }
arch/powerpc/xmon/xmon.c +2 -2
@@ -2870,9 +2870,9 @@ generic_inst_dump(unsigned long adr, long count, int praddr, dotted =0 ; last_inst = inst;if (praddr) -printf (REG " %.8x" , adr, inst); +printf (REG " %.8x" , adr,ppc_inst_val (inst));printf ("\t" ); -dump_func (inst, adr); +dump_func (ppc_inst_val (inst), adr);printf ("\n" ); }return adr - first_adr;
Signature · 1 line
2.17.1
PATCH v5 7/21 powerpc: Use a function for byte swapping instructions
In reply to Jordan NietheUse a function for byte swapping instructions in preparation of a more complicated instruction type.
--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- 2 files changed, 6 insertions(+), 1 deletion(-)
arch/powerpc/include/asm/inst.h +5 -0
@@ -18,4 +18,9 @@ static inline int ppc_inst_opcode(u32 x) return x >> 26; } +static inline u32 ppc_inst_swab (u32 x) +{ +return ppc_inst (swab32 (ppc_inst_val (x))); +} +#endif /* _ASM_INST_H */
arch/powerpc/kernel/align.c +1 -1
@@ -310,7 +310,7 @@ int fix_alignment(struct pt_regs *regs)/* We don't handle PPC little-endian any more... */ if (cpu_has_feature (CPU_FTR_PPC_LE ))return -EIO ; - instr =swab32 (instr); + instr =ppc_inst_swab (instr); }#ifdef CONFIG_SPE
Signature · 1 line
2.17.1
Re: [PATCH v5 07/21] powerpc: Use a function for byte swapping instructions
Quoted 2 lines · Jordan Niethe
Use a function for byte swapping instructions in preparation of a more complicated instruction type.
Quoted 35 lines
Signed-off-by Jordan Niethe <[email protected]>--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- 2 files changed, 6 insertions(+), 1 deletion(-)arch/powerpc/include/asm/inst.h +5
-0@@ -18,4 +18,9 @@ static inline int ppc_inst_opcode(u32 x) return x >> 26; } +static inline u32 ppc_inst_swab (u32 x) +{ +return ppc_inst (swab32 (ppc_inst_val (x))); +} +#endif /* _ASM_INST_H */ arch/powerpc/kernel/align.c +1
-1@@ -310,7 +310,7 @@ int fix_alignment(struct pt_regs *regs)/* We don't handle PPC little-endian any more... */ if (cpu_has_feature (CPU_FTR_PPC_LE ))return -EIO ; - instr =swab32 (instr); + instr =ppc_inst_swab (instr); }#ifdef CONFIG_SPE
PATCH v5 8/21 powerpc: Introduce functions for instruction equality
In reply to Jordan NietheIn preparation for an instruction data type that can not be directly used with the '==' operator use functions for checking equality.
---
v5: Remove ppc_inst_null()
--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/trace/ftrace.c | 15 ++++++++------- arch/powerpc/lib/code-patching.c | 12 ++++++------ arch/powerpc/lib/test_emulate_step.c | 2 +- arch/powerpc/xmon/xmon.c | 4 ++-- 5 files changed, 22 insertions(+), 16 deletions(-)
arch/powerpc/include/asm/inst.h +5 -0
@@ -23,4 +23,9 @@ static inline u32 ppc_inst_swab(u32 x) return ppc_inst(swab32(ppc_inst_val(x))); } +static inline bool ppc_inst_equal (u32 x,u32 y) +{ +return x == y; +} +#endif /* _ASM_INST_H */
arch/powerpc/kernel/trace/ftrace.c +8 -7
@@ -72,7 +72,7 @@ ftrace_modify_code(unsigned long ip, unsigned int old, unsigned int new)return -EFAULT ;/* Make sure it is what we expect it to be */ -if (replaced != old) { +if (!ppc_inst_equal (replaced, old)) {pr_err ("%p: replaced (%#x) != old (%#x)" , (void *)ip,ppc_inst_val (replaced),ppc_inst_val (old));return -EINVAL ;
@@ -170,7 +170,8 @@ __ftrace_make_nop(struct module *mod, }/* We expect either a mflr r0, or a std r0, LRSAVE(r1) */ -if (op !=ppc_inst (PPC_INST_MFLR ) && op !=ppc_inst (PPC_INST_STD_LR )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_MFLR )) && + !ppc_inst_equal (op,ppc_inst (PPC_INST_STD_LR ))) {pr_err ("Unexpected instruction %08x around bl _mcount\n" ,ppc_inst_val (op));return -EINVAL ; }
@@ -200,7 +201,7 @@ __ftrace_make_nop(struct module *mod,return -EFAULT ; } -if (op !=ppc_inst (PPC_INST_LD_TOC )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_LD_TOC ))) {pr_err ("Expected %08x found %08x\n" ,PPC_INST_LD_TOC ,ppc_inst_val (op));return -EINVAL ; }
@@ -497,7 +498,7 @@ expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1)* The load offset is different depending on the ABI. For simplicity * just mask it out when doing the compare. */ -if ((op0 !=ppc_inst (0x48000008 )) || (ppc_inst_val (op1) &0xffff0000 ) !=0xe8410000 ) +if ((!ppc_inst_equal (op0),ppc_inst (0x48000008 )) || (ppc_inst_val (op1) &0xffff0000 ) !=0xe8410000 )return 0 ;return 1 ; }
@@ -506,7 +507,7 @@ static int expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1) {/* look for patched "NOP" on ppc64 with -mprofile-kernel */ -if (op0 !=ppc_inst (PPC_INST_NOP )) +if (!ppc_inst_equal (op0,ppc_inst (PPC_INST_NOP )))return 0 ;return 1 ; }
@@ -589,7 +590,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ;/* It should be pointing to a nop */ -if (op !=ppc_inst (PPC_INST_NOP )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_NOP ))) {pr_err ("Expected NOP but have %x\n" , op);return -EINVAL ; }
@@ -646,7 +647,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ; } -if (op !=ppc_inst (PPC_INST_NOP )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_NOP ))) {pr_err ("Unexpected call sequence at %p: %x\n" , ip,ppc_inst_val (op));return -EINVAL ; }
arch/powerpc/lib/code-patching.c +6 -6
@@ -478,7 +478,7 @@ static void __init test_branch_iform(void)/* Check flags are masked correctly */ err =create_branch (&instr, &instr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==ppc_inst (0x48000000 )); +check (ppc_inst_equal (instr,ppc_inst (0x48000000 ))); }static void __init test_create_function_call (void )
@@ -563,7 +563,7 @@ static void __init test_branch_bform(void)/* Check flags are masked correctly */ err =create_cond_branch (&instr, iptr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==ppc_inst (0x43FF0000 )); +check (ppc_inst_equal (instr,ppc_inst (0x43FF0000 ))); }static void __init test_translate_branch (void )
@@ -597,7 +597,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x4a000000 )); +check (ppc_inst_equal (*q,ppc_inst (0x4a000000 )));/* Maximum positive case, move x to x - 32 MB + 4 */ p = buf +0x2000000 ;
@@ -608,7 +608,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x49fffffc )); +check (ppc_inst_equal (*q,ppc_inst (0x49fffffc )));/* Jump to x + 16 MB moved to x + 20 MB */ p = buf;
@@ -654,7 +654,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x43ff8000 )); +check (ppc_inst_equal (*q,ppc_inst (0x43ff8000 )));/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ;
@@ -666,7 +666,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x43ff7ffc )); +check (ppc_inst_equal (*q,ppc_inst (0x43ff7ffc )));/* Jump to x + 12 KB moved to x + 20 KB */ p = buf;
arch/powerpc/lib/test_emulate_step.c +1 -1
@@ -865,7 +865,7 @@ static int __init execute_compute_instr(struct pt_regs *regs,extern int exec_instr (struct pt_regs *regs);extern s32 patch__exec_instr; -if (!regs || !instr) +if (!regs || !ppc_inst_val (instr))return -EINVAL ;/* Patch the NOP with the actual instruction */
arch/powerpc/xmon/xmon.c +2 -2
@@ -950,7 +950,7 @@ static void remove_bpts(void)if ((bp->enabled & (BP_TRAP |BP_CIABR )) !=BP_TRAP )continue ;if (mread (bp->address, &instr,4 ) ==4 - && instr ==ppc_inst (bpinstr) + &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) printf("Couldn't remove breakpoint at %lx\n",
@@ -2860,7 +2860,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr,break ; } inst =ppc_inst (GETWORD (val)); -if (adr > first_adr && inst == last_inst) { +if (adr > first_adr &&ppc_inst_equal (inst, last_inst)) {if (!dotted) {printf (" ...\n" ); dotted =1 ;
Signature · 1 line
2.17.1
Re: [PATCH v5 08/21] powerpc: Introduce functions for instruction equality
Quoted 2 lines · Jordan Niethe
In preparation for an instruction data type that can not be directly used with the '==' operator use functions for checking equality.
LGTM except one comment below, otherwise
Quoted 170 lines
Signed-off-by Jordan Niethe <[email protected]>---
v5: Removeppc_inst_null()--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/trace/ftrace.c | 15 ++++++++------- arch/powerpc/lib/code-patching.c | 12 ++++++------ arch/powerpc/lib/test_emulate_step.c | 2 +- arch/powerpc/xmon/xmon.c | 4 ++-- 5 files changed, 22 insertions(+), 16 deletions(-)arch/powerpc/include/asm/inst.h +5
-0@@ -23,4 +23,9 @@ static inline u32 ppc_inst_swab(u32 x) return ppc_inst(swab32(ppc_inst_val(x))); } +static inline bool ppc_inst_equal (u32 x,u32 y) +{ +return x == y; +} +#endif /* _ASM_INST_H */ arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -72,7 +72,7 @@ ftrace_modify_code(unsigned long ip, unsigned int old, unsigned int new)return -EFAULT ;/* Make sure it is what we expect it to be */ -if (replaced != old) { +if (!ppc_inst_equal (replaced, old)) {pr_err ("%p: replaced (%#x) != old (%#x)" , (void *)ip,ppc_inst_val (replaced),ppc_inst_val (old));arch/powerpc/kernel/trace/ftrace.c +2
-1return -EINVAL ;@@ -170,7 +170,8 @@ __ftrace_make_nop(struct module *mod, }/* We expect either a mflr r0, or a std r0, LRSAVE(r1) */ -if (op !=ppc_inst (PPC_INST_MFLR ) && op !=ppc_inst (PPC_INST_STD_LR )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_MFLR )) && + !ppc_inst_equal (op,ppc_inst (PPC_INST_STD_LR ))) {pr_err ("Unexpected instruction %08x around bl _mcount\n" ,ppc_inst_val (op));return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -200,7 +201,7 @@ __ftrace_make_nop(struct module *mod,return -EFAULT ; } -if (op !=ppc_inst (PPC_INST_LD_TOC )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_LD_TOC ))) {pr_err ("Expected %08x found %08x\n" ,PPC_INST_LD_TOC ,ppc_inst_val (op));return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -497,7 +498,7 @@ expected_nop_sequence(void *ip, unsigned int op0,unsigned int op1) * The load offset is different depending on the ABI. For simplicity * just mask it out when doing the compare. */ -if ((op0 !=ppc_inst (0x48000008 )) || (ppc_inst_val (op1) &0xffff0000 ) != 0xe8410000) +if ((!ppc_inst_equal (op0),ppc_inst (0x48000008 )) || (ppc_inst_val (op1) &0xffff0000 ) !=0xe8410000 )arch/powerpc/kernel/trace/ftrace.c +2
-2return 0 ;return 1 ; }@@ -506,7 +507,7 @@ static int expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1) {/* look for patched "NOP" on ppc64 with -mprofile-kernel */ -if (op0 !=ppc_inst (PPC_INST_NOP )) +if (!ppc_inst_equal (op0,ppc_inst (PPC_INST_NOP )))return 0 ;return 1 ; }@@ -589,7 +590,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ;/* It should be pointing to a nop */ -if (op !=ppc_inst (PPC_INST_NOP )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_NOP ))) {pr_err ("Expected NOP but have %x\n" , op);return -EINVAL ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -646,7 +647,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr)return -EFAULT ; } -if (op !=ppc_inst (PPC_INST_NOP )) { +if (!ppc_inst_equal (op,ppc_inst (PPC_INST_NOP ))) {pr_err ("Unexpected call sequence at %p: %x\n" , ip,ppc_inst_val (op));arch/powerpc/kernel/trace/ftrace.c +0
-0return -EINVAL ; }arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index3f88d2a4400c..33654c6334a9100644arch/powerpc/lib/code-patching.c +6
-6@@ -478,7 +478,7 @@ static void __init test_branch_iform(void)/* Check flags are masked correctly */ err =create_branch (&instr, &instr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==ppc_inst (0x48000000 )); +check (ppc_inst_equal (instr,ppc_inst (0x48000000 ))); }static void __init test_create_function_call (void )@@ -563,7 +563,7 @@ static void __init test_branch_bform(void)/* Check flags are masked correctly */ err =create_cond_branch (&instr, iptr, addr,0xFFFFFFFC );check (instr_is_branch_to_addr (&instr, addr)); -check (instr ==ppc_inst (0x43FF0000 )); +check (ppc_inst_equal (instr,ppc_inst (0x43FF0000 ))); }static void __init test_translate_branch (void )@@ -597,7 +597,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x4a000000 )); +check (ppc_inst_equal (*q,ppc_inst (0x4a000000 )));/* Maximum positive case, move x to x - 32 MB + 4 */ p = buf +0x2000000 ;@@ -608,7 +608,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x49fffffc )); +check (ppc_inst_equal (*q,ppc_inst (0x49fffffc )));/* Jump to x + 16 MB moved to x + 20 MB */ p = buf;@@ -654,7 +654,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x43ff8000 )); +check (ppc_inst_equal (*q,ppc_inst (0x43ff8000 )));/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ;@@ -666,7 +666,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (*q ==ppc_inst (0x43ff7ffc )); +check (ppc_inst_equal (*q,ppc_inst (0x43ff7ffc )));/* Jump to x + 12 KB moved to x + 20 KB */ p = buf;arch/powerpc/lib/test_emulate_step.c +0
-0
arch/powerpc/lib/test_emulate_step.c static int __init execute_compute_instr(struct pt_regs · line 869
Quoted 6 lines
arch/powerpc/lib/test_emulate_step.c +1
-1@@ -865,7 +865,7 @@ static int __init execute_compute_instr(struct pt_regs *regs, extern int exec_instr(struct pt_regs *regs);extern s32 patch__exec_instr; -if (!regs || !instr) +if (!regs || !ppc_inst_val (instr))
This change should go in to below patch,
[PATCH v5 06/21] powerpc: Use an accessor for instructions
-- Bala
Quoted 26 lines
arch/powerpc/lib/test_emulate_step.c +0
-0return -EINVAL ;arch/powerpc/lib/test_emulate_step.c +0
-0/* Patch the NOP with the actual instruction */ arch/powerpc/xmon/xmon.c +2
-2@@ -950,7 +950,7 @@ static void remove_bpts(void)if ((bp->enabled & (BP_TRAP |BP_CIABR )) !=BP_TRAP )continue ;if (mread (bp->address, &instr,4 ) ==4 - && instr ==ppc_inst (bpinstr) + &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) printf("Couldn't remove breakpoint at %lx\n",@@ -2860,7 +2860,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, break; } inst =ppc_inst (GETWORD (val)); -if (adr > first_adr && inst == last_inst) { +if (adr > first_adr &&ppc_inst_equal (inst, last_inst)) {if (!dotted) {printf (" ...\n" );dotted = 1;
PATCH v5 9/21 powerpc: Use a datatype for instructions
In reply to Jordan NietheCurrently unsigned ints are used to represent instructions on powerpc. This has worked well as instructions have always been 4 byte words. However, a future ISA version will introduce some changes to instructions that mean this scheme will no longer work as well. This change is Prefixed Instructions. A prefixed instruction is made up of a word prefix followed by a word suffix to make an 8 byte double word instruction. No matter the endianess of the system the prefix always comes first. Prefixed instructions are only planned for powerpc64.
Introduce a ppc_inst type to represent both prefixed and word instructions on powerpc64 while keeping it possible to exclusively have word instructions on powerpc32, A latter patch will expand the type to include prefixed instructions but for now just typedef it to a u32.
Later patches will introduce helper functions and macros for manipulating the instructions so that powerpc64 and powerpc32 might maintain separate type definitions.
---
v4: New to series
v5: Add to epapr_paravirt.c, kgdb.c
--- arch/powerpc/include/asm/code-patching.h | 32 ++++----- arch/powerpc/include/asm/inst.h | 20 +++--- arch/powerpc/include/asm/sstep.h | 5 +- arch/powerpc/include/asm/uprobes.h | 5 +- arch/powerpc/kernel/align.c | 4 +- arch/powerpc/kernel/epapr_paravirt.c | 4 +- arch/powerpc/kernel/hw_breakpoint.c | 4 +- arch/powerpc/kernel/jump_label.c | 2 +- arch/powerpc/kernel/kgdb.c | 4 +- arch/powerpc/kernel/kprobes.c | 8 +-- arch/powerpc/kernel/mce_power.c | 5 +- arch/powerpc/kernel/optprobes.c | 40 ++++++------ arch/powerpc/kernel/setup_32.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 83 ++++++++++++------------ arch/powerpc/kernel/vecemu.c | 5 +- arch/powerpc/lib/code-patching.c | 69 ++++++++++---------- arch/powerpc/lib/feature-fixups.c | 48 +++++++------- arch/powerpc/lib/sstep.c | 4 +- arch/powerpc/lib/test_emulate_step.c | 9 +-- arch/powerpc/perf/core-book3s.c | 4 +- arch/powerpc/xmon/xmon.c | 24 +++---- 21 files changed, 196 insertions(+), 185 deletions(-)
arch/powerpc/include/asm/code-patching.h +16 -16
@@ -23,33 +23,33 @@#define BRANCH_ABSOLUTE 0x2bool is_offset_in_branch_range (long offset); -int create_branch (unsigned int *instr,const unsigned int *addr, +int create_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags); -int create_cond_branch (unsigned int *instr,const unsigned int *addr, +int create_cond_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags); -int patch_branch (unsigned int *addr,unsigned long target,int flags); -int patch_instruction (unsigned int *addr,unsigned int instr); -int raw_patch_instruction (unsigned int *addr,unsigned int instr); +int patch_branch (struct ppc_inst *addr,unsigned long target,int flags); +int patch_instruction (struct ppc_inst *addr,struct ppc_inst instr); +int raw_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr);static inline unsigned long patch_site_addr (s32 *site) {return (unsigned long )site + *site; } -static inline int patch_instruction_site (s32 *site,unsigned int instr) +static inline int patch_instruction_site (s32 *site,struct ppc_inst instr) { -return patch_instruction ((unsigned int *)patch_site_addr (site), instr); +return patch_instruction ((struct ppc_inst *)patch_site_addr (site), instr); }static inline int patch_branch_site (s32 *site,unsigned long target,int flags) { -return patch_branch ((unsigned int *)patch_site_addr (site), target, flags); +return patch_branch ((struct ppc_inst *)patch_site_addr (site), target, flags); }static inline int modify_instruction (unsigned int *addr,unsigned int clr,unsigned int set) { -return patch_instruction (addr,ppc_inst ((*addr & ~clr) | set)); +return patch_instruction ((struct ppc_inst *)addr,ppc_inst ((*addr & ~clr) | set)); }static inline int modify_instruction_site (s32 *site,unsigned int clr,unsigned int set)
@@ -57,13 +57,13 @@ static inline int modify_instruction_site(s32 *site, unsigned int clr, unsignedreturn modify_instruction ((unsigned int *)patch_site_addr (site), clr, set); } -int instr_is_relative_branch (unsigned int instr); -int instr_is_relative_link_branch (unsigned int instr); -int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr); -unsigned long branch_target (const unsigned int *instr); -int translate_branch (unsigned int *instr,const unsigned int *dest, -const unsigned int *src); -extern bool is_conditional_branch (unsigned int instr); +int instr_is_relative_branch (struct ppc_inst instr); +int instr_is_relative_link_branch (struct ppc_inst instr); +int instr_is_branch_to_addr (const struct ppc_inst *instr,unsigned long addr); +unsigned long branch_target (const struct ppc_inst *instr); +int translate_branch (struct ppc_inst *instr,const struct ppc_inst *dest, +const struct ppc_inst *src); +extern bool is_conditional_branch (struct ppc_inst instr);#ifdef CONFIG_PPC_BOOK3E_64 void __patch_exception (int exc,unsigned long addr);#define patch_exception (exc, name) do { \
arch/powerpc/include/asm/inst.h +12 -8
@@ -6,26 +6,30 @@* Instruction data type for POWER */ -#define ppc_inst (x) (x) +struct ppc_inst { +u32 val; +} __packed; -static inline u32 ppc_inst_val (u32 x) +#define ppc_inst (x) ((struct ppc_inst){ .val = x }) + +static inline u32 ppc_inst_val (struct ppc_inst x) { -return x; +return x.val; } -static inline int ppc_inst_opcode (u32 x) +static inline int ppc_inst_opcode (struct ppc_inst x) { -return x >>26 ; +return x.val >>26 ; } -static inline u32 ppc_inst_swab (u32 x) +static inline struct ppc_inst ppc_inst_swab (struct ppc_inst x) {return ppc_inst (swab32 (ppc_inst_val (x))); } -static inline bool ppc_inst_equal (u32 x,u32 y) +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) { -return x == y; +return !memcmp (&x, &y,sizeof (struct ppc_inst )); }#endif /* _ASM_INST_H */
arch/powerpc/include/asm/sstep.h +3 -2
@@ -2,6 +2,7 @@/* * Copyright (C) 2004 Paul Mackerras <[email protected]>, IBM */ +#include <asm/inst.h> struct pt_regs ;
@@ -132,7 +133,7 @@ union vsx_reg {* otherwise. */ extern int analyse_instr (struct instruction_op *op,const struct pt_regs *regs, -unsigned int instr); +struct ppc_inst instr);/* * Emulate an instruction that can be executed just by updating
@@ -149,7 +150,7 @@ void emulate_update_regs(struct pt_regs *reg, struct instruction_op *op);* 0 if it could not be emulated, or -1 for an instruction that * should not be emulated (rfid, mtmsrd clearing MSR_RI, etc.). */ -extern int emulate_step (struct pt_regs *regs,unsigned int instr); +extern int emulate_step (struct pt_regs *regs,struct ppc_inst instr);/* * Emulate a load or store instruction by reading/writing the
arch/powerpc/include/asm/uprobes.h +3 -2
@@ -11,6 +11,7 @@#include <linux/notifier.h> #include <asm/probes.h> +#include <asm/inst.h> typedef ppc_opcode_t uprobe_opcode_t ;
@@ -23,8 +24,8 @@ typedef ppc_opcode_t uprobe_opcode_t;struct arch_uprobe {union { -u32 insn; -u32 ixol; +struct ppc_inst insn; +struct ppc_inst ixol; }; };
arch/powerpc/kernel/align.c +2 -2
@@ -294,7 +294,7 @@ static int emulate_spe(struct pt_regs *regs, unsigned int reg,int fix_alignment (struct pt_regs *regs) { -unsigned int instr; +struct ppc_inst instr;struct instruction_op op;int r, type;
@@ -304,7 +304,7 @@ int fix_alignment(struct pt_regs *regs)*/ CHECK_FULL_REGS (regs); -if (unlikely (__get_user (instr, (unsigned int __user *)regs->nip))) +if (unlikely (__get_user (instr.val, (unsigned int __user *)regs->nip)))return -EFAULT ;if ((regs->msr &MSR_LE ) != (MSR_KERNEL &MSR_LE )) {/* We don't handle PPC little-endian any more... */
arch/powerpc/kernel/epapr_paravirt.c +2 -2
@@ -38,9 +38,9 @@ static int __init early_init_dt_scan_epapr(unsigned long node,for (i =0 ; i < (len /4 ); i++) {u32 inst =be32_to_cpu (insts[i]); -patch_instruction (epapr_hypercall_start + i,ppc_inst (inst)); +patch_instruction ((struct ppc_inst *)(epapr_hypercall_start + i),ppc_inst (inst));#if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 ) -patch_instruction (epapr_ev_idle_start + i,ppc_inst (inst)); +patch_instruction ((struct ppc_inst *)(epapr_ev_idle_start + i),ppc_inst (inst));#endif }
arch/powerpc/kernel/hw_breakpoint.c +2 -2
@@ -244,12 +244,12 @@ dar_range_overlaps(unsigned long dar, int size, struct arch_hw_breakpoint *info)static bool stepping_handler (struct pt_regs *regs,struct perf_event *bp,struct arch_hw_breakpoint *info) { -unsigned int instr =ppc_inst (0 ); +struct ppc_inst instr =ppc_inst (0 );int ret, type, size;struct instruction_op op;unsigned long addr = info->address; -if (__get_user_inatomic (instr, (unsigned int *)regs->nip)) +if (__get_user_inatomic (instr.val, (unsigned int *)regs->nip)) goto fail; ret =analyse_instr (&op, regs, instr);
arch/powerpc/kernel/jump_label.c +1 -1
@@ -11,7 +11,7 @@void arch_jump_label_transform (struct jump_entry *entry,enum jump_label_type type) { -u32 *addr = (u32 *)(unsigned long )entry->code; +struct ppc_inst *addr = (struct ppc_inst *)(unsigned long )entry->code;if (type ==JUMP_LABEL_JMP )patch_branch (addr, entry->target,0 );
arch/powerpc/kernel/kgdb.c +2 -2
@@ -419,7 +419,7 @@ int kgdb_arch_set_breakpoint(struct kgdb_bkpt *bpt) {int err;unsigned int instr; -unsigned int *addr = (unsigned int *)bpt->bpt_addr; +struct ppc_inst *addr = (struct ppc_inst *)bpt->bpt_addr; err =probe_kernel_address (addr, instr);if (err)
@@ -438,7 +438,7 @@ int kgdb_arch_remove_breakpoint(struct kgdb_bkpt *bpt) {int err;unsigned int instr = *(unsigned int *)bpt->saved_instr; -unsigned int *addr = (unsigned int *)bpt->bpt_addr; +struct ppc_inst *addr = (struct ppc_inst *)bpt->bpt_addr; err =patch_instruction (addr,ppc_inst (instr));if (err)
arch/powerpc/kernel/kprobes.c +4 -4
@@ -106,7 +106,7 @@ kprobe_opcode_t *kprobe_lookup_name(const char *name, unsigned int offset)int arch_prepare_kprobe (struct kprobe *p) {int ret =0 ; -kprobe_opcode_t insn = *p->addr; +struct ppc_inst insn = *(struct ppc_inst *)p->addr;if ((unsigned long )p->addr &0x03 ) {printk ("Attempt to register kprobe at an unaligned address\n" );
@@ -139,13 +139,13 @@ NOKPROBE_SYMBOL(arch_prepare_kprobe);void arch_arm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); +patch_instruction ((struct ppc_inst *)p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); }NOKPROBE_SYMBOL (arch_arm_kprobe);void arch_disarm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,ppc_inst (p->opcode)); +patch_instruction ((struct ppc_inst *)p->addr,ppc_inst (p->opcode)); }NOKPROBE_SYMBOL (arch_disarm_kprobe);
@@ -217,7 +217,7 @@ NOKPROBE_SYMBOL(arch_prepare_kretprobe);static int try_to_emulate (struct kprobe *p,struct pt_regs *regs) {int ret; -unsigned int insn = *p->ainsn.insn; +struct ppc_inst insn = *(struct ppc_inst *)p->ainsn.insn;/* regs->nip is also adjusted if emulate_step returns 1 */ ret =emulate_step (regs, insn);
arch/powerpc/kernel/mce_power.c +3 -2
@@ -20,6 +20,7 @@#include <asm/sstep.h> #include <asm/exception-64s.h> #include <asm/extable.h> +#include <asm/inst.h> /* * Convert an address related to an mm to a PFN. NOTE: we are in real
@@ -365,7 +366,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs *regs, uint64_t *addr,* in real-mode is tricky and can lead to recursive * faults */ -int instr; +struct ppc_inst instr;unsigned long pfn, instr_addr;struct instruction_op op;struct pt_regs tmp = *regs;
@@ -373,7 +374,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs *regs, uint64_t *addr, pfn =addr_to_pfn (regs, regs->nip);if (pfn !=ULONG_MAX ) { instr_addr = (pfn <<PAGE_SHIFT ) + (regs->nip & ~PAGE_MASK ); - instr = *(unsigned int *)(instr_addr); + instr = *(struct ppc_inst *)(instr_addr);if (!analyse_instr (&op, &tmp, instr)) { pfn =addr_to_pfn (regs, op.ea); *addr = op.ea;
arch/powerpc/kernel/optprobes.c +20 -20
@@ -100,8 +100,8 @@ static unsigned long can_optimize(struct kprobe *p)* Ensure that the instruction is not a conditional branch, * and that can be emulated. */ -if (!is_conditional_branch (*p->ainsn.insn) && -analyse_instr (&op, ®s, *p->ainsn.insn) ==1 ) { +if (!is_conditional_branch (*(struct ppc_inst *)p->ainsn.insn) && +analyse_instr (&op, ®s, *(struct ppc_inst *)p->ainsn.insn) ==1 ) {emulate_update_regs (®s, &op); nip = regs.nip; }
@@ -148,12 +148,12 @@ void arch_remove_optimized_kprobe(struct optimized_kprobe *op)void patch_imm32_load_insns (unsigned int val,kprobe_opcode_t *addr) {/* addis r4,0,(insn)@h */ -patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (4 ) | +patch_instruction ((struct ppc_inst *)addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (4 ) | ((val >>16 ) &0xffff ))); addr++;/* ori r4,r4,(insn)@l */ -patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (4 ) | +patch_instruction ((struct ppc_inst *)addr,ppc_inst (PPC_INST_ORI |___PPC_RA (4 ) |___PPC_RS (4 ) | (val &0xffff ))); }
@@ -164,34 +164,34 @@ void patch_imm32_load_insns(unsigned int val, kprobe_opcode_t *addr)void patch_imm64_load_insns (unsigned long val,kprobe_opcode_t *addr) {/* lis r3,(op)@highest */ -patch_instruction (addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (3 ) | +patch_instruction ((struct ppc_inst *)addr,ppc_inst (PPC_INST_ADDIS |___PPC_RT (3 ) | ((val >>48 ) &0xffff ))); addr++;/* ori r3,r3,(op)@higher */ -patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +patch_instruction ((struct ppc_inst *)addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) |___PPC_RS (3 ) | ((val >>32 ) &0xffff ))); addr++;/* rldicr r3,r3,32,31 */ -patch_instruction (addr,ppc_inst (PPC_INST_RLDICR |___PPC_RA (3 ) | +patch_instruction ((struct ppc_inst *)addr,ppc_inst (PPC_INST_RLDICR |___PPC_RA (3 ) |___PPC_RS (3 ) |__PPC_SH64 (32 ) |__PPC_ME64 (31 ))); addr++;/* oris r3,r3,(op)@h */ -patch_instruction (addr,ppc_inst (PPC_INST_ORIS |___PPC_RA (3 ) | +patch_instruction ((struct ppc_inst *)addr,ppc_inst (PPC_INST_ORIS |___PPC_RA (3 ) |___PPC_RS (3 ) | ((val >>16 ) &0xffff ))); addr++;/* ori r3,r3,(op)@l */ -patch_instruction (addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) | +patch_instruction ((struct ppc_inst *)addr,ppc_inst (PPC_INST_ORI |___PPC_RA (3 ) |___PPC_RS (3 ) | (val &0xffff ))); }int arch_prepare_optimized_kprobe (struct optimized_kprobe *op,struct kprobe *p) { -kprobe_opcode_t *buff, branch_op_callback, branch_emulate_step; -kprobe_opcode_t *op_callback_addr, *emulate_step_addr; +struct ppc_inst branch_op_callback, branch_emulate_step; +kprobe_opcode_t *op_callback_addr, *emulate_step_addr, *buff;long b_offset;unsigned long nip, size;int rc, i;
@@ -231,7 +231,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) size = (TMPL_END_IDX *sizeof (kprobe_opcode_t)) /sizeof (int );pr_devel ("Copying template to %p, size %lu\n" , buff, size);for (i =0 ; i < size; i++) { - rc =patch_instruction (buff + i,ppc_inst (*(optprobe_template_entry + i))); + rc =patch_instruction ((struct ppc_inst *)(buff + i),ppc_inst (*(optprobe_template_entry + i)));if (rc <0 ) goto error; }
@@ -253,20 +253,20 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) } rc =create_branch (&branch_op_callback, - (unsigned int *)buff +TMPL_CALL_HDLR_IDX , + (struct ppc_inst *)(buff +TMPL_CALL_HDLR_IDX ), (unsigned long )op_callback_addr,BRANCH_SET_LINK ); rc |=create_branch (&branch_emulate_step, - (unsigned int *)buff +TMPL_EMULATE_IDX , + (struct ppc_inst *)(buff +TMPL_EMULATE_IDX ), (unsigned long )emulate_step_addr,BRANCH_SET_LINK );if (rc) goto error; -patch_instruction (buff +TMPL_CALL_HDLR_IDX , branch_op_callback); -patch_instruction (buff +TMPL_EMULATE_IDX , branch_emulate_step); +patch_instruction ((struct ppc_inst *)(buff +TMPL_CALL_HDLR_IDX ), branch_op_callback); +patch_instruction ((struct ppc_inst *)(buff +TMPL_EMULATE_IDX ), branch_emulate_step);/* * 3. load instruction to be emulated into relevant register, and
@@ -276,7 +276,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p)/* * 4. branch back from trampoline */ -patch_branch (buff +TMPL_RET_IDX , (unsigned long )nip,0 ); +patch_branch ((void *)(buff +TMPL_RET_IDX ), (unsigned long )nip,0 );flush_icache_range ((unsigned long )buff, (unsigned long )(&buff[TMPL_END_IDX ]));
@@ -308,7 +308,7 @@ int arch_check_optimized_kprobe(struct optimized_kprobe *op)void arch_optimize_kprobes (struct list_head *oplist) { -unsigned int instr; +struct ppc_inst instr;struct optimized_kprobe *op;struct optimized_kprobe *tmp;
@@ -320,9 +320,9 @@ void arch_optimize_kprobes(struct list_head *oplist)memcpy (op->optinsn.copied_insn, op->kp.addr,RELATIVEJUMP_SIZE );create_branch (&instr, - (unsigned int *)op->kp.addr, + (struct ppc_inst *)op->kp.addr, (unsigned long )op->optinsn.insn,0 ); -patch_instruction (op->kp.addr, instr); +patch_instruction ((struct ppc_inst *)op->kp.addr, instr);list_del_init (&op->list); } }
arch/powerpc/kernel/setup_32.c +1 -1
@@ -76,7 +76,7 @@ EXPORT_SYMBOL(DMA_MODE_WRITE); notrace void __init machine_init(u64 dt_ptr) {unsigned int *addr = (unsigned int *)patch_site_addr (&patch__memset_nocache); -unsigned long insn; +struct ppc_inst insn;/* Configure static keys first, now that we're relocated. */ setup_feature_keys ();
arch/powerpc/kernel/trace/ftrace.c +42 -41
289 lines not on this page · raw message
arch/powerpc/kernel/vecemu.c +3 -2
@@ -261,11 +261,12 @@ static unsigned int rfin(unsigned int x)int emulate_altivec (struct pt_regs *regs) { -unsigned int instr, i, word; +struct ppc_inst instr; +unsigned int i, word;unsigned int va, vb, vc, vd;vector128 *vrs; -if (get_user (instr, (unsigned int __user *) regs->nip)) +if (get_user (instr.val, (unsigned int __user *) regs->nip))return -EFAULT ; word =ppc_inst_val (instr);
arch/powerpc/lib/code-patching.c +35 -34
220 lines not on this page · raw message
arch/powerpc/lib/feature-fixups.c +24 -24
115 lines not on this page · raw message
arch/powerpc/lib/sstep.c +2 -2
@@ -1163,7 +1163,7 @@ static nokprobe_inline int trap_compare(long v1, long v2)* otherwise. */ int analyse_instr (struct instruction_op *op,const struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr) {unsigned int opcode, ra, rb, rc, rd, spr, u;unsigned long int imm;
@@ -3103,7 +3103,7 @@ NOKPROBE_SYMBOL(emulate_loadstore);* or -1 if the instruction is one that should not be stepped, * such as an rfid, or a mtmsrd that would clear MSR_RI. */ -int emulate_step (struct pt_regs *regs,unsigned int instr) +int emulate_step (struct pt_regs *regs,struct ppc_inst instr) {struct instruction_op op;int r, err, type;
arch/powerpc/lib/test_emulate_step.c +5 -4
@@ -461,7 +461,7 @@ struct compute_test {struct {char *descr;unsigned long flags; -unsigned int instr; +struct ppc_inst instr;struct pt_regs regs; } subtests[MAX_SUBTESTS +1 ]; };
@@ -842,7 +842,7 @@ static struct compute_test compute_tests[] = { };static int __init emulate_compute_instr (struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr) {struct instruction_op op;
@@ -860,7 +860,7 @@ static int __init emulate_compute_instr(struct pt_regs *regs, }static int __init execute_compute_instr (struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr) {extern int exec_instr (struct pt_regs *regs);extern s32 patch__exec_instr;
@@ -891,7 +891,8 @@ static void __init run_tests_compute(void)unsigned long flags;struct compute_test *test;struct pt_regs *regs, exp, got; -unsigned int i, j, k, instr; +unsigned int i, j, k; +struct ppc_inst instr;bool ignore_gpr, ignore_xer, ignore_ccr, passed;for (i =0 ; i <ARRAY_SIZE (compute_tests); i++) {
arch/powerpc/perf/core-book3s.c +2 -2
@@ -421,14 +421,14 @@ static __u64 power_pmu_bhrb_to(u64 addr)if (probe_kernel_read (&instr, (void *)addr,sizeof (instr)))return 0 ; -return branch_target (&instr); +return branch_target ((struct ppc_inst *)&instr); }/* Userspace: need copy instruction here then translate it */ if (probe_user_read (&instr, (unsigned int __user *)addr,sizeof (instr)))return 0 ; - target =branch_target (&instr); + target =branch_target ((struct ppc_inst *)&instr);if ((!target) || (instr &BRANCH_ABSOLUTE ))return target;
arch/powerpc/xmon/xmon.c +12 -12
@@ -99,7 +99,7 @@ static long *xmon_fault_jmp[NR_CPUS];/* Breakpoint stuff */ struct bpt {unsigned long address; -unsigned int *instr; +struct ppc_inst *instr;atomic_t ref_count;int enabled;unsigned long pad;
@@ -117,7 +117,7 @@ static unsigned bpinstr = 0x7fe00008; /* trap */#define BP_NUM (bp) ((bp) - bpts + 1) -#define BPT_SIZE (sizeof(unsigned int) * 2) +#define BPT_SIZE (sizeof(struct ppc_inst) * 2)#define BPT_WORDS (BPT_SIZE / sizeof(unsigned int))extern unsigned int bpt_table[NBPTS *BPT_WORDS ];
@@ -879,8 +879,8 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; - bp->instr = bpt_table + ((bp - bpts) *BPT_WORDS ); -patch_instruction (bp->instr +1 , bpinstr); + bp->instr = (void *)(bpt_table + ((bp - bpts) *BPT_WORDS )); +patch_instruction (bp->instr +1 ,ppc_inst (bpinstr));return bp; } }
@@ -892,7 +892,7 @@ static struct bpt *new_breakpoint(unsigned long a)static void insert_bpts (void ) {int i; -unsigned int instr; +struct ppc_inst instr;struct bpt *bp; bp = bpts;
@@ -914,8 +914,8 @@ static void insert_bpts(void)patch_instruction (bp->instr, instr);if (bp->enabled &BP_CIABR )continue ; -if (patch_instruction ((unsigned int *)bp->address, - bpinstr) !=0 ) { +if (patch_instruction ((struct ppc_inst *)bp->address, +ppc_inst (bpinstr)) !=0 ) {printf ("Couldn't write instruction at %lx, " "disabling breakpoint there\n" , bp->address); bp->enabled &= ~BP_TRAP ;
@@ -943,7 +943,7 @@ static void remove_bpts(void) {int i;struct bpt *bp; -unsigned instr; +struct ppc_inst instr; bp = bpts;for (i =0 ; i <NBPTS ; ++i, ++bp) {
@@ -952,7 +952,7 @@ static void remove_bpts(void)if (mread (bp->address, &instr,4 ) ==4 &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( - (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) + (struct ppc_inst *)bp->address, bp->instr[0 ]) !=0 )printf ("Couldn't remove breakpoint at %lx\n" , bp->address); }
@@ -1159,7 +1159,7 @@ static int do_step(struct pt_regs *regs)*/ static int do_step (struct pt_regs *regs) { -unsigned int instr; +struct ppc_inst instr;int stepped;force_enable_xmon ();
@@ -1325,7 +1325,7 @@ csum(void)*/ static long check_bp_loc (unsigned long addr) { -unsigned int instr; +struct ppc_inst instr; addr &= ~3 ;if (!is_kernel_addr (addr)) {
@@ -2846,7 +2846,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, {int nr, dotted;unsigned long first_adr; -unsigned int inst, last_inst =ppc_inst (0 ); +struct ppc_inst inst, last_inst =ppc_inst (0 );unsigned char val[4 ]; dotted =0 ;
Signature · 1 line
2.17.1
kbuild test robot
build botRe: [PATCH v5 09/21] powerpc: Use a datatype for instructions
Thank you for the patch! Yet something to improve:
Hi Jordan,
Thank you for the patch! Yet something to improve:
[auto build test ERROR on v5.6]
[cannot apply to powerpc/next kvm-ppc/kvm-ppc-next scottwood/next next-20200406] [if your patch is applied to the wrong git tree, please drop us a note to help improve the system. BTW, we also suggest to use '--base' option to specify the base tree in git format-patch, please see https://stackoverflow.com/a/37406982]
url: https://github.com/0day-ci/linux/commits/Jordan-Niethe/Initial-Prefixed-Instruction-support/20200406-165215 base: 7111951b8d4973bda27ff663f2cf18b663d15b48 config: powerpc-rhel-kconfig (attached as .config) compiler: powerpc64le-linux-gcc (GCC) 9.3.0
reproduce:
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin/make.cross
# save the attached .config to linux build tree
GCC_VERSION=9.3.0 make.cross ARCH=powerpc
If you fix the issue, kindly add following tag as appropriate
All errors (new ones prefixed by >>):
arch/powerpc/lib/feature-fixups.c: In function 'do_final_fixups':
>> arch/powerpc/lib/feature-fixups.c:404:25: error: passing argument 1 of 'raw_patch_instruction' from incompatible pointer type [-Werror=incompatible-pointer-types]
404 | raw_patch_instruction(dest, ppc_inst(*src));
| ^~~~
| |
| int *
In file included from arch/powerpc/lib/feature-fixups.c:18:
arch/powerpc/include/asm/code-patching.h:32:44: note: expected 'struct ppc_inst *' but argument is of type 'int *'
32 | int raw_patch_instruction(struct ppc_inst *addr, struct ppc_inst instr);
| ~~~~~~~~~~~~~~~~~^~~~cc1: some warnings being treated as errors
vim +/raw_patch_instruction +404 arch/powerpc/lib/feature-fixups.c
2d1b2027626d51 Kumar Gala 2008-07-02 389
9402c684613163 Benjamin Herrenschmidt 2016-07-05 390 static void do_final_fixups(void)
d715e433b7ad19 Anton Blanchard 2011-11-14 391 {
d715e433b7ad19 Anton Blanchard 2011-11-14 392 #if defined(CONFIG_PPC64) && defined(CONFIG_RELOCATABLE)
d715e433b7ad19 Anton Blanchard 2011-11-14 393 int *src, *dest;
d715e433b7ad19 Anton Blanchard 2011-11-14 394 unsigned long length;
d715e433b7ad19 Anton Blanchard 2011-11-14 395
d715e433b7ad19 Anton Blanchard 2011-11-14 396 if (PHYSICAL_START == 0)
d715e433b7ad19 Anton Blanchard 2011-11-14 397 return;
d715e433b7ad19 Anton Blanchard 2011-11-14 398
d715e433b7ad19 Anton Blanchard 2011-11-14 399 src = (int *)(KERNELBASE + PHYSICAL_START);
d715e433b7ad19 Anton Blanchard 2011-11-14 400 dest = (int *)KERNELBASE;
d715e433b7ad19 Anton Blanchard 2011-11-14 401 length = (__end_interrupts - _stext) / sizeof(int);
d715e433b7ad19 Anton Blanchard 2011-11-14 402
d715e433b7ad19 Anton Blanchard 2011-11-14 403 while (length--) {
16f7ae823ee707 Jordan Niethe 2020-04-06 @404 raw_patch_instruction(dest, ppc_inst(*src));
d715e433b7ad19 Anton Blanchard 2011-11-14 405 src++;
d715e433b7ad19 Anton Blanchard 2011-11-14 406 dest++;
d715e433b7ad19 Anton Blanchard 2011-11-14 407 }
d715e433b7ad19 Anton Blanchard 2011-11-14 408 #endif
d715e433b7ad19 Anton Blanchard 2011-11-14 409 }
d715e433b7ad19 Anton Blanchard 2011-11-14 410 :::::: The code at line 404 was first introduced by commit
:::::: 16f7ae823ee70796c5ba2cc321b2c02f3dcfb816 powerpc: Use a macro for creating instructions from u32s
:::::: TO: Jordan Niethe <[email protected]>
:::::: CC: 0day robot <[email protected]>
---
0-DAY CI Kernel Test Service, Intel Corporation
https://lists.01.org/hyperkitty/list/kbuild-all(a)lists.01.org
kbuild test robot
build botRe: [PATCH v5 09/21] powerpc: Use a datatype for instructions
In reply to Jordan NietheThank you for the patch! Yet something to improve:
Hi Jordan,
Thank you for the patch! Yet something to improve:
[auto build test ERROR on v5.6]
[cannot apply to powerpc/next kvm-ppc/kvm-ppc-next scottwood/next next-20200406] [if your patch is applied to the wrong git tree, please drop us a note to help improve the system. BTW, we also suggest to use '--base' option to specify the base tree in git format-patch, please see https://stackoverflow.com/a/37406982]
url: https://github.com/0day-ci/linux/commits/Jordan-Niethe/Initial-Prefixed-Instruction-support/20200406-165215 base: 7111951b8d4973bda27ff663f2cf18b663d15b48 config: powerpc-allnoconfig (attached as .config) compiler: powerpc-linux-gcc (GCC) 9.3.0
reproduce:
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin/make.cross
# save the attached .config to linux build tree
GCC_VERSION=9.3.0 make.cross ARCH=powerpc
If you fix the issue, kindly add following tag as appropriate
All error/warnings (new ones prefixed by >>):
In file included from arch/powerpc/include/asm/asm-compat.h:6,
from arch/powerpc/include/asm/bitops.h:42,
from include/linux/bitops.h:29,
from include/linux/kernel.h:12,
from include/linux/list.h:9,
from include/linux/module.h:12,
from arch/powerpc/kernel/setup_32.c:6:
arch/powerpc/kernel/setup_32.c: In function 'machine_init':
>> arch/powerpc/include/asm/ppc-opcode.h:234:24: error: incompatible type for argument 2 of 'patch_instruction_site'
234 | #define PPC_INST_NOP 0x60000000
| ^~~~~~~~~~
| |
| int
>> arch/powerpc/kernel/setup_32.c:89:49: note: in expansion of macro 'PPC_INST_NOP'
89 | patch_instruction_site(&patch__memcpy_nocache, PPC_INST_NOP);
| ^~~~~~~~~~~~
In file included from arch/powerpc/kernel/setup_32.c:42:
arch/powerpc/include/asm/code-patching.h:39:69: note: expected 'struct ppc_inst' but argument is of type 'int'
39 | static inline int patch_instruction_site(s32 *site, struct ppc_inst instr)
| ~~~~~~~~~~~~~~~~^~~~~
>> arch/powerpc/kernel/setup_32.c:91:48: error: passing argument 1 of 'branch_target' from incompatible pointer type [-Werror=incompatible-pointer-types]
91 | create_cond_branch(&insn, addr, branch_target(addr), 0x820000);
| ^~~~
| |
| unsigned int *
In file included from arch/powerpc/kernel/setup_32.c:42:
arch/powerpc/include/asm/code-patching.h:63:52: note: expected 'const struct ppc_inst *' but argument is of type 'unsigned int *'
63 | unsigned long branch_target(const struct ppc_inst *instr);
| ~~~~~~~~~~~~~~~~~~~~~~~^~~~~
arch/powerpc/kernel/setup_32.c:91:28: error: passing argument 2 of 'create_cond_branch' from incompatible pointer type [-Werror=incompatible-pointer-types]
91 | create_cond_branch(&insn, addr, branch_target(addr), 0x820000);
| ^~~~
| |
| unsigned int *
In file included from arch/powerpc/kernel/setup_32.c:42:
arch/powerpc/include/asm/code-patching.h:28:71: note: expected 'const struct ppc_inst *' but argument is of type 'unsigned int *'
28 | int create_cond_branch(struct ppc_inst *instr, const struct ppc_inst *addr,
| ~~~~~~~~~~~~~~~~~~~~~~~^~~~
>> arch/powerpc/kernel/setup_32.c:92:20: error: passing argument 1 of 'patch_instruction' from incompatible pointer type [-Werror=incompatible-pointer-types]
92 | patch_instruction(addr, insn); /* replace b by bne cr0 */
| ^~~~
| |
| unsigned int *
In file included from arch/powerpc/kernel/setup_32.c:42:
arch/powerpc/include/asm/code-patching.h:31:40: note: expected 'struct ppc_inst *' but argument is of type 'unsigned int *'
31 | int patch_instruction(struct ppc_inst *addr, struct ppc_inst instr);
| ~~~~~~~~~~~~~~~~~^~~~cc1: all warnings being treated as errors
vim +/patch_instruction_site +234 arch/powerpc/include/asm/ppc-opcode.h
9123c5ed45a583 Hongtao Jia 2013-04-28 193 16c57b3620d77e Kumar Gala 2009-02-10 194 /* sorted alphabetically */ 95213959aefc94 Anshuman Khandual 2013-04-22 195 #define PPC_INST_BHRBE 0x7c00025c 95213959aefc94 Anshuman Khandual 2013-04-22 196 #define PPC_INST_CLRBHRB 0x7c00035c 07d2a628bc0008 Nicholas Piggin 2017-06-09 197 #define PPC_INST_COPY 0x7c20060c 8a649045e75a4b Chris Smart 2016-04-26 198 #define PPC_INST_CP_ABORT 0x7c00068c e66ca3db5917f4 Matt Brown 2017-08-04 199 #define PPC_INST_DARN 0x7c0005e6 16c57b3620d77e Kumar Gala 2009-02-10 200 #define PPC_INST_DCBA 0x7c0005ec 16c57b3620d77e Kumar Gala 2009-02-10 201 #define PPC_INST_DCBA_MASK 0xfc0007fe 16c57b3620d77e Kumar Gala 2009-02-10 202 #define PPC_INST_DCBAL 0x7c2005ec 16c57b3620d77e Kumar Gala 2009-02-10 203 #define PPC_INST_DCBZL 0x7c2007ec 1afc149def25ac Tony Breeds 2012-10-02 204 #define PPC_INST_ICBT 0x7c00002c edc424f8cd84bb Dan Streetman 2015-05-07 205 #define PPC_INST_ICSWX 0x7c00032d edc424f8cd84bb Dan Streetman 2015-05-07 206 #define PPC_INST_ICSWEPX 0x7c00076d 16c57b3620d77e Kumar Gala 2009-02-10 207 #define PPC_INST_ISEL 0x7c00001e 16c57b3620d77e Kumar Gala 2009-02-10 208 #define PPC_INST_ISEL_MASK 0xfc00003e 864b9e6fd76489 Anton Blanchard 2010-02-10 209 #define PPC_INST_LDARX 0x7c0000a8 156d0e290e969c Naveen N. Rao 2016-06-22 210 #define PPC_INST_STDCX 0x7c0001ad 350779a29f11f8 Paul Mackerras 2017-08-30 211 #define PPC_INST_LQARX 0x7c000228 350779a29f11f8 Paul Mackerras 2017-08-30 212 #define PPC_INST_STQCX 0x7c00016d 16c57b3620d77e Kumar Gala 2009-02-10 213 #define PPC_INST_LSWI 0x7c0004aa 16c57b3620d77e Kumar Gala 2009-02-10 214 #define PPC_INST_LSWX 0x7c00042a d6ccb1f55ddf51 Kumar Gala 2010-03-10 215 #define PPC_INST_LWARX 0x7c000028 156d0e290e969c Naveen N. Rao 2016-06-22 216 #define PPC_INST_STWCX 0x7c00012d 16c57b3620d77e Kumar Gala 2009-02-10 217 #define PPC_INST_LWSYNC 0x7c2004ac 9863c28a2af90a James Yang 2013-07-03 218 #define PPC_INST_SYNC 0x7c0004ac 9863c28a2af90a James Yang 2013-07-03 219 #define PPC_INST_SYNC_MASK 0xfc0007fe ddc6cd0d70a6f9 Christophe Leroy 2016-05-17 220 #define PPC_INST_ISYNC 0x4c00012c dfb432cb960bfc Michael Neuling 2009-04-29 221 #define PPC_INST_LXVD2X 0x7c000698 16c57b3620d77e Kumar Gala 2009-02-10 222 #define PPC_INST_MCRXR 0x7c000400 16c57b3620d77e Kumar Gala 2009-02-10 223 #define PPC_INST_MCRXR_MASK 0xfc0007fe 16c57b3620d77e Kumar Gala 2009-02-10 224 #define PPC_INST_MFSPR_PVR 0x7c1f42a6 178f358208ceb8 Anton Blanchard 2017-01-19 225 #define PPC_INST_MFSPR_PVR_MASK 0xfc1ffffe e16c8765533a15 Andy Fleming 2011-12-08 226 #define PPC_INST_MFTMR 0x7c0002dc 16c57b3620d77e Kumar Gala 2009-02-10 227 #define PPC_INST_MSGSND 0x7c00019c 755563bc79c764 Paul Mackerras 2015-03-19 228 #define PPC_INST_MSGCLR 0x7c0001dc 6b3edefefa6752 Nicholas Piggin 2017-04-13 229 #define PPC_INST_MSGSYNC 0x7c0006ec 42d02b81f265b7 Ian Munsie 2012-11-14 230 #define PPC_INST_MSGSNDP 0x7c00011c a9af97aa0a12c3 Nicholas Piggin 2017-06-13 231 #define PPC_INST_MSGCLRP 0x7c00015c 4bb3c7a0208fc1 Paul Mackerras 2018-03-21 232 #define PPC_INST_MTMSRD 0x7c000164 e16c8765533a15 Andy Fleming 2011-12-08 233 #define PPC_INST_MTTMR 0x7c0003dc 16c57b3620d77e Kumar Gala 2009-02-10 @234 #define PPC_INST_NOP 0x60000000 07d2a628bc0008 Nicholas Piggin 2017-06-09 235 #define PPC_INST_PASTE 0x7c20070d 16c57b3620d77e Kumar Gala 2009-02-10 236 #define PPC_INST_POPCNTB 0x7c0000f4 16c57b3620d77e Kumar Gala 2009-02-10 237 #define PPC_INST_POPCNTB_MASK 0xfc0007fe b5f9b6665b70b4 Anton Blanchard 2010-12-07 238 #define PPC_INST_POPCNTD 0x7c0003f4 b5f9b6665b70b4 Anton Blanchard 2010-12-07 239 #define PPC_INST_POPCNTW 0x7c0002f4 4bb3c7a0208fc1 Paul Mackerras 2018-03-21 240 #define PPC_INST_RFEBB 0x4c000124 16c57b3620d77e Kumar Gala 2009-02-10 241 #define PPC_INST_RFCI 0x4c000066 16c57b3620d77e Kumar Gala 2009-02-10 242 #define PPC_INST_RFDI 0x4c00004e 4bb3c7a0208fc1 Paul Mackerras 2018-03-21 243 #define PPC_INST_RFID 0x4c000024 16c57b3620d77e Kumar Gala 2009-02-10 244 #define PPC_INST_RFMCI 0x4c00004c cd99ddbea250ee Christophe Leroy 2018-01-12 245 #define PPC_INST_MFSPR 0x7c0002a6 efcac6589a277c Alexey Kardashevskiy 2011-03-02 246 #define PPC_INST_MFSPR_DSCR 0x7c1102a6 178f358208ceb8 Anton Blanchard 2017-01-19 247 #define PPC_INST_MFSPR_DSCR_MASK 0xfc1ffffe efcac6589a277c Alexey Kardashevskiy 2011-03-02 248 #define PPC_INST_MTSPR_DSCR 0x7c1103a6 178f358208ceb8 Anton Blanchard 2017-01-19 249 #define PPC_INST_MTSPR_DSCR_MASK 0xfc1ffffe 73d2fb758e678c Anton Blanchard 2013-05-01 250 #define PPC_INST_MFSPR_DSCR_USER 0x7c0302a6 178f358208ceb8 Anton Blanchard 2017-01-19 251 #define PPC_INST_MFSPR_DSCR_USER_MASK 0xfc1ffffe 73d2fb758e678c Anton Blanchard 2013-05-01 252 #define PPC_INST_MTSPR_DSCR_USER 0x7c0303a6 178f358208ceb8 Anton Blanchard 2017-01-19 253 #define PPC_INST_MTSPR_DSCR_USER_MASK 0xfc1ffffe 6dd7a82cc54ebd Anton Blanchard 2016-07-01 254 #define PPC_INST_MFVSRD 0x7c000066 6dd7a82cc54ebd Anton Blanchard 2016-07-01 255 #define PPC_INST_MTVSRD 0x7c000166 d16952a629129c Christophe Leroy 2018-11-09 256 #define PPC_INST_SC 0x44000002 697d3899dcb4bc Paul Mackerras 2011-12-12 257 #define PPC_INST_SLBFEE 0x7c0007a7 09cf5bcb0c9355 Aneesh Kumar K.V 2016-07-13 258 #define PPC_INST_SLBIA 0x7c0003e4 16c57b3620d77e Kumar Gala 2009-02-10 259
:::::: The code at line 234 was first introduced by commit
:::::: 16c57b3620d77e0bc981da5ef32beae730512684 powerpc: Unify opcode definitions and support
:::::: TO: Kumar Gala <[email protected]> :::::: CC: Benjamin Herrenschmidt <[email protected]>
---
0-DAY CI Kernel Test Service, Intel Corporation
https://lists.01.org/hyperkitty/list/kbuild-all(a)lists.01.org
Re: [PATCH v5 09/21] powerpc: Use a datatype for instructions
In reply to Jordan NietheQuoted 240 lines · Jordan Niethe
Currently unsigned ints are used to represent instructions on powerpc. This has worked well as instructions have always been 4 byte words. However, a future ISA version will introduce some changes to instructions that mean this scheme will no longer work as well. This change is Prefixed Instructions. A prefixed instruction is made up of a word prefix followed by a word suffix to make an 8 byte double word instruction. No matter the endianess of the system the prefix always comes first. Prefixed instructions are only planned for powerpc64.
Introduce a
ppc_insttype to represent both prefixed and word instructions on powerpc64 while keeping it possible to exclusively have word instructions on powerpc32, A latter patch will expand the type to include prefixed instructions but for now just typedef it to a u32.Later patches will introduce helper functions and macros for manipulating the instructions so that powerpc64 and powerpc32 might maintain separate type definitions.
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: Add toepapr_paravirt.c,kgdb.c--- arch/powerpc/include/asm/code-patching.h | 32 ++++----- arch/powerpc/include/asm/inst.h | 20 +++--- arch/powerpc/include/asm/sstep.h | 5 +- arch/powerpc/include/asm/uprobes.h | 5 +- arch/powerpc/kernel/align.c | 4 +- arch/powerpc/kernel/epapr_paravirt.c | 4 +- arch/powerpc/kernel/hw_breakpoint.c | 4 +- arch/powerpc/kernel/jump_label.c | 2 +- arch/powerpc/kernel/kgdb.c | 4 +- arch/powerpc/kernel/kprobes.c | 8 +-- arch/powerpc/kernel/mce_power.c | 5 +- arch/powerpc/kernel/optprobes.c | 40 ++++++------ arch/powerpc/kernel/setup_32.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 83 ++++++++++++------------ arch/powerpc/kernel/vecemu.c | 5 +- arch/powerpc/lib/code-patching.c | 69 ++++++++++---------- arch/powerpc/lib/feature-fixups.c | 48 +++++++------- arch/powerpc/lib/sstep.c | 4 +- arch/powerpc/lib/test_emulate_step.c | 9 +-- arch/powerpc/perf/core-book3s.c | 4 +- arch/powerpc/xmon/xmon.c | 24 +++---- 21 files changed, 196 insertions(+), 185 deletions(-)arch/powerpc/include/asm/code-patching.h +9
-9@@ -23,33 +23,33 @@#define BRANCH_ABSOLUTE 0x2bool is_offset_in_branch_range (long offset); -int create_branch (unsigned int *instr,const unsigned int *addr, +int create_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags); -int create_cond_branch (unsigned int *instr,const unsigned int *addr, +int create_cond_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags); -int patch_branch (unsigned int *addr,unsigned long target,int flags); -int patch_instruction (unsigned int *addr,unsigned int instr); -int raw_patch_instruction (unsigned int *addr,unsigned int instr); +int patch_branch (struct ppc_inst *addr,unsigned long target,int flags); +int patch_instruction (struct ppc_inst *addr,struct ppc_inst instr); +int raw_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr);static inline unsigned long patch_site_addr (s32 *site) {return (unsigned long )site + *site; } -static inline int patch_instruction_site (s32 *site,unsigned int instr) +static inline int patch_instruction_site (s32 *site,struct ppc_inst instr) { -return patch_instruction ((unsigned int *)patch_site_addr (site), instr); +return patch_instruction ((struct ppc_inst *)patch_site_addr (site), instr); }static inline int patch_branch_site (s32 *site,unsigned long target,int flags) { -return patch_branch ((unsigned int *)patch_site_addr (site), target, flags); +return patch_branch ((struct ppc_inst *)patch_site_addr (site), target, flags); }static inline int modify_instruction (unsigned int *addr,unsigned int clr,unsigned int set) { -return patch_instruction (addr,ppc_inst ((*addr & ~clr) | set)); + return patch_instruction((struct ppc_inst *)addr, ppc_inst((*addr &~clr) | set));
}static inline int modify_instruction_site(s32 *site, unsigned int clr,
unsigned int set)arch/powerpc/include/asm/code-patching.h +0
-0@@ -57,13 +57,13 @@ static inline int modify_instruction_site(s32 *site,unsigned int clr, unsigned
return modify_instruction((unsigned int *)patch_site_addr(site), clr,
set);
}arch/powerpc/include/asm/code-patching.h +3
-7-int instr_is_relative_branch (unsigned int instr); -int instr_is_relative_link_branch (unsigned int instr); -int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr); -unsigned long branch_target (const unsigned int *instr); -int translate_branch (unsigned int *instr,const unsigned int *dest, -const unsigned int *src); -extern bool is_conditional_branch (unsigned int instr); +int instr_is_relative_branch (struct ppc_inst instr); +int instr_is_relative_link_branch (struct ppc_inst instr); +int instr_is_branch_to_addr(const struct ppc_inst *instr, unsigned longaddr);
arch/powerpc/include/asm/code-patching.h +4
-0+unsigned long branch_target (const struct ppc_inst *instr); +int translate_branch (struct ppc_inst *instr,const struct ppc_inst *dest, +const struct ppc_inst *src); +extern bool is_conditional_branch (struct ppc_inst instr);#ifdef CONFIG_PPC_BOOK3E_64 void __patch_exception (int exc,unsigned long addr);#define patch_exception (exc, name) do { \arch/powerpc/include/asm/inst.h +12
-8@@ -6,26 +6,30 @@* Instruction data type for POWER */ -#define ppc_inst (x) (x) +struct ppc_inst { +u32 val; +} __packed; -static inline u32 ppc_inst_val (u32 x) +#define ppc_inst (x) ((struct ppc_inst){ .val = x }) + +static inline u32 ppc_inst_val (struct ppc_inst x) { -return x; +return x.val; } -static inline int ppc_inst_opcode (u32 x) +static inline int ppc_inst_opcode (struct ppc_inst x) { -return x >>26 ; +return x.val >>26 ; } -static inline u32 ppc_inst_swab (u32 x) +static inline struct ppc_inst ppc_inst_swab (struct ppc_inst x) {return ppc_inst (swab32 (ppc_inst_val (x))); } -static inline bool ppc_inst_equal (u32 x,u32 y) +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) { -return x == y; +return !memcmp (&x, &y,sizeof (struct ppc_inst )); }#endif /* _ASM_INST_H */ arch/powerpc/include/asm/sstep.h +2
-1@@ -2,6 +2,7 @@/* * Copyright (C) 2004 Paul Mackerras <[email protected]>, IBM */ +#include <asm/inst.h> struct pt_regs ;@@ -132,7 +133,7 @@ union vsx_reg {* otherwise. */ extern int analyse_instr (struct instruction_op *op,const struct pt_regs *regs, -unsigned int instr); +struct ppc_inst instr);/* * Emulate an instruction that can be executed just by updating
arch/powerpc/include/asm/sstep.h +1
-1@@ -149,7 +150,7 @@ void emulate_update_regs(struct pt_regs *reg, structinstruction_op *op); * 0 if it could not be emulated, or -1 for an instruction that * should not be emulated (rfid, mtmsrd clearing MSR_RI, etc.). */ -extern int emulate_step (struct pt_regs *regs,unsigned int instr); +extern int emulate_step (struct pt_regs *regs,struct ppc_inst instr);/* * Emulate a load or store instruction by reading/writing the
arch/powerpc/include/asm/uprobes.h +3
-2@@ -11,6 +11,7 @@#include <linux/notifier.h> #include <asm/probes.h> +#include <asm/inst.h> typedef ppc_opcode_t uprobe_opcode_t ;@@ -23,8 +24,8 @@ typedef ppc_opcode_t uprobe_opcode_t;struct arch_uprobe {union { -u32 insn; -u32 ixol; +struct ppc_inst insn; +struct ppc_inst ixol; }; };arch/powerpc/kernel/align.c +1
-1@@ -294,7 +294,7 @@ static int emulate_spe(struct pt_regs *regs, unsigned int reg, int fix_alignment(struct pt_regs *regs) { -unsigned int instr; +struct ppc_inst instr;struct instruction_op op;int r, type;
arch/powerpc/kernel/align.c int fix_alignment(struct pt_regs *regs) · line 307
Quoted 5 lines
arch/powerpc/kernel/align.c +1
-1@@ -304,7 +304,7 @@ int fix_alignment(struct pt_regs *regs)*/ CHECK_FULL_REGS (regs); -if (unlikely (__get_user (instr, (unsigned int __user *)regs->nip))) +if (unlikely (__get_user (instr.val, (unsigned int __user *)regs->nip)))
don't we have to use the helper ppc_inst_val() here to retrieve instr.val ?
I see couple of other places we directly retrieve as instr.val. if we need to change it, then all of them should go to patch 6, [PATCH v5 06/21] powerpc: Use an accessor for instructions
Quoted 31 lines
arch/powerpc/kernel/align.c +0
-0return -EFAULT ;if ((regs->msr &MSR_LE ) != (MSR_KERNEL &MSR_LE )) {/* We don't handle PPC little-endian any more... */ arch/powerpc/kernel/epapr_paravirt.c +2
-2@@ -38,9 +38,9 @@ static int __init early_init_dt_scan_epapr(unsigned long node, for (i = 0; i < (len / 4); i++) {u32 inst =be32_to_cpu (insts[i]); -patch_instruction (epapr_hypercall_start + i,ppc_inst (inst)); +patch_instruction ((struct ppc_inst *)(epapr_hypercall_start + i),ppc_inst (inst));#if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 ) -patch_instruction (epapr_ev_idle_start + i,ppc_inst (inst)); +patch_instruction ((struct ppc_inst *)(epapr_ev_idle_start + i),ppc_inst (inst));#endif
arch/powerpc/kernel/epapr_paravirt.c +0
-0}arch/powerpc/kernel/hw_breakpoint.c +0
-0@@ -244,12 +244,12 @@ dar_range_overlaps(unsigned long dar, int size, struct arch_hw_breakpoint *info) static bool stepping_handler(struct pt_regs *regs, struct perf_event *bp,
arch/powerpc/kernel/hw_breakpoint.c dar_range_overlaps(unsigned long dar, int size, struct · line 253
Quoted 10 lines
arch/powerpc/kernel/hw_breakpoint.c +2
-2struct arch_hw_breakpoint *info) { -unsigned int instr =ppc_inst (0 ); +struct ppc_inst instr =ppc_inst (0 );int ret, type, size;struct instruction_op op;unsigned long addr = info->address; -if (__get_user_inatomic (instr, (unsigned int *)regs->nip)) +if (__get_user_inatomic (instr.val, (unsigned int *)regs->nip))
[...] reference to above
Quoted 237 lines
arch/powerpc/kernel/hw_breakpoint.c +0
-0goto fail;arch/powerpc/kernel/hw_breakpoint.c +0
-0ret =analyse_instr (&op, regs, instr);arch/powerpc/kernel/jump_label.c +1
-1@@ -11,7 +11,7 @@void arch_jump_label_transform (struct jump_entry *entry,enum jump_label_type type) { -u32 *addr = (u32 *)(unsigned long )entry->code; +struct ppc_inst *addr = (struct ppc_inst *)(unsigned long )entry->code;if (type ==JUMP_LABEL_JMP )patch_branch (addr, entry->target,0 );arch/powerpc/kernel/kgdb.c +2
-2@@ -419,7 +419,7 @@ int kgdb_arch_set_breakpoint(struct kgdb_bkpt *bpt) {int err;unsigned int instr; -unsigned int *addr = (unsigned int *)bpt->bpt_addr; +struct ppc_inst *addr = (struct ppc_inst *)bpt->bpt_addr; err =probe_kernel_address (addr, instr);if (err)@@ -438,7 +438,7 @@ int kgdb_arch_remove_breakpoint(struct kgdb_bkpt *bpt) {int err;unsigned int instr = *(unsigned int *)bpt->saved_instr; -unsigned int *addr = (unsigned int *)bpt->bpt_addr; +struct ppc_inst *addr = (struct ppc_inst *)bpt->bpt_addr; err =patch_instruction (addr,ppc_inst (instr));if (err)arch/powerpc/kernel/kprobes.c +1
-1@@ -106,7 +106,7 @@ kprobe_opcode_t *kprobe_lookup_name(const char *name, unsigned int offset)int arch_prepare_kprobe (struct kprobe *p) {int ret =0 ; -kprobe_opcode_t insn = *p->addr; +struct ppc_inst insn = *(struct ppc_inst *)p->addr;if ((unsigned long )p->addr &0x03 ) {arch/powerpc/kernel/kprobes.c +3
-3printk ("Attempt to register kprobe at an unaligned address\n" );@@ -139,13 +139,13 @@ NOKPROBE_SYMBOL(arch_prepare_kprobe);void arch_arm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); +patch_instruction ((struct ppc_inst *)p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); }NOKPROBE_SYMBOL (arch_arm_kprobe);void arch_disarm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,ppc_inst (p->opcode)); +patch_instruction ((struct ppc_inst *)p->addr,ppc_inst (p->opcode)); }NOKPROBE_SYMBOL (arch_disarm_kprobe);@@ -217,7 +217,7 @@ NOKPROBE_SYMBOL(arch_prepare_kretprobe);static int try_to_emulate (struct kprobe *p,struct pt_regs *regs) {int ret; -unsigned int insn = *p->ainsn.insn; +struct ppc_inst insn = *(struct ppc_inst *)p->ainsn.insn;/* regs->nip is also adjusted if emulate_step returns 1 */ ret =emulate_step (regs, insn);arch/powerpc/kernel/mce_power.c +2
-1@@ -20,6 +20,7 @@#include <asm/sstep.h> #include <asm/exception-64s.h> #include <asm/extable.h> +#include <asm/inst.h> /* * Convert an address related to an mm to a PFN. NOTE: we are in real @@ -365,7 +366,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs*regs, uint64_t *addr, * in real-mode is tricky and can lead to recursive * faults */ -int instr; +struct ppc_inst instr;unsigned long pfn, instr_addr;struct instruction_op op;arch/powerpc/kernel/mce_power.c +1
-1struct pt_regs tmp = *regs;@@ -373,7 +374,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs *regs, uint64_t *addr, pfn =addr_to_pfn (regs, regs->nip);if (pfn !=ULONG_MAX ) { instr_addr = (pfn <<PAGE_SHIFT ) + (regs->nip & ~PAGE_MASK ); - instr = *(unsigned int *)(instr_addr); + instr = *(struct ppc_inst *)(instr_addr);if (!analyse_instr (&op, &tmp, instr)) { pfn =addr_to_pfn (regs, op.ea);arch/powerpc/kernel/mce_power.c +0
-0*addr = op.ea;arch/powerpc/kernel/optprobes.c +2
-2@@ -100,8 +100,8 @@ static unsigned long can_optimize(struct kprobe *p)* Ensure that the instruction is not a conditional branch, * and that can be emulated. */ -if (!is_conditional_branch (*p->ainsn.insn) && -analyse_instr (&op, ®s, *p->ainsn.insn) ==1 ) { +if (!is_conditional_branch (*(struct ppc_inst *)p->ainsn.insn) && +analyse_instr (&op, ®s, *(struct ppc_inst *)p- >ainsn.insn) == 1) {emulate_update_regs (®s, &op); nip = regs.nip;arch/powerpc/kernel/optprobes.c +1
-1}@@ -148,12 +148,12 @@ void arch_remove_optimized_kprobe(struct optimized_kprobe *op)void patch_imm32_load_insns (unsigned int val,kprobe_opcode_t *addr) {/* addis r4,0,(insn)@h */ - patch_instruction(addr, ppc_inst(PPC_INST_ADDIS | ___PPC_RT(4) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ADDIS |
___PPC_RT(4)|arch/powerpc/kernel/optprobes.c +1
-1((val >> 16) & 0xffff))); addr++;/* ori r4,r4,(insn)@l */ - patch_instruction(addr, ppc_inst(PPC_INST_ORI | ___PPC_RA(4) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(4)|arch/powerpc/kernel/optprobes.c +1
-1___PPC_RS(4) | (val & 0xffff))); }@@ -164,34 +164,34 @@ void patch_imm32_load_insns(unsigned int val, kprobe_opcode_t *addr)void patch_imm64_load_insns (unsigned long val,kprobe_opcode_t *addr) {/* lis r3,(op)@highest */ - patch_instruction(addr, ppc_inst(PPC_INST_ADDIS | ___PPC_RT(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ADDIS |
___PPC_RT(3)|arch/powerpc/kernel/optprobes.c +1
-1((val >> 48) & 0xffff))); addr++;/* ori r3,r3,(op)@higher */ - patch_instruction(addr, ppc_inst(PPC_INST_ORI | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(3)|arch/powerpc/kernel/optprobes.c +1
-1___PPC_RS(3) | ((val >> 32) & 0xffff))); addr++;/* rldicr r3,r3,32,31 */ - patch_instruction(addr, ppc_inst(PPC_INST_RLDICR | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_RLDICR |
___PPC_RA(3)|arch/powerpc/kernel/optprobes.c +1
-1___PPC_RS(3) | __PPC_SH64(32) | __PPC_ME64(31))); addr++;/* oris r3,r3,(op)@h */ - patch_instruction(addr, ppc_inst(PPC_INST_ORIS | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORIS |
___PPC_RA(3)|arch/powerpc/kernel/optprobes.c +1
-1___PPC_RS(3) | ((val >> 16) & 0xffff))); addr++;/* ori r3,r3,(op)@l */ - patch_instruction(addr, ppc_inst(PPC_INST_ORI | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(3)|
___PPC_RS(3)| (val &0xffff)));
}int arch_prepare_optimized_kprobe(struct
optimized_kprobe*op, struct kprobe
*p)
{arch/powerpc/kernel/optprobes.c +3
-3-kprobe_opcode_t *buff, branch_op_callback, branch_emulate_step; -kprobe_opcode_t *op_callback_addr, *emulate_step_addr; +struct ppc_inst branch_op_callback, branch_emulate_step; +kprobe_opcode_t *op_callback_addr, *emulate_step_addr, *buff;long b_offset;unsigned long nip, size;int rc, i;@@ -231,7 +231,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) size = (TMPL_END_IDX *sizeof (kprobe_opcode_t)) /sizeof (int );pr_devel ("Copying template to %p, size %lu\n" , buff, size);for (i =0 ; i < size; i++) { - rc =patch_instruction (buff + i, ppc_inst(*(optprobe_template_entry + i))); + rc =patch_instruction ((struct ppc_inst *)(buff + i),ppc_inst (*(optprobe_template_entry + i)));arch/powerpc/kernel/optprobes.c +4
-4if (rc <0 ) goto error; }@@ -253,20 +253,20 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) } rc =create_branch (&branch_op_callback, - (unsigned int *)buff +TMPL_CALL_HDLR_IDX , + (struct ppc_inst *)(buff +TMPL_CALL_HDLR_IDX ), (unsigned long )op_callback_addr,BRANCH_SET_LINK ); rc |=create_branch (&branch_emulate_step, - (unsigned int *)buff +TMPL_EMULATE_IDX , + (struct ppc_inst *)(buff +TMPL_EMULATE_IDX ), (unsigned long )emulate_step_addr,BRANCH_SET_LINK );if (rc) goto error; -patch_instruction (buff +TMPL_CALL_HDLR_IDX , branch_op_callback); -patch_instruction (buff +TMPL_EMULATE_IDX , branch_emulate_step); +patch_instruction ((struct ppc_inst *)(buff +TMPL_CALL_HDLR_IDX ), branch_op_callback); +patch_instruction ((struct ppc_inst *)(buff +TMPL_EMULATE_IDX ), branch_emulate_step);arch/powerpc/kernel/optprobes.c +0
-0/* * 3. load instruction to be emulated into relevant register, and
arch/powerpc/kernel/optprobes.c int arch_prepare_optimized_kprobe(struct optimized_kprobe · line 280
Quoted 6 lines
arch/powerpc/kernel/optprobes.c +1
-1@@ -276,7 +276,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p)/* * 4. branch back from trampoline */ -patch_branch (buff +TMPL_RET_IDX , (unsigned long )nip,0 ); +patch_branch ((void *)(buff +TMPL_RET_IDX ), (unsigned long )nip,0 );
why do we cast it differently here ?
Quoted 245 lines
arch/powerpc/kernel/optprobes.c +3
-3flush_icache_range ((unsigned long )buff, (unsigned long )(&buff[TMPL_END_IDX ]));@@ -308,7 +308,7 @@ int arch_check_optimized_kprobe(struct optimized_kprobe *op)void arch_optimize_kprobes (struct list_head *oplist) { -unsigned int instr; +struct ppc_inst instr;struct optimized_kprobe *op;struct optimized_kprobe *tmp;@@ -320,9 +320,9 @@ void arch_optimize_kprobes(struct list_head *oplist)memcpy (op->optinsn.copied_insn, op->kp.addr,RELATIVEJUMP_SIZE );create_branch (&instr, - (unsigned int *)op->kp.addr, + (struct ppc_inst *)op->kp.addr, (unsigned long )op->optinsn.insn,0 ); -patch_instruction (op->kp.addr, instr); +patch_instruction ((struct ppc_inst *)op->kp.addr, instr);list_del_init (&op->list); } }arch/powerpc/kernel/setup_32.c +1
-1@@ -76,7 +76,7 @@ EXPORT_SYMBOL(DMA_MODE_WRITE); notrace void __init machine_init(u64 dt_ptr) {unsigned int *addr = (unsigned int *)patch_site_addr (&patch__memset_nocache); -unsigned long insn; +struct ppc_inst insn;/* Configure static keys first, now that we're relocated. */ arch/powerpc/kernel/setup_32.c +0
-0setup_feature_keys ();arch/powerpc/kernel/trace/ftrace.c +5
-5@@ -41,23 +41,23 @@#define NUM_FTRACE_TRAMPS 8static unsigned long ftrace_tramps[NUM_FTRACE_TRAMPS ]; -static unsigned int +static struct ppc_inst ftrace_call_replace (unsigned long ip,unsigned long addr,int link) { -unsigned int op; +struct ppc_inst op; addr =ppc_function_entry ((void *)addr);/* if (link) set op to 'bl' else 'b' */ -create_branch (&op, (unsigned int *)ip, addr, link ?1 :0 ); +create_branch (&op, (struct ppc_inst *)ip, addr, link ?1 :0 );return op; }static int -ftrace_modify_code (unsigned long ip,unsigned int old,unsigned int new) +ftrace_modify_code (unsigned long ip,struct ppc_inst old,struct ppc_inst new) { -unsigned int replaced; +struct ppc_inst replaced;/* arch/powerpc/kernel/trace/ftrace.c +1
-1* Note: @@ -79,7 +79,7 @@ ftrace_modify_code(unsigned long ip, unsigned int old, unsigned int new) }/* replace the text with the new text */ -if (patch_instruction ((unsigned int *)ip, new)) +if (patch_instruction ((struct ppc_inst *)ip, new))return -EPERM ;arch/powerpc/kernel/trace/ftrace.c +14
-13return 0 ;@@ -90,24 +90,24 @@ ftrace_modify_code(unsigned long ip, unsigned int old,unsigned int new) */ static int test_24bit_addr (unsigned long ip,unsigned long addr) { -unsigned int op; +struct ppc_inst op; addr =ppc_function_entry ((void *)addr);/* use the create_branch to verify that this offset can be branched */ -return create_branch (&op, (unsigned int *)ip, addr,0 ) ==0 ; +return create_branch (&op, (struct ppc_inst *)ip, addr,0 ) ==0 ; } -static int is_bl_op (unsigned int op) +static int is_bl_op (struct ppc_inst op) {return (ppc_inst_val (op) &0xfc000003 ) ==0x48000001 ; } -static int is_b_op (unsigned int op) +static int is_b_op (struct ppc_inst op) {return (ppc_inst_val (op) &0xfc000003 ) ==0x48000000 ; } -static unsigned long find_bl_target (unsigned long ip,unsigned int op) +static unsigned long find_bl_target (unsigned long ip,struct ppc_inst op) {int offset;@@ -127,7 +127,7 @@ __ftrace_make_nop(struct module *mod, {unsigned long entry, ptr, tramp;unsigned long ip = rec->ip; -unsigned int op, pop; +struct ppc_inst op, pop;/* read where this goes */ if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) {@@ -207,7 +207,7 @@ __ftrace_make_nop(struct module *mod, }#endif /* CONFIG_MPROFILE_KERNEL */ -if (patch_instruction ((unsigned int *)ip, pop)) { +if (patch_instruction ((struct ppc_inst *)ip, pop)) {pr_err ("Patching NOP failed.\n" );return -EPERM ; }@@ -220,7 +220,7 @@ static int __ftrace_make_nop(struct module *mod, struct dyn_ftrace *rec, unsigned long addr) { - unsigned int op; + struct ppc_inst op;unsigned int jmp[4 ];unsigned long ip = rec->ip;unsigned long tramp;@@ -279,7 +279,7 @@ __ftrace_make_nop(struct module *mod, op =ppc_inst (PPC_INST_NOP ); -if (patch_instruction ((unsigned int *)ip, op)) +if (patch_instruction ((struct ppc_inst *)ip, op))return -EPERM ;return 0 ;@@ -290,7 +290,7 @@ __ftrace_make_nop(struct module *mod,static unsigned long find_ftrace_tramp (unsigned long ip) {int i; -unsigned int instr; +struct ppc_inst instr;/* * We have the compiler generated long_branch tramps at the end @@ -327,9 +327,10 @@ static int add_ftrace_tramp(unsigned long tramp)*/ static int setup_mcount_compiler_tramp (unsigned long tramp) { -int i, op; +int i; +struct ppc_inst op;unsigned long ptr; -unsigned int instr; +struct ppc_inst instr;static unsigned long ftrace_plt_tramps[NUM_FTRACE_TRAMPS ];/* Is this a known long jump tramp? */ @@ -378,7 +379,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)return -1 ; } -if (patch_branch ((unsigned int *)tramp, ptr,0 )) { +if (patch_branch ((struct ppc_inst *)tramp, ptr,0 )) {pr_debug ("REL24 out of range!\n" );return -1 ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -394,7 +395,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp) static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr) {unsigned long tramp, ip = rec->ip; -unsigned int op; +struct ppc_inst op;arch/powerpc/kernel/trace/ftrace.c +1
-1/* Read where this goes */ if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) {@@ -422,7 +423,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr) } } -if (patch_instruction ((unsigned int *)ip,ppc_inst (PPC_INST_NOP ))) { +if (patch_instruction ((struct ppc_inst *)ip,ppc_inst (PPC_INST_NOP ))) {pr_err ("Patching NOP failed.\n" );return -EPERM ;arch/powerpc/kernel/trace/ftrace.c +3
-3}@@ -434,7 +435,7 @@ int ftrace_make_nop(struct module *mod, struct dyn_ftrace *rec, unsigned long addr) {unsigned long ip = rec->ip; -unsigned int old, new; +struct ppc_inst old, new;/* * If the calling address is more that 24 bits away, @@ -487,7 +488,7 @@ int ftrace_make_nop(struct module *mod,*/ #ifndef CONFIG_MPROFILE_KERNEL static int -expected_nop_sequence (void *ip,unsigned int op0,unsigned int op1) +expected_nop_sequence (void *ip,struct ppc_inst op0,struct ppc_inst op1) {/* * We expect to see: @@ -504,7 +505,7 @@ expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1) }#else static int -expected_nop_sequence (void *ip,unsigned int op0,unsigned int op1) +expected_nop_sequence (void *ip,struct ppc_inst op0,struct ppc_inst op1) {/* look for patched "NOP" on ppc64 with -mprofile-kernel */ arch/powerpc/kernel/trace/ftrace.c +2
-2if (!ppc_inst_equal (op0,ppc_inst (PPC_INST_NOP )))@@ -516,8 +517,8 @@ expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1)static int __ftrace_make_call (struct dyn_ftrace *rec,unsigned long addr) { -unsigned int op[2 ]; -unsigned int instr; +struct ppc_inst op[2 ]; +struct ppc_inst instr;void *ip = (void *)rec->ip;unsigned long entry, ptr, tramp;arch/powerpc/kernel/trace/ftrace.c +0
-0struct module *mod = rec->arch.mod;
arch/powerpc/kernel/trace/ftrace.c __ftrace_make_call(struct dyn_ftrace *rec, unsigned long · line 533
Quoted 6 lines
arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -528,7 +529,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)if (!expected_nop_sequence (ip, op[0 ], op[1 ])) {pr_err ("Unexpected call sequence at %p: %x %x\n" , - ip, op[0 ], op[1 ]); + ip,ppc_inst_val (op[0 ]),ppc_inst_val (op[1 ]));
shouldn't this change be part of patch 6,
[PATCH v5 06/21] powerpc: Use an accessor for instructions
Quoted 137 lines
arch/powerpc/kernel/trace/ftrace.c +2
-2return -EINVAL ; }@@ -582,7 +583,7 @@ static int __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) { int err; -unsigned int op; +struct ppc_inst op;unsigned long ip = rec->ip;/* read where this goes */ @@ -602,7 +603,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }/* create the branch to the trampoline */ - err =create_branch (&op, (unsigned int *)ip, + err =create_branch (&op, (struct ppc_inst *)ip, rec->arch.mod->arch.tramp,BRANCH_SET_LINK );if (!err) {arch/powerpc/kernel/trace/ftrace.c +1
-1pr_err ("REL24 out of range!\n" );@@ -621,7 +622,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr) { -unsigned int op; +struct ppc_inst op;void *ip = (void *)rec->ip;arch/powerpc/kernel/trace/ftrace.c +1
-1unsigned long tramp, entry, ptr;@@ -669,7 +670,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr)int ftrace_make_call (struct dyn_ftrace *rec,unsigned long addr) {unsigned long ip = rec->ip; -unsigned int old, new; +struct ppc_inst old, new;/* arch/powerpc/kernel/trace/ftrace.c +2
-2* If the calling address is more that 24 bits away, @@ -708,7 +709,7 @@ static int __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, unsigned long addr) { - unsigned int op; + struct ppc_inst op;unsigned long ip = rec->ip;unsigned long entry, ptr, tramp;struct module *mod = rec->arch.mod;@@ -756,7 +757,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, /* The new target may be within range */ if (test_24bit_addr(ip, addr)) { /* within range */ - if (patch_branch((unsigned int *)ip, addr, BRANCH_SET_LINK)) { + if (patch_branch((struct ppc_inst *)ip, addr, BRANCH_SET_LINK)) {pr_err ("REL24 out of range!\n" );arch/powerpc/kernel/trace/ftrace.c +2
-2return -EINVAL ; }@@ -784,12 +785,12 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* Ensure branch is within 24 bits */ -if (create_branch (&op, (unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&op, (struct ppc_inst *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ; } -if (patch_branch ((unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (patch_branch ((struct ppc_inst *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("REL24 out of range!\n" );arch/powerpc/kernel/trace/ftrace.c +1
-1return -EINVAL ; }@@ -802,7 +803,7 @@ int ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, unsigned long addr) {unsigned long ip = rec->ip; -unsigned int old, new; +struct ppc_inst old, new;/* arch/powerpc/kernel/trace/ftrace.c +5
-5* If the calling address is more that 24 bits away, @@ -842,10 +843,10 @@ int ftrace_modify_call(struct dyn_ftrace *rec, unsignedlong old_addr, int ftrace_update_ftrace_func(ftrace_func_t func) { unsigned long ip = (unsigned long)(&ftrace_call); -unsigned int old, new; +struct ppc_inst old, new;int ret; - old = *(unsigned int *)&ftrace_call; + old = *(struct ppc_inst *)&ftrace_call; new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new);@@ -853,7 +854,7 @@ int ftrace_update_ftrace_func(ftrace_func_t func)/* Also update the regs callback function */ if (!ret) { ip = (unsigned long )(&ftrace_regs_call); - old = *(unsigned int *)&ftrace_regs_call; + old = *(struct ppc_inst *)&ftrace_regs_call; new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new); }@@ -927,7 +928,7 @@ int ftrace_enable_ftrace_graph_caller(void)unsigned long ip = (unsigned long )(&ftrace_graph_call);unsigned long addr = (unsigned long )(&ftrace_graph_caller);unsigned long stub = (unsigned long )(&ftrace_graph_stub); -unsigned int old, new; +struct ppc_inst old, new; old =ftrace_call_replace (ip, stub,0 ); new =ftrace_call_replace (ip, addr,0 );@@ -940,7 +941,7 @@ int ftrace_disable_ftrace_graph_caller(void)unsigned long ip = (unsigned long )(&ftrace_graph_call);unsigned long addr = (unsigned long )(&ftrace_graph_caller);unsigned long stub = (unsigned long )(&ftrace_graph_stub); -unsigned int old, new; +struct ppc_inst old, new; old =ftrace_call_replace (ip, addr,0 ); new =ftrace_call_replace (ip, stub,0 );arch/powerpc/kernel/vecemu.c +0
-0@@ -261,11 +261,12 @@ static unsigned int rfin(unsigned int x)
arch/powerpc/kernel/vecemu.c static unsigned int rfin(unsigned int x) · line 269
Quoted 10 lines
arch/powerpc/kernel/vecemu.c +3
-2int emulate_altivec (struct pt_regs *regs) { -unsigned int instr, i, word; +struct ppc_inst instr; +unsigned int i, word;unsigned int va, vb, vc, vd;vector128 *vrs; -if (get_user (instr, (unsigned int __user *) regs->nip)) +if (get_user (instr.val, (unsigned int __user *) regs->nip))
[...] reference to above for using helper.
Quoted 315 lines
arch/powerpc/kernel/vecemu.c +0
-0return -EFAULT ; word =ppc_inst_val (instr);arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index33654c6334a9..91be4a0b51cb100644arch/powerpc/lib/code-patching.c +4
-4@@ -19,12 +19,12 @@#include <asm/setup.h> #include <asm/inst.h> -static int __patch_instruction (unsigned int *exec_addr,unsigned int instr, -unsigned int *patch_addr) +static int __patch_instruction (struct ppc_inst *exec_addr,struct ppc_inst instr, +struct ppc_inst *patch_addr) {int err =0 ; -__put_user_asm (instr, patch_addr, err,"stw" ); +__put_user_asm (ppc_inst_val (instr), patch_addr, err,"stw" );if (err)return err;@@ -34,7 +34,7 @@ static int __patch_instruction(unsigned int *exec_addr,unsigned int instr, return 0; } -int raw_patch_instruction (unsigned int *addr,unsigned int instr) +int raw_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {return __patch_instruction (addr, instr, addr);}
arch/powerpc/lib/code-patching.c +2
-2@@ -137,10 +137,10 @@ static inline int unmap_patch_area(unsigned long addr)return 0 ; } -static int do_patch_instruction (unsigned int *addr,unsigned int instr) +static int do_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {int err; -unsigned int *patch_addr =NULL ; +struct ppc_inst *patch_addr =NULL ;unsigned long flags;unsigned long text_poke_addr;arch/powerpc/lib/code-patching.c +2
-2unsigned long kaddr = (unsigned long )addr;@@ -177,14 +177,14 @@ static int do_patch_instruction(unsigned int *addr, unsigned int instr) }#else /* !CONFIG_STRICT_KERNEL_RWX */ -static int do_patch_instruction (unsigned int *addr,unsigned int instr) +static int do_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {return raw_patch_instruction (addr, instr); }#endif /* CONFIG_STRICT_KERNEL_RWX */ -int patch_instruction (unsigned int *addr,unsigned int instr) +int patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {arch/powerpc/lib/code-patching.c +2
-2/* Make sure we aren't patching a freed init section */ if (init_mem_is_free &&init_section_contains (addr,4 )) {@@ -195,9 +195,9 @@ int patch_instruction(unsigned int *addr, unsigned int instr) }NOKPROBE_SYMBOL (patch_instruction); -int patch_branch (unsigned int *addr,unsigned long target,int flags) +int patch_branch (struct ppc_inst *addr,unsigned long target,int flags) { -unsigned int instr; +struct ppc_inst instr;create_branch (&instr, addr, target, flags);arch/powerpc/lib/code-patching.c +11
-11return patch_instruction (addr, instr);@@ -229,7 +229,7 @@ bool is_offset_in_branch_range(long offset)* Helper to check if a given instruction is a conditional branch * Derived from the conditional checks in analyse_instr() */ -bool is_conditional_branch (unsigned int instr) +bool is_conditional_branch (struct ppc_inst instr) {unsigned int opcode =ppc_inst_opcode (instr);@@ -247,13 +247,13 @@ bool is_conditional_branch(unsigned int instr) }NOKPROBE_SYMBOL (is_conditional_branch); -int create_branch (unsigned int *instr, -const unsigned int *addr, +int create_branch (struct ppc_inst *instr, +const struct ppc_inst *addr,unsigned long target,int flags) {long offset; - *instr =0 ; + *instr =ppc_inst (0 ); offset = target;if (! (flags &BRANCH_ABSOLUTE )) offset = offset - (unsigned long )addr;@@ -263,12 +263,12 @@ int create_branch(unsigned int *instr,return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - *instr =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); + *instr =ppc_inst (0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ));return 0 ; } -int create_cond_branch (unsigned int *instr,const unsigned int *addr, +int create_cond_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags) {long offset;@@ -282,27 +282,27 @@ int create_cond_branch(unsigned int *instr, constunsigned int *addr, return 1;/* Mask out the flags and target, so they don't step on each other. */ - *instr =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); + *instr =ppc_inst (0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ));return 0 ; } -static unsigned int branch_opcode (unsigned int instr) +static unsigned int branch_opcode (struct ppc_inst instr) {return ppc_inst_opcode (instr) &0x3F ; } -static int instr_is_branch_iform (unsigned int instr) +static int instr_is_branch_iform (struct ppc_inst instr) {return branch_opcode (instr) ==18 ; } -static int instr_is_branch_bform (unsigned int instr) +static int instr_is_branch_bform (struct ppc_inst instr) {return branch_opcode (instr) ==16 ; } -int instr_is_relative_branch (unsigned int instr) +int instr_is_relative_branch (struct ppc_inst instr) {arch/powerpc/lib/code-patching.c +4
-4if (ppc_inst_val (instr) &BRANCH_ABSOLUTE )return 0 ;@@ -310,12 +310,12 @@ int instr_is_relative_branch(unsigned int instr)return instr_is_branch_iform (instr) ||instr_is_branch_bform (instr); } -int instr_is_relative_link_branch (unsigned int instr) +int instr_is_relative_link_branch (struct ppc_inst instr) {return instr_is_relative_branch (instr) && (ppc_inst_val (instr) &BRANCH_SET_LINK ); } -static unsigned long branch_iform_target (const unsigned int *instr) +static unsigned long branch_iform_target (const struct ppc_inst *instr) {signed long imm;@@ -331,7 +331,7 @@ static unsigned long branch_iform_target(const unsigned int *instr)return (unsigned long )imm; } -static unsigned long branch_bform_target (const unsigned int *instr) +static unsigned long branch_bform_target (const struct ppc_inst *instr) {signed long imm;@@ -347,7 +347,7 @@ static unsigned long branch_bform_target(const unsigned int *instr)return (unsigned long )imm; } -unsigned long branch_target (const unsigned int *instr) +unsigned long branch_target (const struct ppc_inst *instr) {if (instr_is_branch_iform (*instr))arch/powerpc/lib/code-patching.c +1
-1return branch_iform_target (instr);@@ -357,7 +357,7 @@ unsigned long branch_target(const unsigned int *instr)return 0 ; } -int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr) +int instr_is_branch_to_addr (const struct ppc_inst *instr,unsigned long addr) {if (instr_is_branch_iform (*instr) ||instr_is_branch_bform (*instr))arch/powerpc/lib/code-patching.c +1
-1return branch_target (instr) == addr;@@ -365,7 +365,7 @@ int instr_is_branch_to_addr(const unsigned int *instr, unsigned long addr)return 0 ; } -int translate_branch(unsigned int *instr, const unsigned int *dest, const unsigned int *src) +int translate_branch (struct ppc_inst *instr,const struct ppc_inst *dest,const struct ppc_inst *src){
arch/powerpc/lib/code-patching.c +8
-7unsigned long target;@@ -408,7 +408,7 @@ static void __init test_trampoline(void)static void __init test_branch_iform (void ) {int err; -unsigned int instr; +struct ppc_inst instr;unsigned long addr; addr = (unsigned long )&instr;@@ -483,12 +483,12 @@ static void __init test_branch_iform(void)static void __init test_create_function_call (void ) { -unsigned int *iptr; +struct ppc_inst *iptr;unsigned long dest; -unsigned int instr; +struct ppc_inst instr;/* Check we can create a function call */ - iptr = (unsigned int *)ppc_function_entry (test_trampoline); + iptr = (struct ppc_inst *)ppc_function_entry (test_trampoline); dest =ppc_function_entry (test_create_function_call);create_branch (&instr, iptr, dest,BRANCH_SET_LINK );patch_instruction (iptr, instr);@@ -499,7 +499,8 @@ static void __init test_branch_bform(void) {int err;unsigned long addr; -unsigned int *iptr, instr, flags; +struct ppc_inst *iptr, instr; +unsigned int flags; iptr = &instr; addr = (unsigned long )iptr;@@ -569,8 +570,8 @@ static void __init test_branch_bform(void)static void __init test_translate_branch (void ) {unsigned long addr; -unsigned int *p, *q; -unsigned int instr; +struct ppc_inst *p, *q; +struct ppc_inst instr;void *buf; buf =vmalloc (PAGE_ALIGN (0x2000000 +1 ));arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
index6e7479b8887a..8c5d0db77013100644arch/powerpc/lib/feature-fixups.c +6
-6@@ -32,26 +32,26 @@ struct fixup_entry {long alt_end_off; }; -static unsigned int *calc_addr (struct fixup_entry *fcur,long offset) +static struct ppc_inst *calc_addr (struct fixup_entry *fcur,long offset) {/* * We store the offset to the code as a negative offset from * the start of the alt_entry, to support the VDSO. This * routine converts that back into an actual address. */ -return (unsigned int *)((unsigned long )fcur + offset); +return (struct ppc_inst *)((unsigned long )fcur + offset); } -static int patch_alt_instruction (unsigned int *src,unsigned int *dest, -unsigned int *alt_start,unsigned int *alt_end) +static int patch_alt_instruction (struct ppc_inst *src,struct ppc_inst *dest, +struct ppc_inst *alt_start,struct ppc_inst *alt_end) {int err; -unsigned int instr; +struct ppc_inst instr; instr = *src;if (instr_is_relative_branch (*src)) { -unsigned int *target = (unsigned int *)branch_target (src); + struct ppc_inst *target = (struct ppc_inst*)branch_target(src);
arch/powerpc/lib/feature-fixups.c +1
-1/* Branch within the section doesn't need translating */ if (target < alt_start || target > alt_end) {@@ -68,7 +68,7 @@ static int patch_alt_instruction(unsigned int *src,unsigned int *dest, static int patch_feature_section(unsigned long value, struct fixup_entry *fcur) { - unsigned int *start, *end, *alt_start, *alt_end, *src, *dest; + struct ppc_inst *start, *end, *alt_start, *alt_end, *src, *dest;arch/powerpc/lib/feature-fixups.c +0
-0start =calc_addr (fcur, fcur->start_off); end =calc_addr (fcur, fcur->end_off);
arch/powerpc/lib/feature-fixups.c static void do_stf_entry_barrier_fixups(enum · line 152
Quoted 7 lines
arch/powerpc/lib/feature-fixups.c +1
-1@@ -147,15 +147,15 @@ static void do_stf_entry_barrier_fixups(enum stf_barrier_type types) pr_devel("patching dest %lx\n", (unsigned long)dest); -patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instrs[0 ]));
we had already declared them as struct ppc_inst *
Quoted 100 lines
arch/powerpc/lib/feature-fixups.c +3
-3if (types &STF_BARRIER_FALLBACK ) -patch_branch (dest +1 , (unsigned long)&stf_barrier_fallback, +patch_branch ((struct ppc_inst *)(dest +1 ), (unsigned long )&stf_barrier_fallback,BRANCH_SET_LINK );else -patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instrs[1 ])); -patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); + patch_instruction((struct ppc_inst *)(dest + 2),
ppc_inst(instrs[2]));arch/powerpc/lib/feature-fixups.c +0
-0} printk(KERN_DEBUG "stf-barrier: patched %d entry locations (%sbarrier)\n", i,
arch/powerpc/lib/feature-fixups.c +3
-6@@ -208,12 +208,12 @@ static void do_stf_exit_barrier_fixups(enum stf_barrier_type types) pr_devel("patching dest %lx\n", (unsigned long)dest); -patch_instruction (dest,ppc_inst (instrs[0 ])); -patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); -patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); -patch_instruction (dest +3 ,ppc_inst (instrs[3 ])); -patch_instruction (dest +4 ,ppc_inst (instrs[4 ])); -patch_instruction (dest +5 ,ppc_inst (instrs[5 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instrs[0 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instrs[1 ])); + patch_instruction((struct ppc_inst *)(dest + 2),
ppc_inst(instrs[2]));arch/powerpc/lib/feature-fixups.c +1
-0+ patch_instruction((struct ppc_inst *)(dest + 3),
ppc_inst(instrs[3]));arch/powerpc/lib/feature-fixups.c +1
-0+ patch_instruction((struct ppc_inst *)(dest + 4),
ppc_inst(instrs[4]));arch/powerpc/lib/feature-fixups.c +1
-0+ patch_instruction((struct ppc_inst *)(dest + 5),
ppc_inst(instrs[5]));arch/powerpc/lib/feature-fixups.c +0
-0} printk(KERN_DEBUG "stf-barrier: patched %d exit locations (%sbarrier)\n", i,
arch/powerpc/lib/feature-fixups.c +3
-3(types == STF_BARRIER_NONE) ? "no" :@@ -261,9 +261,9 @@ void do_rfi_flush_fixups(enum l1d_flush_type types)pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest,ppc_inst (instrs[0 ])); -patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); -patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instrs[0 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instrs[1 ])); +patch_instruction ((struct ppc_inst *)(dest +2 ),ppc_inst (instrs[2 ]));arch/powerpc/lib/feature-fixups.c +1
-1} printk(KERN_DEBUG "rfi-flush: patched %d locations (%s flush)\n", i,@@ -296,7 +296,7 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest,ppc_inst (instr)); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instr)); }arch/powerpc/lib/feature-fixups.c +2
-2printk (KERN_DEBUG "barrier-nospec: patched %d locations\n" , i);@@ -339,8 +339,8 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest,ppc_inst (instr[0 ])); -patch_instruction (dest +1 ,ppc_inst (instr[1 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instr[0 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instr[1 ])); }arch/powerpc/lib/feature-fixups.c +1
-1printk (KERN_DEBUG "barrier-nospec: patched %d locations\n" , i);@@ -373,7 +373,7 @@ void do_btb_flush_fixups(void)void do_lwsync_fixups (unsigned long value,void *fixup_start,void *fixup_end) {long *start, *end; -unsigned int *dest; +struct ppc_inst *dest;if (!(value &CPU_FTR_LWSYNC ))arch/powerpc/lib/feature-fixups.c +0
-0return ;arch/powerpc/lib/sstep.c +0
-0
arch/powerpc/lib/sstep.c static nokprobe_inline int trap_compare(long v1, long · line 1167
Quoted 6 lines
arch/powerpc/lib/sstep.c +1
-1@@ -1163,7 +1163,7 @@ static nokprobe_inline int trap_compare(long v1, longv2) * otherwise. */ int analyse_instr (struct instruction_op *op,const struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr)
we need to take care of instr inside this function as well to adopt the helpers to work with it.
-- Bala
Quoted 179 lines
arch/powerpc/lib/sstep.c +0
-0{unsigned int opcode, ra, rb, rc, rd, spr, u;arch/powerpc/lib/sstep.c +1
-1unsigned long int imm;@@ -3103,7 +3103,7 @@ NOKPROBE_SYMBOL(emulate_loadstore);* or -1 if the instruction is one that should not be stepped, * such as an rfid, or a mtmsrd that would clear MSR_RI. */ -int emulate_step (struct pt_regs *regs,unsigned int instr) +int emulate_step (struct pt_regs *regs,struct ppc_inst instr) {struct instruction_op op;int r, err, type;arch/powerpc/lib/test_emulate_step.c +3
-3@@ -461,7 +461,7 @@ struct compute_test {struct {char *descr;unsigned long flags; -unsigned int instr; +struct ppc_inst instr;struct pt_regs regs; } subtests[MAX_SUBTESTS +1 ]; };@@ -842,7 +842,7 @@ static struct compute_test compute_tests[] = { };static int __init emulate_compute_instr (struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr) {struct instruction_op op;@@ -860,7 +860,7 @@ static int __init emulate_compute_instr(struct pt_regs *regs, }static int __init execute_compute_instr (struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr) {extern int exec_instr (struct pt_regs *regs);arch/powerpc/lib/test_emulate_step.c +2
-1extern s32 patch__exec_instr;@@ -891,7 +891,8 @@ static void __init run_tests_compute(void)unsigned long flags;struct compute_test *test;struct pt_regs *regs, exp, got; -unsigned int i, j, k, instr; +unsigned int i, j, k; +struct ppc_inst instr;bool ignore_gpr, ignore_xer, ignore_ccr, passed;for (i =0 ; i <ARRAY_SIZE (compute_tests); i++) {arch/powerpc/perf/core- renamed from arch/powerpc/perf/core-book3s.c +0
-0
book3s.c
index3086055bf681..2d2580a4bfb5100644arch/powerpc/perf/core-book3s.c +2
-2@@ -421,14 +421,14 @@ static __u64 power_pmu_bhrb_to(u64 addr)if (probe_kernel_read (&instr, (void *)addr,sizeof (instr)))return 0 ; -return branch_target (&instr); +return branch_target ((struct ppc_inst *)&instr); }/* Userspace: need copy instruction here then translate it */ if (probe_user_read (&instr, (unsigned int __user *)addr,sizeof (instr)))return 0 ; - target =branch_target (&instr); + target =branch_target ((struct ppc_inst *)&instr);if ((!target) || (instr &BRANCH_ABSOLUTE ))return target;arch/powerpc/xmon/xmon.c +4
-4@@ -99,7 +99,7 @@ static long *xmon_fault_jmp[NR_CPUS];/* Breakpoint stuff */ struct bpt {unsigned long address; -unsigned int *instr; +struct ppc_inst *instr;atomic_t ref_count;int enabled;unsigned long pad;@@ -117,7 +117,7 @@ static unsigned bpinstr = 0x7fe00008; /* trap */#define BP_NUM (bp) ((bp) - bpts + 1) -#define BPT_SIZE (sizeof(unsigned int) * 2) +#define BPT_SIZE (sizeof(struct ppc_inst) * 2)#define BPT_WORDS (BPT_SIZE / sizeof(unsigned int))extern unsigned int bpt_table[NBPTS *BPT_WORDS ];@@ -879,8 +879,8 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; - bp->instr = bpt_table + ((bp - bpts) *BPT_WORDS ); -patch_instruction (bp->instr +1 , bpinstr); + bp->instr = (void *)(bpt_table + ((bp - bpts) *BPT_WORDS )); +patch_instruction (bp->instr +1 ,ppc_inst (bpinstr));return bp; }arch/powerpc/xmon/xmon.c +3
-3}@@ -892,7 +892,7 @@ static struct bpt *new_breakpoint(unsigned long a)static void insert_bpts (void ) {int i; -unsigned int instr; +struct ppc_inst instr;struct bpt *bp; bp = bpts;@@ -914,8 +914,8 @@ static void insert_bpts(void)patch_instruction (bp->instr, instr);if (bp->enabled &BP_CIABR )continue ; -if (patch_instruction ((unsigned int *)bp->address, - bpinstr) !=0 ) { +if (patch_instruction ((struct ppc_inst *)bp->address, +ppc_inst (bpinstr)) !=0 ) {printf ("Couldn't write instruction at %lx, " "disabling breakpoint there\n" , bp->address);arch/powerpc/xmon/xmon.c +5
-5bp->enabled &= ~BP_TRAP ;@@ -943,7 +943,7 @@ static void remove_bpts(void) {int i;struct bpt *bp; -unsigned instr; +struct ppc_inst instr; bp = bpts;for (i =0 ; i <NBPTS ; ++i, ++bp) {@@ -952,7 +952,7 @@ static void remove_bpts(void)if (mread (bp->address, &instr,4 ) ==4 &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( - (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) + (struct ppc_inst *)bp->address, bp->instr[0 ]) !=0 )printf ("Couldn't remove breakpoint at %lx\n" , bp->address); }@@ -1159,7 +1159,7 @@ static int do_step(struct pt_regs *regs)*/ static int do_step (struct pt_regs *regs) { -unsigned int instr; +struct ppc_inst instr;int stepped;force_enable_xmon ();@@ -1325,7 +1325,7 @@ csum(void)*/ static long check_bp_loc (unsigned long addr) { -unsigned int instr; +struct ppc_inst instr; addr &= ~3 ;if (!is_kernel_addr (addr)) {@@ -2846,7 +2846,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, {int nr, dotted;unsigned long first_adr; -unsigned int inst, last_inst =ppc_inst (0 ); +struct ppc_inst inst, last_inst =ppc_inst (0 );unsigned char val[4 ];dotted = 0;
Re: [PATCH v5 09/21] powerpc: Use a datatype for instructions
Quoted 245 lines · Balamuruhan S
Quoted 243 lines · Jordan Niethe
Currently unsigned ints are used to represent instructions on powerpc. This has worked well as instructions have always been 4 byte words. However, a future ISA version will introduce some changes to instructions that mean this scheme will no longer work as well. This change is Prefixed Instructions. A prefixed instruction is made up of a word prefix followed by a word suffix to make an 8 byte double word instruction. No matter the endianess of the system the prefix always comes first. Prefixed instructions are only planned for powerpc64.
Introduce a
ppc_insttype to represent both prefixed and word instructions on powerpc64 while keeping it possible to exclusively have word instructions on powerpc32, A latter patch will expand the type to include prefixed instructions but for now just typedef it to a u32.Later patches will introduce helper functions and macros for manipulating the instructions so that powerpc64 and powerpc32 might maintain separate type definitions.
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: Add toepapr_paravirt.c,kgdb.c--- arch/powerpc/include/asm/code-patching.h | 32 ++++----- arch/powerpc/include/asm/inst.h | 20 +++--- arch/powerpc/include/asm/sstep.h | 5 +- arch/powerpc/include/asm/uprobes.h | 5 +- arch/powerpc/kernel/align.c | 4 +- arch/powerpc/kernel/epapr_paravirt.c | 4 +- arch/powerpc/kernel/hw_breakpoint.c | 4 +- arch/powerpc/kernel/jump_label.c | 2 +- arch/powerpc/kernel/kgdb.c | 4 +- arch/powerpc/kernel/kprobes.c | 8 +-- arch/powerpc/kernel/mce_power.c | 5 +- arch/powerpc/kernel/optprobes.c | 40 ++++++------ arch/powerpc/kernel/setup_32.c | 2 +- arch/powerpc/kernel/trace/ftrace.c | 83 ++++++++++++------------ arch/powerpc/kernel/vecemu.c | 5 +- arch/powerpc/lib/code-patching.c | 69 ++++++++++---------- arch/powerpc/lib/feature-fixups.c | 48 +++++++------- arch/powerpc/lib/sstep.c | 4 +- arch/powerpc/lib/test_emulate_step.c | 9 +-- arch/powerpc/perf/core-book3s.c | 4 +- arch/powerpc/xmon/xmon.c | 24 +++---- 21 files changed, 196 insertions(+), 185 deletions(-)arch/powerpc/include/asm/code-patching.h +9
-9@@ -23,33 +23,33 @@#define BRANCH_ABSOLUTE 0x2bool is_offset_in_branch_range (long offset); -int create_branch (unsigned int *instr,const unsigned int *addr, +int create_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags); -int create_cond_branch (unsigned int *instr,const unsigned int *addr, +int create_cond_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags); -int patch_branch (unsigned int *addr,unsigned long target,int flags); -int patch_instruction (unsigned int *addr,unsigned int instr); -int raw_patch_instruction (unsigned int *addr,unsigned int instr); +int patch_branch (struct ppc_inst *addr,unsigned long target,int flags); +int patch_instruction (struct ppc_inst *addr,struct ppc_inst instr); +int raw_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr);static inline unsigned long patch_site_addr (s32 *site) {return (unsigned long )site + *site; } -static inline int patch_instruction_site (s32 *site,unsigned int instr) +static inline int patch_instruction_site (s32 *site,struct ppc_inst instr) { -return patch_instruction ((unsigned int *)patch_site_addr (site), instr); +return patch_instruction ((struct ppc_inst *)patch_site_addr (site), instr); }static inline int patch_branch_site (s32 *site,unsigned long target,int flags) { -return patch_branch ((unsigned int *)patch_site_addr (site), target, flags); +return patch_branch ((struct ppc_inst *)patch_site_addr (site), target, flags); }static inline int modify_instruction (unsigned int *addr,unsigned int clr,unsigned int set) { -return patch_instruction (addr,ppc_inst ((*addr & ~clr) | set)); + return patch_instruction((struct ppc_inst *)addr, ppc_inst((*addr &~clr) | set));
}static inline int modify_instruction_site(s32 *site, unsigned int clr,
unsigned int set)arch/powerpc/include/asm/code-patching.h +0
-0@@ -57,13 +57,13 @@ static inline int modify_instruction_site(s32 *site,unsigned int clr, unsigned
return modify_instruction((unsigned int *)patch_site_addr(site), clr,
set);
}arch/powerpc/include/asm/code-patching.h +3
-7-int instr_is_relative_branch (unsigned int instr); -int instr_is_relative_link_branch (unsigned int instr); -int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr); -unsigned long branch_target (const unsigned int *instr); -int translate_branch (unsigned int *instr,const unsigned int *dest, -const unsigned int *src); -extern bool is_conditional_branch (unsigned int instr); +int instr_is_relative_branch (struct ppc_inst instr); +int instr_is_relative_link_branch (struct ppc_inst instr); +int instr_is_branch_to_addr(const struct ppc_inst *instr, unsigned longaddr);
arch/powerpc/include/asm/code-patching.h +4
-0+unsigned long branch_target (const struct ppc_inst *instr); +int translate_branch (struct ppc_inst *instr,const struct ppc_inst *dest, +const struct ppc_inst *src); +extern bool is_conditional_branch (struct ppc_inst instr);#ifdef CONFIG_PPC_BOOK3E_64 void __patch_exception (int exc,unsigned long addr);#define patch_exception (exc, name) do { \arch/powerpc/include/asm/inst.h +12
-8@@ -6,26 +6,30 @@* Instruction data type for POWER */ -#define ppc_inst (x) (x) +struct ppc_inst { +u32 val; +} __packed; -static inline u32 ppc_inst_val (u32 x) +#define ppc_inst (x) ((struct ppc_inst){ .val = x }) + +static inline u32 ppc_inst_val (struct ppc_inst x) { -return x; +return x.val; } -static inline int ppc_inst_opcode (u32 x) +static inline int ppc_inst_opcode (struct ppc_inst x) { -return x >>26 ; +return x.val >>26 ; } -static inline u32 ppc_inst_swab (u32 x) +static inline struct ppc_inst ppc_inst_swab (struct ppc_inst x) {return ppc_inst (swab32 (ppc_inst_val (x))); } -static inline bool ppc_inst_equal (u32 x,u32 y) +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) { -return x == y; +return !memcmp (&x, &y,sizeof (struct ppc_inst )); }#endif /* _ASM_INST_H */ arch/powerpc/include/asm/sstep.h +2
-1@@ -2,6 +2,7 @@/* * Copyright (C) 2004 Paul Mackerras <[email protected]>, IBM */ +#include <asm/inst.h> struct pt_regs ;@@ -132,7 +133,7 @@ union vsx_reg {* otherwise. */ extern int analyse_instr (struct instruction_op *op,const struct pt_regs *regs, -unsigned int instr); +struct ppc_inst instr);/* * Emulate an instruction that can be executed just by updating
arch/powerpc/include/asm/sstep.h +1
-1@@ -149,7 +150,7 @@ void emulate_update_regs(struct pt_regs *reg, structinstruction_op *op); * 0 if it could not be emulated, or -1 for an instruction that * should not be emulated (rfid, mtmsrd clearing MSR_RI, etc.). */ -extern int emulate_step (struct pt_regs *regs,unsigned int instr); +extern int emulate_step (struct pt_regs *regs,struct ppc_inst instr);/* * Emulate a load or store instruction by reading/writing the
arch/powerpc/include/asm/uprobes.h +3
-2@@ -11,6 +11,7 @@#include <linux/notifier.h> #include <asm/probes.h> +#include <asm/inst.h> typedef ppc_opcode_t uprobe_opcode_t ;@@ -23,8 +24,8 @@ typedef ppc_opcode_t uprobe_opcode_t;struct arch_uprobe {union { -u32 insn; -u32 ixol; +struct ppc_inst insn; +struct ppc_inst ixol; }; };arch/powerpc/kernel/align.c +1
-1@@ -294,7 +294,7 @@ static int emulate_spe(struct pt_regs *regs, unsigned int reg, int fix_alignment(struct pt_regs *regs) { -unsigned int instr; +struct ppc_inst instr;struct instruction_op op;int r, type;@@ -304,7 +304,7 @@ int fix_alignment(struct pt_regs *regs)*/ CHECK_FULL_REGS (regs);
Quoted 5 lines
arch/powerpc/kernel/align.c int fix_alignment(struct pt_regs *regs) · line 307
Quoted 2 lines
arch/powerpc/kernel/align.c +1
-1-if (unlikely (__get_user (instr, (unsigned int __user *)regs->nip))) +if (unlikely (__get_user (instr.val, (unsigned int __user *)regs->nip)))don't we have to use the helper
ppc_inst_val()here to retrieve instr.val ?
__get_user() is loading into instr.val, so using ppc_inst_val() would not work.
Quoted 3 lines
I see couple of other places we directly retrieve as instr.val. if we need to change it, then all of them should go to patch 6,
Those other places also are for the __get_user() macros I think.
Quoted 283 lines
[PATCH v5 06/21] powerpc: Use an accessor for instructions
Quoted 31 lines
arch/powerpc/kernel/align.c +0
-0return -EFAULT ;if ((regs->msr &MSR_LE ) != (MSR_KERNEL &MSR_LE )) {/* We don't handle PPC little-endian any more... */ arch/powerpc/kernel/epapr_paravirt.c +2
-2@@ -38,9 +38,9 @@ static int __init early_init_dt_scan_epapr(unsigned long node, for (i = 0; i < (len / 4); i++) {u32 inst =be32_to_cpu (insts[i]); -patch_instruction (epapr_hypercall_start + i,ppc_inst (inst)); +patch_instruction ((struct ppc_inst *)(epapr_hypercall_start + i),ppc_inst (inst));#if !defined(CONFIG_64BIT ) || defined(CONFIG_PPC_BOOK3E_64 ) -patch_instruction (epapr_ev_idle_start + i,ppc_inst (inst)); +patch_instruction ((struct ppc_inst *)(epapr_ev_idle_start + i),ppc_inst (inst));#endif }arch/powerpc/kernel/hw_breakpoint.c +0
-0@@ -244,12 +244,12 @@ dar_range_overlaps(unsigned long dar, int size, struct arch_hw_breakpoint *info) static bool stepping_handler(struct pt_regs *regs, struct perf_event *bp,arch/powerpc/kernel/hw_breakpoint.c dar_range_overlaps(unsigned long dar, int size, struct · line 253
Quoted 10 lines
arch/powerpc/kernel/hw_breakpoint.c +2
-2struct arch_hw_breakpoint *info) { -unsigned int instr =ppc_inst (0 ); +struct ppc_inst instr =ppc_inst (0 );int ret, type, size;struct instruction_op op;unsigned long addr = info->address; -if (__get_user_inatomic (instr, (unsigned int *)regs->nip)) +if (__get_user_inatomic (instr.val, (unsigned int *)regs->nip))[...] reference to above
Quoted 234 lines
arch/powerpc/kernel/hw_breakpoint.c +0
-0goto fail;ret = analyse_instr(&op, regs, instr);arch/powerpc/kernel/jump_label.c +1
-1@@ -11,7 +11,7 @@void arch_jump_label_transform (struct jump_entry *entry,enum jump_label_type type) { -u32 *addr = (u32 *)(unsigned long )entry->code; +struct ppc_inst *addr = (struct ppc_inst *)(unsigned long )entry->code;if (type ==JUMP_LABEL_JMP )patch_branch (addr, entry->target,0 );arch/powerpc/kernel/kgdb.c +2
-2@@ -419,7 +419,7 @@ int kgdb_arch_set_breakpoint(struct kgdb_bkpt *bpt) {int err;unsigned int instr; -unsigned int *addr = (unsigned int *)bpt->bpt_addr; +struct ppc_inst *addr = (struct ppc_inst *)bpt->bpt_addr; err =probe_kernel_address (addr, instr);if (err)@@ -438,7 +438,7 @@ int kgdb_arch_remove_breakpoint(struct kgdb_bkpt *bpt) {int err;unsigned int instr = *(unsigned int *)bpt->saved_instr; -unsigned int *addr = (unsigned int *)bpt->bpt_addr; +struct ppc_inst *addr = (struct ppc_inst *)bpt->bpt_addr; err =patch_instruction (addr,ppc_inst (instr));if (err)arch/powerpc/kernel/kprobes.c +1
-1@@ -106,7 +106,7 @@ kprobe_opcode_t *kprobe_lookup_name(const char *name, unsigned int offset)int arch_prepare_kprobe (struct kprobe *p) {int ret =0 ; -kprobe_opcode_t insn = *p->addr; +struct ppc_inst insn = *(struct ppc_inst *)p->addr;if ((unsigned long )p->addr &0x03 ) {printk("Attempt to register kprobe at an unaligned address\n");arch/powerpc/kernel/kprobes.c +3
-3@@ -139,13 +139,13 @@ NOKPROBE_SYMBOL(arch_prepare_kprobe);void arch_arm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); +patch_instruction ((struct ppc_inst *)p->addr,ppc_inst (BREAKPOINT_INSTRUCTION )); }NOKPROBE_SYMBOL (arch_arm_kprobe);void arch_disarm_kprobe (struct kprobe *p) { -patch_instruction (p->addr,ppc_inst (p->opcode)); +patch_instruction ((struct ppc_inst *)p->addr,ppc_inst (p->opcode)); }NOKPROBE_SYMBOL (arch_disarm_kprobe);@@ -217,7 +217,7 @@ NOKPROBE_SYMBOL(arch_prepare_kretprobe);static int try_to_emulate (struct kprobe *p,struct pt_regs *regs) {int ret; -unsigned int insn = *p->ainsn.insn; +struct ppc_inst insn = *(struct ppc_inst *)p->ainsn.insn;/* regs->nip is also adjusted if emulate_step returns 1 */ ret =emulate_step (regs, insn);arch/powerpc/kernel/mce_power.c +2
-1@@ -20,6 +20,7 @@#include <asm/sstep.h> #include <asm/exception-64s.h> #include <asm/extable.h> +#include <asm/inst.h> /* * Convert an address related to an mm to a PFN. NOTE: we are in real @@ -365,7 +366,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs*regs, uint64_t *addr, * in real-mode is tricky and can lead to recursive * faults */ -int instr; +struct ppc_inst instr;unsigned long pfn, instr_addr;struct instruction_op op;struct pt_regs tmp = *regs;arch/powerpc/kernel/mce_power.c +1
-1@@ -373,7 +374,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs *regs, uint64_t *addr, pfn =addr_to_pfn (regs, regs->nip);if (pfn !=ULONG_MAX ) { instr_addr = (pfn <<PAGE_SHIFT ) + (regs->nip & ~PAGE_MASK ); - instr = *(unsigned int *)(instr_addr); + instr = *(struct ppc_inst *)(instr_addr);if (!analyse_instr (&op, &tmp, instr)) { pfn =addr_to_pfn (regs, op.ea);*addr = op.ea;arch/powerpc/kernel/optprobes.c +2
-2@@ -100,8 +100,8 @@ static unsigned long can_optimize(struct kprobe *p)* Ensure that the instruction is not a conditional branch, * and that can be emulated. */ -if (!is_conditional_branch (*p->ainsn.insn) && -analyse_instr (&op, ®s, *p->ainsn.insn) ==1 ) { +if (!is_conditional_branch (*(struct ppc_inst *)p->ainsn.insn) && +analyse_instr (&op, ®s, *(struct ppc_inst *)p- >ainsn.insn) == 1) {emulate_update_regs (®s, &op); nip = regs.nip;}arch/powerpc/kernel/optprobes.c +1
-1@@ -148,12 +148,12 @@ void arch_remove_optimized_kprobe(struct optimized_kprobe *op)void patch_imm32_load_insns (unsigned int val,kprobe_opcode_t *addr) {/* addis r4,0,(insn)@h */ - patch_instruction(addr, ppc_inst(PPC_INST_ADDIS | ___PPC_RT(4) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ADDIS |
___PPC_RT(4)|((val >> 16) & 0xffff))); addr++; /* ori r4,r4,(insn)@l */arch/powerpc/kernel/optprobes.c +1
-1- patch_instruction(addr, ppc_inst(PPC_INST_ORI | ___PPC_RA(4) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(4)|___PPC_RS(4) | (val & 0xffff)));}
arch/powerpc/kernel/optprobes.c +1
-1@@ -164,34 +164,34 @@ void patch_imm32_load_insns(unsigned int val, kprobe_opcode_t *addr)void patch_imm64_load_insns (unsigned long val,kprobe_opcode_t *addr) {/* lis r3,(op)@highest */ - patch_instruction(addr, ppc_inst(PPC_INST_ADDIS | ___PPC_RT(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ADDIS |
___PPC_RT(3)|((val >> 48) & 0xffff))); addr++; /* ori r3,r3,(op)@higher */arch/powerpc/kernel/optprobes.c +1
-1- patch_instruction(addr, ppc_inst(PPC_INST_ORI | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(3)|___PPC_RS(3) | ((val >> 32) & 0xffff))); addr++; /* rldicr r3,r3,32,31 */arch/powerpc/kernel/optprobes.c +1
-1- patch_instruction(addr, ppc_inst(PPC_INST_RLDICR | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_RLDICR |
___PPC_RA(3)|___PPC_RS(3) | __PPC_SH64(32) | __PPC_ME64(31))); addr++; /* oris r3,r3,(op)@h */arch/powerpc/kernel/optprobes.c +1
-1- patch_instruction(addr, ppc_inst(PPC_INST_ORIS | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORIS |
___PPC_RA(3)|___PPC_RS(3) | ((val >> 16) & 0xffff))); addr++; /* ori r3,r3,(op)@l */arch/powerpc/kernel/optprobes.c +1
-1- patch_instruction(addr, ppc_inst(PPC_INST_ORI | ___PPC_RA(3) | + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(3)|___PPC_RS(3) | (val & 0xffff)));}
int arch_prepare_optimized_kprobe(struct
optimized_kprobe*op, struct kprobe
*p)
{arch/powerpc/kernel/optprobes.c +3
-3-kprobe_opcode_t *buff, branch_op_callback, branch_emulate_step; -kprobe_opcode_t *op_callback_addr, *emulate_step_addr; +struct ppc_inst branch_op_callback, branch_emulate_step; +kprobe_opcode_t *op_callback_addr, *emulate_step_addr, *buff;long b_offset;unsigned long nip, size;int rc, i;@@ -231,7 +231,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) size = (TMPL_END_IDX *sizeof (kprobe_opcode_t)) /sizeof (int );pr_devel ("Copying template to %p, size %lu\n" , buff, size);for (i =0 ; i < size; i++) { - rc =patch_instruction (buff + i, ppc_inst(*(optprobe_template_entry + i))); + rc =patch_instruction ((struct ppc_inst *)(buff + i),ppc_inst (*(optprobe_template_entry + i)));if (rc < 0) goto error; }arch/powerpc/kernel/optprobes.c +4
-4@@ -253,20 +253,20 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p) } rc =create_branch (&branch_op_callback, - (unsigned int *)buff +TMPL_CALL_HDLR_IDX , + (struct ppc_inst *)(buff +TMPL_CALL_HDLR_IDX ), (unsigned long )op_callback_addr,BRANCH_SET_LINK ); rc |=create_branch (&branch_emulate_step, - (unsigned int *)buff +TMPL_EMULATE_IDX , + (struct ppc_inst *)(buff +TMPL_EMULATE_IDX ), (unsigned long )emulate_step_addr,BRANCH_SET_LINK );if (rc) goto error; -patch_instruction (buff +TMPL_CALL_HDLR_IDX , branch_op_callback); -patch_instruction (buff +TMPL_EMULATE_IDX , branch_emulate_step); +patch_instruction ((struct ppc_inst *)(buff +TMPL_CALL_HDLR_IDX ), branch_op_callback); +patch_instruction ((struct ppc_inst *)(buff +TMPL_EMULATE_IDX ), branch_emulate_step);
Quoted 12 lines
arch/powerpc/kernel/optprobes.c int arch_prepare_optimized_kprobe(struct optimized_kprobe · line 280
Quoted 9 lines
/*
* 3. load instruction to be emulated into relevant register, andarch/powerpc/kernel/optprobes.c +1
-1@@ -276,7 +276,7 @@ int arch_prepare_optimized_kprobe(struct optimized_kprobe *op, struct kprobe *p)/* * 4. branch back from trampoline */ -patch_branch (buff +TMPL_RET_IDX , (unsigned long )nip,0 ); +patch_branch ((void *)(buff +TMPL_RET_IDX ), (unsigned long )nip,0 );why do we cast it differently here ?
That is a mistake.
Quoted 257 lines
Quoted 247 lines
arch/powerpc/kernel/optprobes.c +3
-3flush_icache_range ((unsigned long )buff, (unsigned long )(&buff[TMPL_END_IDX ]));@@ -308,7 +308,7 @@ int arch_check_optimized_kprobe(struct optimized_kprobe *op)void arch_optimize_kprobes (struct list_head *oplist) { -unsigned int instr; +struct ppc_inst instr;struct optimized_kprobe *op;struct optimized_kprobe *tmp;@@ -320,9 +320,9 @@ void arch_optimize_kprobes(struct list_head *oplist)memcpy (op->optinsn.copied_insn, op->kp.addr,RELATIVEJUMP_SIZE );create_branch (&instr, - (unsigned int *)op->kp.addr, + (struct ppc_inst *)op->kp.addr, (unsigned long )op->optinsn.insn,0 ); -patch_instruction (op->kp.addr, instr); +patch_instruction ((struct ppc_inst *)op->kp.addr, instr);list_del_init (&op->list); } }arch/powerpc/kernel/setup_32.c +1
-1@@ -76,7 +76,7 @@ EXPORT_SYMBOL(DMA_MODE_WRITE); notrace void __init machine_init(u64 dt_ptr) {unsigned int *addr = (unsigned int *)patch_site_addr (&patch__memset_nocache); -unsigned long insn; +struct ppc_inst insn;/* Configure static keys first, now that we're relocated. */ setup_feature_keys();arch/powerpc/kernel/trace/ftrace.c +5
-5@@ -41,23 +41,23 @@#define NUM_FTRACE_TRAMPS 8static unsigned long ftrace_tramps[NUM_FTRACE_TRAMPS ]; -static unsigned int +static struct ppc_inst ftrace_call_replace (unsigned long ip,unsigned long addr,int link) { -unsigned int op; +struct ppc_inst op; addr =ppc_function_entry ((void *)addr);/* if (link) set op to 'bl' else 'b' */ -create_branch (&op, (unsigned int *)ip, addr, link ?1 :0 ); +create_branch (&op, (struct ppc_inst *)ip, addr, link ?1 :0 );return op; }static int -ftrace_modify_code (unsigned long ip,unsigned int old,unsigned int new) +ftrace_modify_code (unsigned long ip,struct ppc_inst old,struct ppc_inst new) { -unsigned int replaced; +struct ppc_inst replaced;/* * Note:
arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -79,7 +79,7 @@ ftrace_modify_code(unsigned long ip, unsigned int old, unsigned int new) }/* replace the text with the new text */ -if (patch_instruction ((unsigned int *)ip, new)) +if (patch_instruction ((struct ppc_inst *)ip, new))return -EPERM ;return 0;arch/powerpc/kernel/trace/ftrace.c +14
-13@@ -90,24 +90,24 @@ ftrace_modify_code(unsigned long ip, unsigned int old,unsigned int new) */ static int test_24bit_addr (unsigned long ip,unsigned long addr) { -unsigned int op; +struct ppc_inst op; addr =ppc_function_entry ((void *)addr);/* use the create_branch to verify that this offset can be branched */ -return create_branch (&op, (unsigned int *)ip, addr,0 ) ==0 ; +return create_branch (&op, (struct ppc_inst *)ip, addr,0 ) ==0 ; } -static int is_bl_op (unsigned int op) +static int is_bl_op (struct ppc_inst op) {return (ppc_inst_val (op) &0xfc000003 ) ==0x48000001 ; } -static int is_b_op (unsigned int op) +static int is_b_op (struct ppc_inst op) {return (ppc_inst_val (op) &0xfc000003 ) ==0x48000000 ; } -static unsigned long find_bl_target (unsigned long ip,unsigned int op) +static unsigned long find_bl_target (unsigned long ip,struct ppc_inst op) {int offset;@@ -127,7 +127,7 @@ __ftrace_make_nop(struct module *mod, {unsigned long entry, ptr, tramp;unsigned long ip = rec->ip; -unsigned int op, pop; +struct ppc_inst op, pop;/* read where this goes */ if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) {@@ -207,7 +207,7 @@ __ftrace_make_nop(struct module *mod, }#endif /* CONFIG_MPROFILE_KERNEL */ -if (patch_instruction ((unsigned int *)ip, pop)) { +if (patch_instruction ((struct ppc_inst *)ip, pop)) {pr_err ("Patching NOP failed.\n" );return -EPERM ; }@@ -220,7 +220,7 @@ static int __ftrace_make_nop(struct module *mod, struct dyn_ftrace *rec, unsigned long addr) { - unsigned int op; + struct ppc_inst op;unsigned int jmp[4 ];unsigned long ip = rec->ip;unsigned long tramp;@@ -279,7 +279,7 @@ __ftrace_make_nop(struct module *mod, op =ppc_inst (PPC_INST_NOP ); -if (patch_instruction ((unsigned int *)ip, op)) +if (patch_instruction ((struct ppc_inst *)ip, op))return -EPERM ;return 0 ;@@ -290,7 +290,7 @@ __ftrace_make_nop(struct module *mod,static unsigned long find_ftrace_tramp (unsigned long ip) {int i; -unsigned int instr; +struct ppc_inst instr;/* * We have the compiler generated long_branch tramps at the end @@ -327,9 +327,10 @@ static int add_ftrace_tramp(unsigned long tramp)*/ static int setup_mcount_compiler_tramp (unsigned long tramp) { -int i, op; +int i; +struct ppc_inst op;unsigned long ptr; -unsigned int instr; +struct ppc_inst instr;static unsigned long ftrace_plt_tramps[NUM_FTRACE_TRAMPS ];/* Is this a known long jump tramp? */ @@ -378,7 +379,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)return -1 ; } -if (patch_branch ((unsigned int *)tramp, ptr,0 )) { +if (patch_branch ((struct ppc_inst *)tramp, ptr,0 )) {pr_debug ("REL24 out of range!\n" );return -1 ;}arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -394,7 +395,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp) static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr) {unsigned long tramp, ip = rec->ip; -unsigned int op; +struct ppc_inst op;/* Read where this goes */ if (probe_kernel_read(&op, (void *)ip, sizeof(int))) {arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -422,7 +423,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr) } } -if (patch_instruction ((unsigned int *)ip,ppc_inst (PPC_INST_NOP ))) { +if (patch_instruction ((struct ppc_inst *)ip,ppc_inst (PPC_INST_NOP ))) {pr_err ("Patching NOP failed.\n" );return -EPERM ;}arch/powerpc/kernel/trace/ftrace.c +3
-3@@ -434,7 +435,7 @@ int ftrace_make_nop(struct module *mod, struct dyn_ftrace *rec, unsigned long addr) {unsigned long ip = rec->ip; -unsigned int old, new; +struct ppc_inst old, new;/* * If the calling address is more that 24 bits away, @@ -487,7 +488,7 @@ int ftrace_make_nop(struct module *mod,*/ #ifndef CONFIG_MPROFILE_KERNEL static int -expected_nop_sequence (void *ip,unsigned int op0,unsigned int op1) +expected_nop_sequence (void *ip,struct ppc_inst op0,struct ppc_inst op1) {/* * We expect to see: @@ -504,7 +505,7 @@ expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1) }#else static int -expected_nop_sequence (void *ip,unsigned int op0,unsigned int op1) +expected_nop_sequence (void *ip,struct ppc_inst op0,struct ppc_inst op1) {/* look for patched "NOP" on ppc64 with -mprofile-kernel */ if (!ppc_inst_equal(op0, ppc_inst(PPC_INST_NOP)))arch/powerpc/kernel/trace/ftrace.c +2
-2@@ -516,8 +517,8 @@ expected_nop_sequence(void *ip, unsigned int op0, unsigned int op1)static int __ftrace_make_call (struct dyn_ftrace *rec,unsigned long addr) { -unsigned int op[2 ]; -unsigned int instr; +struct ppc_inst op[2 ]; +struct ppc_inst instr;void *ip = (void *)rec->ip;unsigned long entry, ptr, tramp;struct module *mod = rec->arch.mod;arch/powerpc/kernel/trace/ftrace.c __ftrace_make_call(struct dyn_ftrace *rec, unsigned long · line 533
Quoted 6 lines
arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -528,7 +529,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)if (!expected_nop_sequence (ip, op[0 ], op[1 ])) {pr_err ("Unexpected call sequence at %p: %x %x\n" , - ip, op[0 ], op[1 ]); + ip,ppc_inst_val (op[0 ]),ppc_inst_val (op[1 ]));shouldn't this change be part of patch 6,
Quoted 1 line
[PATCH v5 06/21] powerpc: Use an accessor for instructions
Yes it should be.
Quoted 471 lines
Quoted 139 lines
arch/powerpc/kernel/trace/ftrace.c +2
-2return -EINVAL ; }@@ -582,7 +583,7 @@ static int __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) { int err; -unsigned int op; +struct ppc_inst op;unsigned long ip = rec->ip;/* read where this goes */ @@ -602,7 +603,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) }/* create the branch to the trampoline */ - err =create_branch (&op, (unsigned int *)ip, + err =create_branch (&op, (struct ppc_inst *)ip, rec->arch.mod->arch.tramp,BRANCH_SET_LINK );if (!err) {pr_err("REL24 out of range!\n");arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -621,7 +622,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr) static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr) { -unsigned int op; +struct ppc_inst op;void *ip = (void *)rec->ip;unsigned long tramp, entry, ptr;arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -669,7 +670,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr)int ftrace_make_call (struct dyn_ftrace *rec,unsigned long addr) {unsigned long ip = rec->ip; -unsigned int old, new; +struct ppc_inst old, new;/* * If the calling address is more that 24 bits away,
arch/powerpc/kernel/trace/ftrace.c +2
-2@@ -708,7 +709,7 @@ static int __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, unsigned long addr) { - unsigned int op; + struct ppc_inst op;unsigned long ip = rec->ip;unsigned long entry, ptr, tramp;struct module *mod = rec->arch.mod;@@ -756,7 +757,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, /* The new target may be within range */ if (test_24bit_addr(ip, addr)) { /* within range */ - if (patch_branch((unsigned int *)ip, addr, BRANCH_SET_LINK)) { + if (patch_branch((struct ppc_inst *)ip, addr, BRANCH_SET_LINK)) {pr_err ("REL24 out of range!\n" );return -EINVAL; }arch/powerpc/kernel/trace/ftrace.c +2
-2@@ -784,12 +785,12 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* Ensure branch is within 24 bits */ -if (create_branch (&op, (unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (create_branch (&op, (struct ppc_inst *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("Branch out of range\n" );return -EINVAL ; } -if (patch_branch ((unsigned int *)ip, tramp,BRANCH_SET_LINK )) { +if (patch_branch ((struct ppc_inst *)ip, tramp,BRANCH_SET_LINK )) {pr_err ("REL24 out of range!\n" );return -EINVAL; }arch/powerpc/kernel/trace/ftrace.c +1
-1@@ -802,7 +803,7 @@ int ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, unsigned long addr) {unsigned long ip = rec->ip; -unsigned int old, new; +struct ppc_inst old, new;/* * If the calling address is more that 24 bits away,
arch/powerpc/kernel/trace/ftrace.c +5
-5@@ -842,10 +843,10 @@ int ftrace_modify_call(struct dyn_ftrace *rec, unsignedlong old_addr, int ftrace_update_ftrace_func(ftrace_func_t func) { unsigned long ip = (unsigned long)(&ftrace_call); -unsigned int old, new; +struct ppc_inst old, new;int ret; - old = *(unsigned int *)&ftrace_call; + old = *(struct ppc_inst *)&ftrace_call; new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new);@@ -853,7 +854,7 @@ int ftrace_update_ftrace_func(ftrace_func_t func)/* Also update the regs callback function */ if (!ret) { ip = (unsigned long )(&ftrace_regs_call); - old = *(unsigned int *)&ftrace_regs_call; + old = *(struct ppc_inst *)&ftrace_regs_call; new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new); }@@ -927,7 +928,7 @@ int ftrace_enable_ftrace_graph_caller(void)unsigned long ip = (unsigned long )(&ftrace_graph_call);unsigned long addr = (unsigned long )(&ftrace_graph_caller);unsigned long stub = (unsigned long )(&ftrace_graph_stub); -unsigned int old, new; +struct ppc_inst old, new; old =ftrace_call_replace (ip, stub,0 ); new =ftrace_call_replace (ip, addr,0 );@@ -940,7 +941,7 @@ int ftrace_disable_ftrace_graph_caller(void)unsigned long ip = (unsigned long )(&ftrace_graph_call);unsigned long addr = (unsigned long )(&ftrace_graph_caller);unsigned long stub = (unsigned long )(&ftrace_graph_stub); -unsigned int old, new; +struct ppc_inst old, new; old =ftrace_call_replace (ip, addr,0 ); new =ftrace_call_replace (ip, stub,0 );arch/powerpc/kernel/vecemu.c +0
-0@@ -261,11 +261,12 @@ static unsigned int rfin(unsigned int x)arch/powerpc/kernel/vecemu.c static unsigned int rfin(unsigned int x) · line 269
Quoted 10 lines
arch/powerpc/kernel/vecemu.c +3
-2int emulate_altivec (struct pt_regs *regs) { -unsigned int instr, i, word; +struct ppc_inst instr; +unsigned int i, word;unsigned int va, vb, vc, vd;vector128 *vrs; -if (get_user (instr, (unsigned int __user *) regs->nip)) +if (get_user (instr.val, (unsigned int __user *) regs->nip))[...] reference to above for using helper.
Quoted 317 lines
arch/powerpc/kernel/vecemu.c +0
-0return -EFAULT ; word =ppc_inst_val (instr);arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index33654c6334a9..91be4a0b51cb100644arch/powerpc/lib/code-patching.c +4
-4@@ -19,12 +19,12 @@#include <asm/setup.h> #include <asm/inst.h> -static int __patch_instruction (unsigned int *exec_addr,unsigned int instr, -unsigned int *patch_addr) +static int __patch_instruction (struct ppc_inst *exec_addr,struct ppc_inst instr, +struct ppc_inst *patch_addr) {int err =0 ; -__put_user_asm (instr, patch_addr, err,"stw" ); +__put_user_asm (ppc_inst_val (instr), patch_addr, err,"stw" );if (err)return err;@@ -34,7 +34,7 @@ static int __patch_instruction(unsigned int *exec_addr,unsigned int instr, return 0; } -int raw_patch_instruction (unsigned int *addr,unsigned int instr) +int raw_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {return __patch_instruction (addr, instr, addr);}
arch/powerpc/lib/code-patching.c +2
-2@@ -137,10 +137,10 @@ static inline int unmap_patch_area(unsigned long addr)return 0 ; } -static int do_patch_instruction (unsigned int *addr,unsigned int instr) +static int do_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {int err; -unsigned int *patch_addr =NULL ; +struct ppc_inst *patch_addr =NULL ;unsigned long flags;unsigned long text_poke_addr;unsigned long kaddr = (unsigned long)addr;arch/powerpc/lib/code-patching.c +2
-2@@ -177,14 +177,14 @@ static int do_patch_instruction(unsigned int *addr, unsigned int instr) }#else /* !CONFIG_STRICT_KERNEL_RWX */ -static int do_patch_instruction (unsigned int *addr,unsigned int instr) +static int do_patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {return raw_patch_instruction (addr, instr); }#endif /* CONFIG_STRICT_KERNEL_RWX */ -int patch_instruction (unsigned int *addr,unsigned int instr) +int patch_instruction (struct ppc_inst *addr,struct ppc_inst instr) {/* Make sure we aren't patching a freed init section */ if (init_mem_is_free && init_section_contains(addr, 4)) {arch/powerpc/lib/code-patching.c +2
-2@@ -195,9 +195,9 @@ int patch_instruction(unsigned int *addr, unsigned int instr) }NOKPROBE_SYMBOL (patch_instruction); -int patch_branch (unsigned int *addr,unsigned long target,int flags) +int patch_branch (struct ppc_inst *addr,unsigned long target,int flags) { -unsigned int instr; +struct ppc_inst instr;create_branch (&instr, addr, target, flags);return patch_instruction(addr, instr);arch/powerpc/lib/code-patching.c +11
-11@@ -229,7 +229,7 @@ bool is_offset_in_branch_range(long offset)* Helper to check if a given instruction is a conditional branch * Derived from the conditional checks in analyse_instr() */ -bool is_conditional_branch (unsigned int instr) +bool is_conditional_branch (struct ppc_inst instr) {unsigned int opcode =ppc_inst_opcode (instr);@@ -247,13 +247,13 @@ bool is_conditional_branch(unsigned int instr) }NOKPROBE_SYMBOL (is_conditional_branch); -int create_branch (unsigned int *instr, -const unsigned int *addr, +int create_branch (struct ppc_inst *instr, +const struct ppc_inst *addr,unsigned long target,int flags) {long offset; - *instr =0 ; + *instr =ppc_inst (0 ); offset = target;if (! (flags &BRANCH_ABSOLUTE )) offset = offset - (unsigned long )addr;@@ -263,12 +263,12 @@ int create_branch(unsigned int *instr,return 1 ;/* Mask out the flags and target, so they don't step on each other. */ - *instr =0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ); + *instr =ppc_inst (0x48000000 | (flags &0x3 ) | (offset &0x03FFFFFC ));return 0 ; } -int create_cond_branch (unsigned int *instr,const unsigned int *addr, +int create_cond_branch (struct ppc_inst *instr,const struct ppc_inst *addr,unsigned long target,int flags) {long offset;@@ -282,27 +282,27 @@ int create_cond_branch(unsigned int *instr, constunsigned int *addr, return 1;/* Mask out the flags and target, so they don't step on each other. */ - *instr =0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ); + *instr =ppc_inst (0x40000000 | (flags &0x3FF0003 ) | (offset &0xFFFC ));return 0 ; } -static unsigned int branch_opcode (unsigned int instr) +static unsigned int branch_opcode (struct ppc_inst instr) {return ppc_inst_opcode (instr) &0x3F ; } -static int instr_is_branch_iform (unsigned int instr) +static int instr_is_branch_iform (struct ppc_inst instr) {return branch_opcode (instr) ==18 ; } -static int instr_is_branch_bform (unsigned int instr) +static int instr_is_branch_bform (struct ppc_inst instr) {return branch_opcode (instr) ==16 ; } -int instr_is_relative_branch (unsigned int instr) +int instr_is_relative_branch (struct ppc_inst instr) {if (
ppc_inst_val(instr)&BRANCH_ABSOLUTE)
return 0;arch/powerpc/lib/code-patching.c +4
-4@@ -310,12 +310,12 @@ int instr_is_relative_branch(unsigned int instr)return instr_is_branch_iform (instr) ||instr_is_branch_bform (instr); } -int instr_is_relative_link_branch (unsigned int instr) +int instr_is_relative_link_branch (struct ppc_inst instr) {return instr_is_relative_branch (instr) && (ppc_inst_val (instr) &BRANCH_SET_LINK ); } -static unsigned long branch_iform_target (const unsigned int *instr) +static unsigned long branch_iform_target (const struct ppc_inst *instr) {signed long imm;@@ -331,7 +331,7 @@ static unsigned long branch_iform_target(const unsigned int *instr)return (unsigned long )imm; } -static unsigned long branch_bform_target (const unsigned int *instr) +static unsigned long branch_bform_target (const struct ppc_inst *instr) {signed long imm;@@ -347,7 +347,7 @@ static unsigned long branch_bform_target(const unsigned int *instr)return (unsigned long )imm; } -unsigned long branch_target (const unsigned int *instr) +unsigned long branch_target (const struct ppc_inst *instr) {if (instr_is_branch_iform (*instr))return branch_iform_target(instr);arch/powerpc/lib/code-patching.c +1
-1@@ -357,7 +357,7 @@ unsigned long branch_target(const unsigned int *instr)return 0 ; } -int instr_is_branch_to_addr (const unsigned int *instr,unsigned long addr) +int instr_is_branch_to_addr (const struct ppc_inst *instr,unsigned long addr) {if (instr_is_branch_iform (*instr) ||instr_is_branch_bform (*instr))return branch_target(instr) == addr;arch/powerpc/lib/code-patching.c +1
-1@@ -365,7 +365,7 @@ int instr_is_branch_to_addr(const unsigned int *instr, unsigned long addr)return 0 ; } -int translate_branch(unsigned int *instr, const unsigned int *dest, const unsigned int *src) +int translate_branch (struct ppc_inst *instr,const struct ppc_inst *dest,const struct ppc_inst *src){ unsigned long target;arch/powerpc/lib/code-patching.c +8
-7@@ -408,7 +408,7 @@ static void __init test_trampoline(void)static void __init test_branch_iform (void ) {int err; -unsigned int instr; +struct ppc_inst instr;unsigned long addr; addr = (unsigned long )&instr;@@ -483,12 +483,12 @@ static void __init test_branch_iform(void)static void __init test_create_function_call (void ) { -unsigned int *iptr; +struct ppc_inst *iptr;unsigned long dest; -unsigned int instr; +struct ppc_inst instr;/* Check we can create a function call */ - iptr = (unsigned int *)ppc_function_entry (test_trampoline); + iptr = (struct ppc_inst *)ppc_function_entry (test_trampoline); dest =ppc_function_entry (test_create_function_call);create_branch (&instr, iptr, dest,BRANCH_SET_LINK );patch_instruction (iptr, instr);@@ -499,7 +499,8 @@ static void __init test_branch_bform(void) {int err;unsigned long addr; -unsigned int *iptr, instr, flags; +struct ppc_inst *iptr, instr; +unsigned int flags; iptr = &instr; addr = (unsigned long )iptr;@@ -569,8 +570,8 @@ static void __init test_branch_bform(void)static void __init test_translate_branch (void ) {unsigned long addr; -unsigned int *p, *q; -unsigned int instr; +struct ppc_inst *p, *q; +struct ppc_inst instr;void *buf; buf =vmalloc (PAGE_ALIGN (0x2000000 +1 ));arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
index6e7479b8887a..8c5d0db77013100644arch/powerpc/lib/feature-fixups.c +6
-6@@ -32,26 +32,26 @@ struct fixup_entry {long alt_end_off; }; -static unsigned int *calc_addr (struct fixup_entry *fcur,long offset) +static struct ppc_inst *calc_addr (struct fixup_entry *fcur,long offset) {/* * We store the offset to the code as a negative offset from * the start of the alt_entry, to support the VDSO. This * routine converts that back into an actual address. */ -return (unsigned int *)((unsigned long )fcur + offset); +return (struct ppc_inst *)((unsigned long )fcur + offset); } -static int patch_alt_instruction (unsigned int *src,unsigned int *dest, -unsigned int *alt_start,unsigned int *alt_end) +static int patch_alt_instruction (struct ppc_inst *src,struct ppc_inst *dest, +struct ppc_inst *alt_start,struct ppc_inst *alt_end) {int err; -unsigned int instr; +struct ppc_inst instr; instr = *src;if (instr_is_relative_branch (*src)) { -unsigned int *target = (unsigned int *)branch_target (src); + struct ppc_inst *target = (struct ppc_inst*)branch_target(src);
/* Branch within the section doesn't need translating */ if (target < alt_start || target > alt_end) {arch/powerpc/lib/feature-fixups.c +1
-1@@ -68,7 +68,7 @@ static int patch_alt_instruction(unsigned int *src,unsigned int *dest, static int patch_feature_section(unsigned long value, struct fixup_entry *fcur) { - unsigned int *start, *end, *alt_start, *alt_end, *src, *dest; + struct ppc_inst *start, *end, *alt_start, *alt_end, *src, *dest;start = calc_addr(fcur, fcur->start_off); end = calc_addr(fcur, fcur->end_off);arch/powerpc/lib/feature-fixups.c +0
-0@@ -147,15 +147,15 @@ static void do_stf_entry_barrier_fixups(enum stf_barrier_type types)
Quoted 8 lines
arch/powerpc/lib/feature-fixups.c static void do_stf_entry_barrier_fixups(enum stf_barrier_type types)
Quoted 5 lines
arch/powerpc/lib/feature-fixups.c +1
-1pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest,ppc_inst (instrs[0 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instrs[0 ]));we had already declared them as struct
ppc_inst*
True.
Quoted 296 lines
Quoted 102 lines
arch/powerpc/lib/feature-fixups.c +3
-3if (types &STF_BARRIER_FALLBACK ) -patch_branch (dest +1 , (unsigned long)&stf_barrier_fallback, +patch_branch ((struct ppc_inst *)(dest +1 ), (unsigned long )&stf_barrier_fallback,BRANCH_SET_LINK );else -patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instrs[1 ])); -patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); + patch_instruction((struct ppc_inst *)(dest + 2),
ppc_inst(instrs[2]));
}printk(KERN_DEBUG "stf-barrier: patched %d entry locations (%s
barrier)\n", i,arch/powerpc/lib/feature-fixups.c +3
-6@@ -208,12 +208,12 @@ static void do_stf_exit_barrier_fixups(enum stf_barrier_type types) pr_devel("patching dest %lx\n", (unsigned long)dest); -patch_instruction (dest,ppc_inst (instrs[0 ])); -patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); -patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); -patch_instruction (dest +3 ,ppc_inst (instrs[3 ])); -patch_instruction (dest +4 ,ppc_inst (instrs[4 ])); -patch_instruction (dest +5 ,ppc_inst (instrs[5 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instrs[0 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instrs[1 ])); + patch_instruction((struct ppc_inst *)(dest + 2),
ppc_inst(instrs[2]));
+ patch_instruction((structppc_inst*)(dest + 3),ppc_inst(instrs[3]));
+ patch_instruction((structppc_inst*)(dest + 4),ppc_inst(instrs[4]));
+ patch_instruction((structppc_inst*)(dest + 5),ppc_inst(instrs[5]));
}
printk(KERN_DEBUG "stf-barrier: patched %d exit locations (%s
barrier)\n", i,(types == STF_BARRIER_NONE) ? "no" :arch/powerpc/lib/feature-fixups.c +3
-3@@ -261,9 +261,9 @@ void do_rfi_flush_fixups(enum l1d_flush_type types)pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest,ppc_inst (instrs[0 ])); -patch_instruction (dest +1 ,ppc_inst (instrs[1 ])); -patch_instruction (dest +2 ,ppc_inst (instrs[2 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instrs[0 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instrs[1 ])); +patch_instruction ((struct ppc_inst *)(dest +2 ),ppc_inst (instrs[2 ]));}
printk(KERN_DEBUG "rfi-flush: patched %d locations (%s flush)\n", i,
arch/powerpc/lib/feature-fixups.c +1
-1@@ -296,7 +296,7 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest,ppc_inst (instr)); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instr)); }printk(KERN_DEBUG "barrier-nospec: patched %d locations\n", i);arch/powerpc/lib/feature-fixups.c +2
-2@@ -339,8 +339,8 @@ void do_barrier_nospec_fixups_range(bool enable, void *fixup_start, void *fixup_ dest = (void *)start + *start;pr_devel ("patching dest %lx\n" , (unsigned long )dest); -patch_instruction (dest,ppc_inst (instr[0 ])); -patch_instruction (dest +1 ,ppc_inst (instr[1 ])); +patch_instruction ((struct ppc_inst *)dest,ppc_inst (instr[0 ])); +patch_instruction ((struct ppc_inst *)(dest +1 ),ppc_inst (instr[1 ])); }printk(KERN_DEBUG "barrier-nospec: patched %d locations\n", i);arch/powerpc/lib/feature-fixups.c +1
-1@@ -373,7 +373,7 @@ void do_btb_flush_fixups(void)void do_lwsync_fixups (unsigned long value,void *fixup_start,void *fixup_end) {long *start, *end; -unsigned int *dest; +struct ppc_inst *dest;if (!(value &CPU_FTR_LWSYNC ))return ;arch/powerpc/lib/sstep.c +0
-0arch/powerpc/lib/sstep.c static nokprobe_inline int trap_compare(long v1, long · line 1167
Quoted 6 lines
arch/powerpc/lib/sstep.c +1
-1@@ -1163,7 +1163,7 @@ static nokprobe_inline int trap_compare(long v1, longv2) * otherwise. */ int analyse_instr (struct instruction_op *op,const struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr)we need to take care of
instrinside this function as well to adopt the helpers to work with it.-- Bala
Quoted 179 lines
arch/powerpc/lib/sstep.c +0
-0{unsigned int opcode, ra, rb, rc, rd, spr, u;unsigned long int imm;arch/powerpc/lib/sstep.c +1
-1@@ -3103,7 +3103,7 @@ NOKPROBE_SYMBOL(emulate_loadstore);* or -1 if the instruction is one that should not be stepped, * such as an rfid, or a mtmsrd that would clear MSR_RI. */ -int emulate_step (struct pt_regs *regs,unsigned int instr) +int emulate_step (struct pt_regs *regs,struct ppc_inst instr) {struct instruction_op op;int r, err, type;arch/powerpc/lib/test_emulate_step.c +3
-3@@ -461,7 +461,7 @@ struct compute_test {struct {char *descr;unsigned long flags; -unsigned int instr; +struct ppc_inst instr;struct pt_regs regs; } subtests[MAX_SUBTESTS +1 ]; };@@ -842,7 +842,7 @@ static struct compute_test compute_tests[] = { };static int __init emulate_compute_instr (struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr) {struct instruction_op op;@@ -860,7 +860,7 @@ static int __init emulate_compute_instr(struct pt_regs *regs, }static int __init execute_compute_instr (struct pt_regs *regs, -unsigned int instr) +struct ppc_inst instr) {extern int exec_instr (struct pt_regs *regs);extern s32 patch__exec_instr;arch/powerpc/lib/test_emulate_step.c +2
-1@@ -891,7 +891,8 @@ static void __init run_tests_compute(void)unsigned long flags;struct compute_test *test;struct pt_regs *regs, exp, got; -unsigned int i, j, k, instr; +unsigned int i, j, k; +struct ppc_inst instr;bool ignore_gpr, ignore_xer, ignore_ccr, passed;for (i =0 ; i <ARRAY_SIZE (compute_tests); i++) {arch/powerpc/perf/core- renamed from arch/powerpc/perf/core-book3s.c +0
-0
book3s.c
index3086055bf681..2d2580a4bfb5100644arch/powerpc/perf/core-book3s.c +2
-2@@ -421,14 +421,14 @@ static __u64 power_pmu_bhrb_to(u64 addr)if (probe_kernel_read (&instr, (void *)addr,sizeof (instr)))return 0 ; -return branch_target (&instr); +return branch_target ((struct ppc_inst *)&instr); }/* Userspace: need copy instruction here then translate it */ if (probe_user_read (&instr, (unsigned int __user *)addr,sizeof (instr)))return 0 ; - target =branch_target (&instr); + target =branch_target ((struct ppc_inst *)&instr);if ((!target) || (instr &BRANCH_ABSOLUTE ))return target;arch/powerpc/xmon/xmon.c +4
-4@@ -99,7 +99,7 @@ static long *xmon_fault_jmp[NR_CPUS];/* Breakpoint stuff */ struct bpt {unsigned long address; -unsigned int *instr; +struct ppc_inst *instr;atomic_t ref_count;int enabled;unsigned long pad;@@ -117,7 +117,7 @@ static unsigned bpinstr = 0x7fe00008; /* trap */#define BP_NUM (bp) ((bp) - bpts + 1) -#define BPT_SIZE (sizeof(unsigned int) * 2) +#define BPT_SIZE (sizeof(struct ppc_inst) * 2)#define BPT_WORDS (BPT_SIZE / sizeof(unsigned int))extern unsigned int bpt_table[NBPTS *BPT_WORDS ];@@ -879,8 +879,8 @@ static struct bpt *new_breakpoint(unsigned long a)for (bp = bpts; bp < &bpts[NBPTS ]; ++bp) {if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; - bp->instr = bpt_table + ((bp - bpts) *BPT_WORDS ); -patch_instruction (bp->instr +1 , bpinstr); + bp->instr = (void *)(bpt_table + ((bp - bpts) *BPT_WORDS )); +patch_instruction (bp->instr +1 ,ppc_inst (bpinstr));return bp; }}arch/powerpc/xmon/xmon.c +3
-3@@ -892,7 +892,7 @@ static struct bpt *new_breakpoint(unsigned long a)static void insert_bpts (void ) {int i; -unsigned int instr; +struct ppc_inst instr;struct bpt *bp; bp = bpts;@@ -914,8 +914,8 @@ static void insert_bpts(void)patch_instruction (bp->instr, instr);if (bp->enabled &BP_CIABR )continue ; -if (patch_instruction ((unsigned int *)bp->address, - bpinstr) !=0 ) { +if (patch_instruction ((struct ppc_inst *)bp->address, +ppc_inst (bpinstr)) !=0 ) {printf ("Couldn't write instruction at %lx, " "disabling breakpoint there\n" , bp->address);bp->enabled &= ~BP_TRAP;arch/powerpc/xmon/xmon.c +5
-5@@ -943,7 +943,7 @@ static void remove_bpts(void) {int i;struct bpt *bp; -unsigned instr; +struct ppc_inst instr; bp = bpts;for (i =0 ; i <NBPTS ; ++i, ++bp) {@@ -952,7 +952,7 @@ static void remove_bpts(void)if (mread (bp->address, &instr,4 ) ==4 &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( - (unsigned int *)bp->address, bp->instr[0 ]) !=0 ) + (struct ppc_inst *)bp->address, bp->instr[0 ]) !=0 )printf ("Couldn't remove breakpoint at %lx\n" , bp->address); }@@ -1159,7 +1159,7 @@ static int do_step(struct pt_regs *regs)*/ static int do_step (struct pt_regs *regs) { -unsigned int instr; +struct ppc_inst instr;int stepped;force_enable_xmon ();@@ -1325,7 +1325,7 @@ csum(void)*/ static long check_bp_loc (unsigned long addr) { -unsigned int instr; +struct ppc_inst instr; addr &= ~3 ;if (!is_kernel_addr (addr)) {@@ -2846,7 +2846,7 @@ generic_inst_dump(unsigned long adr, long count, int praddr, {int nr, dotted;unsigned long first_adr; -unsigned int inst, last_inst =ppc_inst (0 ); +struct ppc_inst inst, last_inst =ppc_inst (0 );unsigned char val[4 ];dotted = 0;
PATCH v5 10/21 powerpc: Use a function for reading instructions
In reply to Jordan NiethePrefixed instructions will mean there are instructions of different length. As a result dereferencing a pointer to an instruction will not necessarily give the desired result. Introduce a function for reading instructions from memory into the instruction data type.
---
v4: New to series
v5: - Rename read_inst() -> probe_kernel_read_inst()
- No longer modify uprobe probe type in this patch
--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/kprobes.c | 11 ++++------ arch/powerpc/kernel/mce_power.c | 2 +- arch/powerpc/kernel/optprobes.c | 4 ++-- arch/powerpc/kernel/trace/ftrace.c | 33 +++++++++++++++++++----------- arch/powerpc/lib/code-patching.c | 23 ++++++++++----------- arch/powerpc/lib/feature-fixups.c | 2 +- arch/powerpc/xmon/xmon.c | 6 +++--- 8 files changed, 48 insertions(+), 38 deletions(-)
arch/powerpc/include/asm/inst.h +5 -0
@@ -27,6 +27,11 @@ static inline struct ppc_inst ppc_inst_swab(struct ppc_inst x)return ppc_inst (swab32 (ppc_inst_val (x))); } +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) +{ +return *ptr; +} +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) {return !memcmp (&x, &y,sizeof (struct ppc_inst ));
arch/powerpc/kernel/kprobes.c +4 -7
@@ -106,7 +106,7 @@ kprobe_opcode_t *kprobe_lookup_name(const char *name, unsigned int offset)int arch_prepare_kprobe (struct kprobe *p) {int ret =0 ; -struct ppc_inst insn = *(struct ppc_inst *)p->addr; +struct ppc_inst insn =ppc_inst_read ((struct ppc_inst *)p->addr);if ((unsigned long )p->addr &0x03 ) {printk ("Attempt to register kprobe at an unaligned address\n" );
@@ -125,11 +125,8 @@ int arch_prepare_kprobe(struct kprobe *p) }if (!ret) { -memcpy (p->ainsn.insn, p->addr, -MAX_INSN_SIZE *sizeof (kprobe_opcode_t)); - p->opcode = *p->addr; -flush_icache_range ((unsigned long )p->ainsn.insn, - (unsigned long )p->ainsn.insn +sizeof (kprobe_opcode_t)); +patch_instruction ((struct ppc_inst *)p->ainsn.insn, insn); + p->opcode =ppc_inst_val (insn); } p->ainsn.boostable =0 ;
@@ -217,7 +214,7 @@ NOKPROBE_SYMBOL(arch_prepare_kretprobe);static int try_to_emulate (struct kprobe *p,struct pt_regs *regs) {int ret; -struct ppc_inst insn = *(struct ppc_inst *)p->ainsn.insn; +struct ppc_inst insn =ppc_inst_read ((struct ppc_inst *)p->ainsn.insn);/* regs->nip is also adjusted if emulate_step returns 1 */ ret =emulate_step (regs, insn);
arch/powerpc/kernel/mce_power.c +1 -1
@@ -374,7 +374,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs *regs, uint64_t *addr, pfn =addr_to_pfn (regs, regs->nip);if (pfn !=ULONG_MAX ) { instr_addr = (pfn <<PAGE_SHIFT ) + (regs->nip & ~PAGE_MASK ); - instr = *(struct ppc_inst *)(instr_addr); + instr =ppc_inst_read ((struct ppc_inst *)instr_addr);if (!analyse_instr (&op, &tmp, instr)) { pfn =addr_to_pfn (regs, op.ea); *addr = op.ea;
arch/powerpc/kernel/optprobes.c +2 -2
@@ -100,8 +100,8 @@ static unsigned long can_optimize(struct kprobe *p)* Ensure that the instruction is not a conditional branch, * and that can be emulated. */ -if (!is_conditional_branch (*(struct ppc_inst *)p->ainsn.insn) && -analyse_instr (&op, ®s, *(struct ppc_inst *)p->ainsn.insn) ==1 ) { +if (!is_conditional_branch (ppc_inst_read ((struct ppc_inst *)p->ainsn.insn)) && +analyse_instr (&op, ®s,ppc_inst_read ((struct ppc_inst *)p->ainsn.insn)) ==1 ) {emulate_update_regs (®s, &op); nip = regs.nip; }
arch/powerpc/kernel/trace/ftrace.c +21 -12
@@ -41,6 +41,12 @@#define NUM_FTRACE_TRAMPS 8static unsigned long ftrace_tramps[NUM_FTRACE_TRAMPS ]; +static long +probe_kernel_read_inst (struct ppc_inst *inst,const void *src) +{ +return probe_kernel_read ((void *)inst, src,MCOUNT_INSN_SIZE ); +} +static struct ppc_inst ftrace_call_replace (unsigned long ip,unsigned long addr,int link) {
@@ -68,7 +74,7 @@ ftrace_modify_code(unsigned long ip, struct ppc_inst old, struct ppc_inst new)*/ /* read the text we want to modify */ -if (probe_kernel_read (&replaced, (void *)ip,MCOUNT_INSN_SIZE )) +if (probe_kernel_read_inst (&replaced, (void *)ip))return -EFAULT ;/* Make sure it is what we expect it to be */
@@ -130,7 +136,7 @@ __ftrace_make_nop(struct module *mod,struct ppc_inst op, pop;/* read where this goes */ -if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)ip)) {pr_err ("Fetching opcode failed.\n" );return -EFAULT ; }
@@ -164,7 +170,7 @@ __ftrace_make_nop(struct module *mod,/* When using -mkernel_profile there is no load to jump over */ pop =ppc_inst (PPC_INST_NOP ); -if (probe_kernel_read (&op, (void *)(ip -4 ),4 )) { +if (probe_kernel_read_inst (&op, (void *)(ip -4 ))) {pr_err ("Fetching instruction at %lx failed.\n" , ip -4 );return -EFAULT ; }
@@ -196,7 +202,7 @@ __ftrace_make_nop(struct module *mod,* Check what is in the next instruction. We can see ld r2,40(r1), but * on first pass after boot we will see mflr r0. */ -if (probe_kernel_read (&op, (void *)(ip+4 ),MCOUNT_INSN_SIZE )) { +if (probe_kernel_read_inst (&op, (void *)(ip+4 ))) {pr_err ("Fetching op failed.\n" );return -EFAULT ; }
@@ -348,7 +354,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)return -1 ;/* New trampoline -- read where this goes */ -if (probe_kernel_read (&op, (void *)tramp,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)tramp)) {pr_debug ("Fetching opcode failed.\n" );return -1 ; }
@@ -398,7 +404,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr)struct ppc_inst op;/* Read where this goes */ -if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)ip)) {pr_err ("Fetching opcode failed.\n" );return -EFAULT ; }
@@ -524,7 +530,10 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)struct module *mod = rec->arch.mod;/* read where this goes */ -if (probe_kernel_read (op, ip,sizeof (op))) +if (probe_kernel_read_inst (op, ip)) +return -EFAULT ; + +if (probe_kernel_read_inst (op +1 , ip +4 ))return -EFAULT ;if (!expected_nop_sequence (ip, op[0 ], op[1 ])) {
@@ -587,7 +596,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)unsigned long ip = rec->ip;/* read where this goes */ -if (probe_kernel_read (&op, (void *)ip,MCOUNT_INSN_SIZE )) +if (probe_kernel_read_inst (&op, (void *)ip))return -EFAULT ;/* It should be pointing to a nop */
@@ -643,7 +652,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr) }/* Make sure we have a nop */ -if (probe_kernel_read (&op, ip,sizeof (op))) { +if (probe_kernel_read_inst (&op, ip)) {pr_err ("Unable to read ftrace location %p\n" , ip);return -EFAULT ; }
@@ -721,7 +730,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* read where this goes */ -if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)ip)) {pr_err ("Fetching opcode failed.\n" );return -EFAULT ; }
@@ -846,7 +855,7 @@ int ftrace_update_ftrace_func(ftrace_func_t func)struct ppc_inst old, new;int ret; - old = *(struct ppc_inst *)&ftrace_call; + old =ppc_inst_read ((struct ppc_inst *)&ftrace_call); new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new);
@@ -854,7 +863,7 @@ int ftrace_update_ftrace_func(ftrace_func_t func)/* Also update the regs callback function */ if (!ret) { ip = (unsigned long )(&ftrace_regs_call); - old = *(struct ppc_inst *)&ftrace_regs_call; + old =ppc_inst_read ((struct ppc_inst *)&ftrace_regs_call); new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new); }
arch/powerpc/lib/code-patching.c +11 -12
@@ -349,9 +349,9 @@ static unsigned long branch_bform_target(const struct ppc_inst *instr)unsigned long branch_target (const struct ppc_inst *instr) { -if (instr_is_branch_iform (*instr)) +if (instr_is_branch_iform (ppc_inst_read (instr)))return branch_iform_target (instr); -else if (instr_is_branch_bform (*instr)) +else if (instr_is_branch_bform (ppc_inst_read (instr)))return branch_bform_target (instr);return 0 ;
@@ -359,7 +359,7 @@ unsigned long branch_target(const struct ppc_inst *instr)int instr_is_branch_to_addr (const struct ppc_inst *instr,unsigned long addr) { -if (instr_is_branch_iform (*instr) ||instr_is_branch_bform (*instr)) +if (instr_is_branch_iform (ppc_inst_read (instr)) ||instr_is_branch_bform (ppc_inst_read (instr)))return branch_target (instr) == addr;return 0 ;
@@ -368,13 +368,12 @@ int instr_is_branch_to_addr(const struct ppc_inst *instr, unsigned long addr)int translate_branch (struct ppc_inst *instr,const struct ppc_inst *dest,const struct ppc_inst *src) {unsigned long target; - target =branch_target (src); -if (instr_is_branch_iform (*src)) -return create_branch (instr, dest, target,ppc_inst_val (*src)); -else if (instr_is_branch_bform (*src)) -return create_cond_branch (instr, dest, target,ppc_inst_val (*src)); +if (instr_is_branch_iform (ppc_inst_read (src))) +return create_branch (instr, dest, target,ppc_inst_val (ppc_inst_read (src))); +else if (instr_is_branch_bform (ppc_inst_read (src))) +return create_cond_branch (instr, dest, target,ppc_inst_val (ppc_inst_read (src)));return 1 ; }
@@ -598,7 +597,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x4a000000 ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x4a000000 )));/* Maximum positive case, move x to x - 32 MB + 4 */ p = buf +0x2000000 ;
@@ -609,7 +608,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x49fffffc ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x49fffffc )));/* Jump to x + 16 MB moved to x + 20 MB */ p = buf;
@@ -655,7 +654,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x43ff8000 ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x43ff8000 )));/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ;
@@ -667,7 +666,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x43ff7ffc ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x43ff7ffc )));/* Jump to x + 12 KB moved to x + 20 KB */ p = buf;
arch/powerpc/lib/feature-fixups.c +1 -1
@@ -48,7 +48,7 @@ static int patch_alt_instruction(struct ppc_inst *src, struct ppc_inst *dest,int err;struct ppc_inst instr; - instr = *src; + instr =ppc_inst_read (src);if (instr_is_relative_branch (*src)) {struct ppc_inst *target = (struct ppc_inst *)branch_target (src);
arch/powerpc/xmon/xmon.c +3 -3
@@ -705,13 +705,13 @@ static int xmon_core(struct pt_regs *regs, int fromipi)if ((regs->msr & (MSR_IR |MSR_PR |MSR_64BIT )) == (MSR_IR |MSR_64BIT )) { bp =at_breakpoint (regs->nip);if (bp !=NULL ) { -int stepped =emulate_step (regs, bp->instr[0 ]); +int stepped =emulate_step (regs,ppc_inst_read (bp->instr));if (stepped ==0 ) { regs->nip = (unsigned long ) &bp->instr[0 ];atomic_inc (&bp->ref_count); }else if (stepped <0 ) {printf ("Couldn't single-step %s instruction\n" , - (IS_RFID (bp->instr[0 ])?"rfid" :"mtmsrd" )); +IS_RFID (ppc_inst_read (bp->instr))?"rfid" :"mtmsrd" ); } } }
@@ -952,7 +952,7 @@ static void remove_bpts(void)if (mread (bp->address, &instr,4 ) ==4 &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( - (struct ppc_inst *)bp->address, bp->instr[0 ]) !=0 ) + (struct ppc_inst *)bp->address,ppc_inst_read (bp->instr)) !=0 )printf ("Couldn't remove breakpoint at %lx\n" , bp->address); }
Signature · 1 line
2.17.1
Re: [PATCH v5 10/21] powerpc: Use a function for reading instructions
Quoted 55 lines · Jordan Niethe
Prefixed instructions will mean there are instructions of different length. As a result dereferencing a pointer to an instruction will not necessarily give the desired result. Introduce a function for reading instructions from memory into the instruction data type.
Signed-off-by Jordan Niethe <[email protected]>---
v4: New to series
v5: - Renameread_inst()->probe_kernel_read_inst()
- No longer modify uprobe probe type in this patch--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/kprobes.c | 11 ++++------ arch/powerpc/kernel/mce_power.c | 2 +- arch/powerpc/kernel/optprobes.c | 4 ++-- arch/powerpc/kernel/trace/ftrace.c | 33 +++++++++++++++++++----------- arch/powerpc/lib/code-patching.c | 23 ++++++++++----------- arch/powerpc/lib/feature-fixups.c | 2 +- arch/powerpc/xmon/xmon.c | 6 +++--- 8 files changed, 48 insertions(+), 38 deletions(-)arch/powerpc/include/asm/inst.h +5
-0@@ -27,6 +27,11 @@ static inline struct ppc_inst ppc_inst_swab(struct ppc_inst x)return ppc_inst (swab32 (ppc_inst_val (x))); } +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) +{ +return *ptr; +} +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) {arch/powerpc/include/asm/inst.h +0
-0return !memcmp (&x, &y,sizeof (struct ppc_inst ));arch/powerpc/kernel/kprobes.c +1
-1@@ -106,7 +106,7 @@ kprobe_opcode_t *kprobe_lookup_name(const char *name, unsigned int offset)int arch_prepare_kprobe (struct kprobe *p) {int ret =0 ; -struct ppc_inst insn = *(struct ppc_inst *)p->addr; +struct ppc_inst insn =ppc_inst_read ((struct ppc_inst *)p->addr);if ((unsigned long )p->addr &0x03 ) {arch/powerpc/kernel/kprobes.c +0
-0printk ("Attempt to register kprobe at an unaligned address\n" );@@ -125,11 +125,8 @@ int arch_prepare_kprobe(struct kprobe *p) }
arch/powerpc/kernel/kprobes.c int arch_prepare_kprobe(struct kprobe *p) · line 130
Quoted 10 lines
arch/powerpc/kernel/kprobes.c +2
-5if (!ret) { -memcpy (p->ainsn.insn, p->addr, -MAX_INSN_SIZE *sizeof (kprobe_opcode_t)); - p->opcode = *p->addr; -flush_icache_range ((unsigned long )p->ainsn.insn, - (unsigned long )p->ainsn.insn + sizeof(kprobe_opcode_t)); +patch_instruction ((struct ppc_inst *)p->ainsn.insn, insn); + p->opcode =ppc_inst_val (insn);
This is a different change from this commit
-- Bala
Quoted 318 lines
arch/powerpc/kernel/kprobes.c +0
-0}arch/powerpc/kernel/kprobes.c +1
-1p->ainsn.boostable =0 ;@@ -217,7 +214,7 @@ NOKPROBE_SYMBOL(arch_prepare_kretprobe);static int try_to_emulate (struct kprobe *p,struct pt_regs *regs) {int ret; -struct ppc_inst insn = *(struct ppc_inst *)p->ainsn.insn; +struct ppc_inst insn =ppc_inst_read ((struct ppc_inst *)p->ainsn.insn);/* regs->nip is also adjusted if emulate_step returns 1 */ ret =emulate_step (regs, insn);arch/powerpc/kernel/mce_power.c +1
-1@@ -374,7 +374,7 @@ static int mce_find_instr_ea_and_phys(struct pt_regs *regs, uint64_t *addr, pfn =addr_to_pfn (regs, regs->nip);if (pfn !=ULONG_MAX ) { instr_addr = (pfn <<PAGE_SHIFT ) + (regs->nip & ~PAGE_MASK ); - instr = *(struct ppc_inst *)(instr_addr); + instr =ppc_inst_read ((struct ppc_inst *)instr_addr);if (!analyse_instr (&op, &tmp, instr)) { pfn =addr_to_pfn (regs, op.ea);arch/powerpc/kernel/mce_power.c +0
-0*addr = op.ea;arch/powerpc/kernel/optprobes.c +1
-2@@ -100,8 +100,8 @@ static unsigned long can_optimize(struct kprobe *p)* Ensure that the instruction is not a conditional branch, * and that can be emulated. */ -if (!is_conditional_branch (*(struct ppc_inst *)p->ainsn.insn) && -analyse_instr (&op, ®s, *(struct ppc_inst *)p- >ainsn.insn) == 1) { + if (!is_conditional_branch(ppc_inst_read((struct ppc_inst *)p-Quoted 1 line
ainsn.insn)) &&
arch/powerpc/kernel/optprobes.c +1
-0+ analyse_instr(&op, ®s, ppc_inst_read((struct
ppc_inst*)p->ainsn.insn)) == 1) {arch/powerpc/kernel/optprobes.c +0
-0emulate_update_regs (®s, &op); nip = regs.nip; }arch/powerpc/kernel/trace/ftrace.c +7
-1@@ -41,6 +41,12 @@#define NUM_FTRACE_TRAMPS 8static unsigned long ftrace_tramps[NUM_FTRACE_TRAMPS ]; +static long +probe_kernel_read_inst (struct ppc_inst *inst,const void *src) +{ +return probe_kernel_read ((void *)inst, src,MCOUNT_INSN_SIZE ); +} +static struct ppc_inst ftrace_call_replace (unsigned long ip,unsigned long addr,int link) {@@ -68,7 +74,7 @@ ftrace_modify_code(unsigned long ip, struct ppc_inst old,struct ppc_inst new) */ /* read the text we want to modify */ -if (probe_kernel_read (&replaced, (void *)ip,MCOUNT_INSN_SIZE )) +if (probe_kernel_read_inst (&replaced, (void *)ip))return -EFAULT ;arch/powerpc/kernel/trace/ftrace.c +4
-4/* Make sure it is what we expect it to be */ @@ -130,7 +136,7 @@ __ftrace_make_nop(struct module *mod,struct ppc_inst op, pop;/* read where this goes */ -if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)ip)) {pr_err ("Fetching opcode failed.\n" );return -EFAULT ; }@@ -164,7 +170,7 @@ __ftrace_make_nop(struct module *mod,/* When using -mkernel_profile there is no load to jump over */ pop =ppc_inst (PPC_INST_NOP ); -if (probe_kernel_read (&op, (void *)(ip -4 ),4 )) { +if (probe_kernel_read_inst (&op, (void *)(ip -4 ))) {pr_err ("Fetching instruction at %lx failed.\n" , ip -4 );return -EFAULT ; }@@ -196,7 +202,7 @@ __ftrace_make_nop(struct module *mod,* Check what is in the next instruction. We can see ld r2,40(r1), but * on first pass after boot we will see mflr r0. */ -if (probe_kernel_read (&op, (void *)(ip+4 ),MCOUNT_INSN_SIZE )) { +if (probe_kernel_read_inst (&op, (void *)(ip+4 ))) {pr_err ("Fetching op failed.\n" );return -EFAULT ; }@@ -348,7 +354,7 @@ static int setup_mcount_compiler_tramp(unsigned long tramp)return -1 ;/* New trampoline -- read where this goes */ -if (probe_kernel_read (&op, (void *)tramp,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)tramp)) {pr_debug ("Fetching opcode failed.\n" );return -1 ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -398,7 +404,7 @@ static int __ftrace_make_nop_kernel(struct dyn_ftrace *rec, unsigned long addr)struct ppc_inst op;/* Read where this goes */ -if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)ip)) {pr_err ("Fetching opcode failed.\n" );return -EFAULT ;arch/powerpc/kernel/trace/ftrace.c +4
-1}@@ -524,7 +530,10 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)struct module *mod = rec->arch.mod;/* read where this goes */ -if (probe_kernel_read (op, ip,sizeof (op))) +if (probe_kernel_read_inst (op, ip)) +return -EFAULT ; + +if (probe_kernel_read_inst (op +1 , ip +4 ))return -EFAULT ;arch/powerpc/kernel/trace/ftrace.c +1
-1if (!expected_nop_sequence (ip, op[0 ], op[1 ])) {@@ -587,7 +596,7 @@ __ftrace_make_call(struct dyn_ftrace *rec, unsigned long addr)unsigned long ip = rec->ip;/* read where this goes */ -if (probe_kernel_read (&op, (void *)ip,MCOUNT_INSN_SIZE )) +if (probe_kernel_read_inst (&op, (void *)ip))return -EFAULT ;arch/powerpc/kernel/trace/ftrace.c +1
-1/* It should be pointing to a nop */ @@ -643,7 +652,7 @@ static int __ftrace_make_call_kernel(struct dyn_ftrace *rec, unsigned long addr) }/* Make sure we have a nop */ -if (probe_kernel_read (&op, ip,sizeof (op))) { +if (probe_kernel_read_inst (&op, ip)) {pr_err ("Unable to read ftrace location %p\n" , ip);return -EFAULT ;arch/powerpc/kernel/trace/ftrace.c +1
-1}@@ -721,7 +730,7 @@ __ftrace_modify_call(struct dyn_ftrace *rec, unsigned long old_addr, }/* read where this goes */ -if (probe_kernel_read (&op, (void *)ip,sizeof (int ))) { +if (probe_kernel_read_inst (&op, (void *)ip)) {pr_err ("Fetching opcode failed.\n" );return -EFAULT ;arch/powerpc/kernel/trace/ftrace.c +2
-2}@@ -846,7 +855,7 @@ int ftrace_update_ftrace_func(ftrace_func_t func)struct ppc_inst old, new;int ret; - old = *(struct ppc_inst *)&ftrace_call; + old =ppc_inst_read ((struct ppc_inst *)&ftrace_call); new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new);@@ -854,7 +863,7 @@ int ftrace_update_ftrace_func(ftrace_func_t func)/* Also update the regs callback function */ if (!ret) { ip = (unsigned long )(&ftrace_regs_call); - old = *(struct ppc_inst *)&ftrace_regs_call; + old =ppc_inst_read ((struct ppc_inst *)&ftrace_regs_call); new =ftrace_call_replace (ip, (unsigned long )func,1 ); ret =ftrace_modify_code (ip, old, new); }arch/powerpc/lib/code- renamed from arch/powerpc/lib/code-patching.c +0
-0
patching.c
index91be4a0b51cb..ba08f3815d00100644arch/powerpc/lib/code-patching.c +2
-2@@ -349,9 +349,9 @@ static unsigned long branch_bform_target(const struct ppc_inst *instr)unsigned long branch_target (const struct ppc_inst *instr) { -if (instr_is_branch_iform (*instr)) +if (instr_is_branch_iform (ppc_inst_read (instr)))return branch_iform_target (instr); -else if (instr_is_branch_bform (*instr)) +else if (instr_is_branch_bform (ppc_inst_read (instr)))return branch_bform_target (instr);arch/powerpc/lib/code-patching.c +1
-1return 0 ;@@ -359,7 +359,7 @@ unsigned long branch_target(const struct ppc_inst *instr)int instr_is_branch_to_addr (const struct ppc_inst *instr,unsigned long addr) { -if (instr_is_branch_iform (*instr) ||instr_is_branch_bform (*instr)) +if (instr_is_branch_iform (ppc_inst_read (instr)) ||instr_is_branch_bform (ppc_inst_read (instr)))return branch_target (instr) == addr;arch/powerpc/lib/code-patching.c +2
-5return 0 ;@@ -368,13 +368,12 @@ int instr_is_branch_to_addr(const struct ppc_inst *instr, unsigned long addr)int translate_branch (struct ppc_inst *instr,const struct ppc_inst *dest,const struct ppc_inst *src) {unsigned long target; - target =branch_target (src); -if (instr_is_branch_iform (*src)) -return create_branch (instr, dest, target,ppc_inst_val (*src)); -else if (instr_is_branch_bform (*src)) -return create_cond_branch (instr, dest, target, ppc_inst_val(*src)); +if (instr_is_branch_iform (ppc_inst_read (src))) + return create_branch(instr, dest, target,ppc_inst_val(ppc_inst_read(src)));
arch/powerpc/lib/code-patching.c +2
-0+else if (instr_is_branch_bform (ppc_inst_read (src))) + return create_cond_branch(instr, dest, target,ppc_inst_val(ppc_inst_read(src)));
arch/powerpc/lib/code-patching.c +4
-4return 1 ; }@@ -598,7 +597,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x4a000000 ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x4a000000 )));/* Maximum positive case, move x to x - 32 MB + 4 */ p = buf +0x2000000 ;@@ -609,7 +608,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x49fffffc ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x49fffffc )));/* Jump to x + 16 MB moved to x + 20 MB */ p = buf;@@ -655,7 +654,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x43ff8000 ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x43ff8000 )));/* Maximum positive case, move x to x - 32 KB + 4 */ p = buf +0x8000 ;@@ -667,7 +666,7 @@ static void __init test_translate_branch(void)patch_instruction (q, instr);check (instr_is_branch_to_addr (p, addr));check (instr_is_branch_to_addr (q, addr)); -check (ppc_inst_equal (*q,ppc_inst (0x43ff7ffc ))); +check (ppc_inst_equal (ppc_inst_read (q),ppc_inst (0x43ff7ffc )));/* Jump to x + 12 KB moved to x + 20 KB */ p = buf;arch/powerpc/lib/feature- renamed from arch/powerpc/lib/feature-fixups.c +0
-0
fixups.c
index8c5d0db77013..f00dd13b1c3c100644arch/powerpc/lib/feature-fixups.c +1
-1@@ -48,7 +48,7 @@ static int patch_alt_instruction(struct ppc_inst *src,struct ppc_inst *dest, int err;struct ppc_inst instr; - instr = *src; + instr =ppc_inst_read (src);if (instr_is_relative_branch (*src)) {struct
ppc_inst*target = (structppc_inst
*)branch_target(src);arch/powerpc/xmon/xmon.c +2
-2@@ -705,13 +705,13 @@ static int xmon_core(struct pt_regs *regs, int fromipi)if ((regs->msr & (MSR_IR |MSR_PR |MSR_64BIT )) == (MSR_IR |MSR_64BIT )) { bp =at_breakpoint (regs->nip);if (bp !=NULL ) { -int stepped =emulate_step (regs, bp->instr[0 ]); +int stepped =emulate_step (regs,ppc_inst_read (bp- >instr));if (stepped ==0 ) { regs->nip = (unsigned long ) &bp->instr[0 ];atomic_inc (&bp->ref_count); }else if (stepped <0 ) {printf ("Couldn't single-step %s instruction\n" , - (IS_RFID (bp->instr[0 ])?"rfid" :"mtmsrd" )); +IS_RFID (ppc_inst_read (bp->instr))?"rfid" :"mtmsrd" ); }arch/powerpc/xmon/xmon.c +1
-1} }@@ -952,7 +952,7 @@ static void remove_bpts(void)if (mread (bp->address, &instr,4 ) ==4 &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( - (struct ppc_inst *)bp->address, bp->instr[0 ]) !=0 ) + (struct ppc_inst *)bp->address,ppc_inst_read (bp- >instr)) != 0)printf ("Couldn't remove breakpoint at %lx\n" , bp->address);}
PATCH v5 11/21 powerpc: Define and use __get_user_instr{, inatomic}()
In reply to Jordan NietheDefine specific __get_user_instr() and __get_user_instr_inatomic() macros for reading instructions from user space.
--- arch/powerpc/include/asm/uaccess.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/kernel/hw_breakpoint.c | 2 +- arch/powerpc/kernel/vecemu.c | 2 +- 4 files changed, 8 insertions(+), 3 deletions(-)
arch/powerpc/include/asm/uaccess.h +5 -0
@@ -105,6 +105,11 @@ static inline int __access_ok(unsigned long addr, unsigned long size,#define __put_user_inatomic (x, ptr) \ __put_user_nosleep((__typeof__(*(ptr)))(x), (ptr), sizeof(*(ptr))) +#define __get_user_instr (x, ptr) \ + __get_user_nocheck((x).val, (u32 *)(ptr), sizeof(u32), true) + +#define __get_user_instr_inatomic (x, ptr) \ + __get_user_nosleep((x).val, (u32 *)(ptr), sizeof(u32))extern long __put_user_bad (void );/*
arch/powerpc/kernel/align.c +1 -1
@@ -304,7 +304,7 @@ int fix_alignment(struct pt_regs *regs)*/ CHECK_FULL_REGS (regs); -if (unlikely (__get_user (instr.val, (unsigned int __user *)regs->nip))) +if (unlikely (__get_user_instr (instr, (void __user *)regs->nip)))return -EFAULT ;if ((regs->msr &MSR_LE ) != (MSR_KERNEL &MSR_LE )) {/* We don't handle PPC little-endian any more... */
arch/powerpc/kernel/hw_breakpoint.c +1 -1
@@ -249,7 +249,7 @@ static bool stepping_handler(struct pt_regs *regs, struct perf_event *bp,struct instruction_op op;unsigned long addr = info->address; -if (__get_user_inatomic (instr.val, (unsigned int *)regs->nip)) +if (__get_user_instr_inatomic (instr, (void __user *)regs->nip)) goto fail; ret =analyse_instr (&op, regs, instr);
arch/powerpc/kernel/vecemu.c +1 -1
@@ -266,7 +266,7 @@ int emulate_altivec(struct pt_regs *regs)unsigned int va, vb, vc, vd;vector128 *vrs; -if (get_user (instr.val, (unsigned int __user *) regs->nip)) +if (__get_user_instr (instr, (void __user *) regs->nip))return -EFAULT ; word =ppc_inst_val (instr);
Signature · 1 line
2.17.1
Re: [PATCH v5 11/21] powerpc: Define and use __get_user_instr{, inatomic}()
Quoted 17 lines · Jordan Niethe
Define specific
__get_user_instr()and__get_user_instr_inatomic()macros for reading instructions from user space.Signed-off-by Jordan Niethe <[email protected]>--- arch/powerpc/include/asm/uaccess.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/kernel/hw_breakpoint.c | 2 +- arch/powerpc/kernel/vecemu.c | 2 +- 4 files changed, 8 insertions(+), 3 deletions(-)arch/powerpc/include/asm/uaccess.h +0
-0
arch/powerpc/include/asm/uaccess.h static inline int __access_ok(unsigned long addr, · line 113
Quoted 9 lines
arch/powerpc/include/asm/uaccess.h +5
-0@@ -105,6 +105,11 @@ static inline int __access_ok(unsigned long addr,unsigned long size, #define __put_user_inatomic(x, ptr) \ __put_user_nosleep((__typeof__(*(ptr)))(x), (ptr), sizeof(*(ptr))) +#define __get_user_instr(x, ptr) \ + __get_user_nocheck((x).val, (u32 *)(ptr), sizeof(u32), true) + +#define __get_user_instr_inatomic(x, ptr) \ + __get_user_nosleep((x).val, (u32 *)(ptr), sizeof(u32))
should we use ppc_inst_val() ?
-- Bala
Quoted 44 lines
arch/powerpc/include/asm/uaccess.h +0
-0extern long __put_user_bad (void );/*
arch/powerpc/kernel/align.c +1
-1@@ -304,7 +304,7 @@ int fix_alignment(struct pt_regs *regs)*/ CHECK_FULL_REGS (regs); -if (unlikely (__get_user (instr.val, (unsigned int __user *)regs->nip))) +if (unlikely (__get_user_instr (instr, (void __user *)regs->nip)))return -EFAULT ;if ((regs->msr &MSR_LE ) != (MSR_KERNEL &MSR_LE )) {/* We don't handle PPC little-endian any more... */ arch/powerpc/kernel/hw_breakpoint.c +1
-1@@ -249,7 +249,7 @@ static bool stepping_handler(struct pt_regs *regs, structperf_event *bp, struct instruction_op op;unsigned long addr = info->address; -if (__get_user_inatomic (instr.val, (unsigned int *)regs->nip)) +if (__get_user_instr_inatomic (instr, (void __user *)regs->nip)) goto fail;arch/powerpc/kernel/hw_breakpoint.c +0
-0ret =analyse_instr (&op, regs, instr);arch/powerpc/kernel/vecemu.c +1
-1@@ -266,7 +266,7 @@ int emulate_altivec(struct pt_regs *regs)unsigned int va, vb, vc, vd;vector128 *vrs; -if (get_user (instr.val, (unsigned int __user *) regs->nip)) +if (__get_user_instr (instr, (void __user *) regs->nip))return -EFAULT ; word =ppc_inst_val (instr);
Re: [PATCH v5 11/21] powerpc: Define and use __get_user_instr{, inatomic}()
Quoted 23 lines · Balamuruhan S
Quoted 21 lines · Jordan Niethe
Define specific
__get_user_instr()and__get_user_instr_inatomic()macros for reading instructions from user space.Signed-off-by Jordan Niethe <[email protected]>--- arch/powerpc/include/asm/uaccess.h | 5 +++++ arch/powerpc/kernel/align.c | 2 +- arch/powerpc/kernel/hw_breakpoint.c | 2 +- arch/powerpc/kernel/vecemu.c | 2 +- 4 files changed, 8 insertions(+), 3 deletions(-)arch/powerpc/include/asm/uaccess.h +0
-0@@ -105,6 +105,11 @@ static inline int __access_ok(unsigned long addr,unsigned long size, #define __put_user_inatomic(x, ptr) \ __put_user_nosleep((__typeof__(*(ptr)))(x), (ptr), sizeof(*(ptr)))
Quoted 8 lines
arch/powerpc/include/asm/uaccess.h static inline int __access_ok(unsigned long addr, unsigned long size, · line 112
Quoted 5 lines
arch/powerpc/include/asm/uaccess.h +5
-0+#define __get_user_instr (x, ptr) \ + __get_user_nocheck((x).val, (u32 *)(ptr), sizeof(u32), true) + +#define __get_user_instr_inatomic (x, ptr) \ + __get_user_nosleep((x).val, (u32 *)(ptr), sizeof(u32))should we use
ppc_inst_val()?
The __get_user() macros load a value into the given variable, so we can not use ppc_inst_val().
Quoted 49 lines
-- Bala
Quoted 44 lines
arch/powerpc/include/asm/uaccess.h +0
-0extern long __put_user_bad (void );/*
arch/powerpc/kernel/align.c +1
-1@@ -304,7 +304,7 @@ int fix_alignment(struct pt_regs *regs)*/ CHECK_FULL_REGS (regs); -if (unlikely (__get_user (instr.val, (unsigned int __user *)regs->nip))) +if (unlikely (__get_user_instr (instr, (void __user *)regs->nip)))return -EFAULT ;if ((regs->msr &MSR_LE ) != (MSR_KERNEL &MSR_LE )) {/* We don't handle PPC little-endian any more... */ arch/powerpc/kernel/hw_breakpoint.c +1
-1@@ -249,7 +249,7 @@ static bool stepping_handler(struct pt_regs *regs, structperf_event *bp, struct instruction_op op;unsigned long addr = info->address; -if (__get_user_inatomic (instr.val, (unsigned int *)regs->nip)) +if (__get_user_instr_inatomic (instr, (void __user *)regs->nip)) goto fail;ret = analyse_instr(&op, regs, instr);arch/powerpc/kernel/vecemu.c +1
-1@@ -266,7 +266,7 @@ int emulate_altivec(struct pt_regs *regs)unsigned int va, vb, vc, vd;vector128 *vrs; -if (get_user (instr.val, (unsigned int __user *) regs->nip)) +if (__get_user_instr (instr, (void __user *) regs->nip))return -EFAULT ; word =ppc_inst_val (instr);
PATCH v5 12/21 powerpc: Introduce a function for reporting instruction length
In reply to Jordan NietheCurrently all instructions have the same length, but in preparation for prefixed instructions introduce a function for returning instruction length.
--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/kprobes.c | 6 ++++-- arch/powerpc/kernel/uprobes.c | 2 +- 3 files changed, 10 insertions(+), 3 deletions(-)
arch/powerpc/include/asm/inst.h +5 -0
@@ -17,6 +17,11 @@ static inline u32 ppc_inst_val(struct ppc_inst x)return x.val; } +static inline bool ppc_inst_len (struct ppc_inst x) +{ +return sizeof (struct ppc_inst ); +} +static inline int ppc_inst_opcode (struct ppc_inst x) {return x.val >>26 ;
arch/powerpc/kernel/kprobes.c +4 -2
@@ -474,14 +474,16 @@ NOKPROBE_SYMBOL(trampoline_probe_handler);*/ int kprobe_post_handler (struct pt_regs *regs) { +int len;struct kprobe *cur =kprobe_running ();struct kprobe_ctlblk *kcb =get_kprobe_ctlblk ();if (!cur ||user_mode (regs))return 0 ; + len =ppc_inst_len (ppc_inst_read ((struct ppc_inst *)cur->ainsn.insn));/* make sure we got here for instruction we have a kprobe on */ -if (((unsigned long )cur->ainsn.insn +4 ) != regs->nip) +if (((unsigned long )cur->ainsn.insn + len) != regs->nip)return 0 ;if ((kcb->kprobe_status !=KPROBE_REENTER ) && cur->post_handler) {
@@ -490,7 +492,7 @@ int kprobe_post_handler(struct pt_regs *regs) }/* Adjust nip to after the single-stepped instruction */ - regs->nip = (unsigned long )cur->addr +4 ; + regs->nip = (unsigned long )cur->addr + len; regs->msr |= kcb->kprobe_saved_msr;/*Restore back the original saved kprobes variables and continue. */
arch/powerpc/kernel/uprobes.c +1 -1
@@ -112,7 +112,7 @@ int arch_uprobe_post_xol(struct arch_uprobe *auprobe, struct pt_regs *regs)* support doesn't exist and have to fix-up the next instruction * to be executed. */ - regs->nip = utask->vaddr +MAX_UINSN_BYTES ; + regs->nip = utask->vaddr +ppc_inst_len (auprobe->insn);user_disable_single_step (current);return 0 ;
Signature · 1 line
2.17.1
Re: [PATCH v5 12/21] powerpc: Introduce a function for reporting instruction length
Quoted 17 lines · Jordan Niethe
Currently all instructions have the same length, but in preparation for prefixed instructions introduce a function for returning instruction length.
Signed-off-by Jordan Niethe <[email protected]>--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/kprobes.c | 6 ++++-- arch/powerpc/kernel/uprobes.c | 2 +- 3 files changed, 10 insertions(+), 3 deletions(-)arch/powerpc/include/asm/inst.h +0
-0
arch/powerpc/include/asm/inst.h static inline u32 ppc_inst_val(struct ppc_inst x) · line 20
Quoted 4 lines
arch/powerpc/include/asm/inst.h +1
-0@@ -17,6 +17,11 @@ static inline u32 ppc_inst_val(struct ppc_inst x)return x.val; } +static inline bool ppc_inst_len (struct ppc_inst x)
return type shouldn't be a bool, size_t instead.
-- Bala
Quoted 52 lines
arch/powerpc/include/asm/inst.h +4
-0+{ +return sizeof (struct ppc_inst ); +} +static inline int ppc_inst_opcode (struct ppc_inst x) {return x.val >>26 ;arch/powerpc/kernel/kprobes.c +4
-2@@ -474,14 +474,16 @@ NOKPROBE_SYMBOL(trampoline_probe_handler);*/ int kprobe_post_handler (struct pt_regs *regs) { +int len;struct kprobe *cur =kprobe_running ();struct kprobe_ctlblk *kcb =get_kprobe_ctlblk ();if (!cur ||user_mode (regs))return 0 ; + len =ppc_inst_len (ppc_inst_read ((struct ppc_inst *)cur->ainsn.insn));/* make sure we got here for instruction we have a kprobe on */ -if (((unsigned long )cur->ainsn.insn +4 ) != regs->nip) +if (((unsigned long )cur->ainsn.insn + len) != regs->nip)return 0 ;if ((kcb->kprobe_status !=KPROBE_REENTER ) && cur->post_handler) {@@ -490,7 +492,7 @@ int kprobe_post_handler(struct pt_regs *regs) }/* Adjust nip to after the single-stepped instruction */ - regs->nip = (unsigned long )cur->addr +4 ; + regs->nip = (unsigned long )cur->addr + len; regs->msr |= kcb->kprobe_saved_msr;/*Restore back the original saved kprobes variables and continue. */ arch/powerpc/kernel/uprobes.c +1
-1@@ -112,7 +112,7 @@ int arch_uprobe_post_xol(struct arch_uprobe *auprobe,struct pt_regs *regs) * support doesn't exist and have to fix-up the next instruction * to be executed. */ - regs->nip = utask->vaddr +MAX_UINSN_BYTES ; + regs->nip = utask->vaddr +ppc_inst_len (auprobe->insn);user_disable_single_step (current);return 0;
Re: [PATCH v5 12/21] powerpc: Introduce a function for reporting instruction length
Quoted 22 lines · Balamuruhan S
Quoted 20 lines · Jordan Niethe
Currently all instructions have the same length, but in preparation for prefixed instructions introduce a function for returning instruction length.
Signed-off-by Jordan Niethe <[email protected]>--- arch/powerpc/include/asm/inst.h | 5 +++++ arch/powerpc/kernel/kprobes.c | 6 ++++-- arch/powerpc/kernel/uprobes.c | 2 +- 3 files changed, 10 insertions(+), 3 deletions(-)arch/powerpc/include/asm/inst.h +0
-0@@ -17,6 +17,11 @@ static inline u32 ppc_inst_val(struct ppc_inst x)return x.val; }
Quoted 4 lines
arch/powerpc/include/asm/inst.h static inline u32 ppc_inst_val(struct ppc_inst x) · line 20
Quoted 1 line
arch/powerpc/include/asm/inst.h +1
-0+static inline bool ppc_inst_len (struct ppc_inst x)return type shouldn't be a bool,
size_tinstead.
Thank you.
Quoted 56 lines
-- Bala
Quoted 52 lines
arch/powerpc/include/asm/inst.h +4
-0+{ +return sizeof (struct ppc_inst ); +} +static inline int ppc_inst_opcode (struct ppc_inst x) {return x.val >>26 ;arch/powerpc/kernel/kprobes.c +4
-2@@ -474,14 +474,16 @@ NOKPROBE_SYMBOL(trampoline_probe_handler);*/ int kprobe_post_handler (struct pt_regs *regs) { +int len;struct kprobe *cur =kprobe_running ();struct kprobe_ctlblk *kcb =get_kprobe_ctlblk ();if (!cur ||user_mode (regs))return 0 ; + len =ppc_inst_len (ppc_inst_read ((struct ppc_inst *)cur->ainsn.insn));/* make sure we got here for instruction we have a kprobe on */ -if (((unsigned long )cur->ainsn.insn +4 ) != regs->nip) +if (((unsigned long )cur->ainsn.insn + len) != regs->nip)return 0 ;if ((kcb->kprobe_status !=KPROBE_REENTER ) && cur->post_handler) {@@ -490,7 +492,7 @@ int kprobe_post_handler(struct pt_regs *regs) }/* Adjust nip to after the single-stepped instruction */ - regs->nip = (unsigned long )cur->addr +4 ; + regs->nip = (unsigned long )cur->addr + len; regs->msr |= kcb->kprobe_saved_msr;/*Restore back the original saved kprobes variables and continue. */ arch/powerpc/kernel/uprobes.c +1
-1@@ -112,7 +112,7 @@ int arch_uprobe_post_xol(struct arch_uprobe *auprobe,struct pt_regs *regs) * support doesn't exist and have to fix-up the next instruction * to be executed. */ - regs->nip = utask->vaddr +MAX_UINSN_BYTES ; + regs->nip = utask->vaddr +ppc_inst_len (auprobe->insn);user_disable_single_step (current);return 0;
PATCH v5 13/21 powerpc/xmon: Use a function for reading instructions
In reply to Jordan NietheCurrently in xmon, mread() is used for reading instructions. In preparation for prefixed instructions, create and use a new function, mread_instr(), especially for reading instructions.
---
v5: New to series, seperated from "Add prefixed instructions to instruction data type"
--- arch/powerpc/xmon/xmon.c | 24 ++++++++++++++++++++---- 1 file changed, 20 insertions(+), 4 deletions(-)
arch/powerpc/xmon/xmon.c +20 -4
@@ -125,6 +125,7 @@ extern unsigned int bpt_table[NBPTS * BPT_WORDS];static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );static int mwrite (unsigned long ,void *,int ); +static int mread_instr (unsigned long ,struct ppc_inst *);static int handle_fault (struct pt_regs *);static void byterev (unsigned char *,int );static void memex (void );
@@ -899,7 +900,7 @@ static void insert_bpts(void)for (i =0 ; i <NBPTS ; ++i, ++bp) {if ((bp->enabled & (BP_TRAP |BP_CIABR )) ==0 )continue ; -if (mread (bp->address, &instr,4 ) !=4 ) { +if (!mread_instr (bp->address, &instr)) {printf ("Couldn't read instruction at %lx, " "disabling breakpoint there\n" , bp->address); bp->enabled =0 ;
@@ -949,7 +950,7 @@ static void remove_bpts(void)for (i =0 ; i <NBPTS ; ++i, ++bp) {if ((bp->enabled & (BP_TRAP |BP_CIABR )) !=BP_TRAP )continue ; -if (mread (bp->address, &instr,4 ) ==4 +if (mread_instr (bp->address, &instr) &&ppc_inst_equal (instr,ppc_inst (bpinstr)) &&patch_instruction ( (struct ppc_inst *)bp->address,ppc_inst_read (bp->instr)) !=0 )
@@ -1165,7 +1166,7 @@ static int do_step(struct pt_regs *regs)force_enable_xmon ();/* check we are in 64-bit kernel mode, translation enabled */ if ((regs->msr & (MSR_64BIT |MSR_PR |MSR_IR )) == (MSR_64BIT |MSR_IR )) { -if (mread (regs->nip, &instr,4 ) ==4 ) { +if (mread_instr (regs->nip, &instr)) { stepped =emulate_step (regs, instr);if (stepped <0 ) { printf("Couldn't single-step %s instruction\n",
@@ -1332,7 +1333,7 @@ static long check_bp_loc(unsigned long addr)printf ("Breakpoints may only be placed at kernel addresses\n" );return 0 ; } -if (!mread (addr, &instr,sizeof (instr))) { +if (!mread_instr (addr, &instr)) {printf ("Can't read instruction at address %lx\n" , addr);return 0 ; }
@@ -2125,6 +2126,21 @@ mwrite(unsigned long adrs, void *buf, int size)return n; } +static int +mread_instr (unsigned long adrs,struct ppc_inst *instr) +{ +if (setjmp (bus_error_jmp) ==0 ) { + catch_memory_errors =1 ; +sync (); + *instr =ppc_inst_read ((struct ppc_inst *)adrs); +sync (); +/* wait a little while to see if we get a machine check */ +__delay (200 ); + } + catch_memory_errors =0 ; +return ppc_inst_len (*instr); +} +static int fault_type;static int fault_except;static char *fault_chars[] = {"--" ,"**" ,"##" };
Signature · 1 line
2.17.1
Re: [PATCH v5 13/21] powerpc/xmon: Use a function for reading instructions
Quoted 25 lines · Jordan Niethe
Currently in xmon,
mread()is used for reading instructions. In preparation for prefixed instructions, create and use a new function,mread_instr(), especially for reading instructions.Signed-off-by Jordan Niethe <[email protected]>---
v5: New to series, seperated from "Add prefixed instructions to instruction data type"--- arch/powerpc/xmon/xmon.c | 24 ++++++++++++++++++++---- 1 file changed, 20 insertions(+), 4 deletions(-)arch/powerpc/xmon/xmon.c +1
-0@@ -125,6 +125,7 @@ extern unsigned int bpt_table[NBPTS * BPT_WORDS];static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );static int mwrite (unsigned long ,void *,int ); +static int mread_instr (unsigned long ,struct ppc_inst *);static int handle_fault (struct pt_regs *);static void byterev (unsigned char *,int );static void memex (void );
arch/powerpc/xmon/xmon.c static void insert_bpts(void) · line 903
Quoted 5 lines
arch/powerpc/xmon/xmon.c +1
-1@@ -899,7 +900,7 @@ static void insert_bpts(void)for (i =0 ; i <NBPTS ; ++i, ++bp) {if ((bp->enabled & (BP_TRAP |BP_CIABR )) ==0 )continue ; -if (mread (bp->address, &instr,4 ) !=4 ) { +if (!mread_instr (bp->address, &instr)) {
Are these checks made based on whether ppc_inst_len() returns bool from mread_instr() ?
-- Bala
Quoted 53 lines
arch/powerpc/xmon/xmon.c +1
-1printf ("Couldn't read instruction at %lx, " "disabling breakpoint there\n" , bp->address); bp->enabled =0 ;@@ -949,7 +950,7 @@ static void remove_bpts(void) for (i = 0; i < NBPTS; ++i, ++bp) { if ((bp->enabled & (BP_TRAP|BP_CIABR)) != BP_TRAP) continue; - if (mread(bp->address, &instr, 4) == 4 + if (mread_instr(bp->address, &instr) && ppc_inst_equal(instr, ppc_inst(bpinstr)) && patch_instruction( (struct ppc_inst *)bp->address, ppc_inst_read(bp-Quoted 1 line
instr)) != 0)
arch/powerpc/xmon/xmon.c +17
-2@@ -1165,7 +1166,7 @@ static int do_step(struct pt_regs *regs)force_enable_xmon ();/* check we are in 64-bit kernel mode, translation enabled */ if ((regs->msr & (MSR_64BIT |MSR_PR |MSR_IR )) == (MSR_64BIT |MSR_IR )) { -if (mread (regs->nip, &instr,4 ) ==4 ) { +if (mread_instr (regs->nip, &instr)) { stepped =emulate_step (regs, instr);if (stepped <0 ) { printf("Couldn't single-step %s instruction\n",@@ -1332,7 +1333,7 @@ static long check_bp_loc(unsigned long addr)printf ("Breakpoints may only be placed at kernel addresses\n" );return 0 ; } -if (!mread (addr, &instr,sizeof (instr))) { +if (!mread_instr (addr, &instr)) {printf ("Can't read instruction at address %lx\n" , addr);return 0 ; }@@ -2125,6 +2126,21 @@ mwrite(unsigned long adrs, void *buf, int size)return n; } +static int +mread_instr (unsigned long adrs,struct ppc_inst *instr) +{ +if (setjmp (bus_error_jmp) ==0 ) { + catch_memory_errors =1 ; +sync (); + *instr =ppc_inst_read ((struct ppc_inst *)adrs); +sync (); +/* wait a little while to see if we get a machine check */ +__delay (200 ); + } + catch_memory_errors =0 ; +return ppc_inst_len (*instr); +} +static int fault_type;static int fault_except;static char *fault_chars[] = {"--" ,"**" ,"##" };
Re: [PATCH v5 13/21] powerpc/xmon: Use a function for reading instructions
Quoted 28 lines · Balamuruhan S
Quoted 26 lines · Jordan Niethe
Currently in xmon,
mread()is used for reading instructions. In preparation for prefixed instructions, create and use a new function,mread_instr(), especially for reading instructions.Signed-off-by Jordan Niethe <[email protected]>---
v5: New to series, seperated from "Add prefixed instructions to instruction data type"--- arch/powerpc/xmon/xmon.c | 24 ++++++++++++++++++++---- 1 file changed, 20 insertions(+), 4 deletions(-)arch/powerpc/xmon/xmon.c +1
-0@@ -125,6 +125,7 @@ extern unsigned int bpt_table[NBPTS * BPT_WORDS];static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );static int mwrite (unsigned long ,void *,int ); +static int mread_instr (unsigned long ,struct ppc_inst *);static int handle_fault (struct pt_regs *);static void byterev (unsigned char *,int );static void memex (void );@@ -899,7 +900,7 @@ static void insert_bpts(void)for (i =0 ; i <NBPTS ; ++i, ++bp) {
Quoted 8 lines
arch/powerpc/xmon/xmon.c static void insert_bpts(void) · line 903
Quoted 4 lines
arch/powerpc/xmon/xmon.c +1
-1if ((bp->enabled & (BP_TRAP |BP_CIABR )) ==0 )continue ; -if (mread (bp->address, &instr,4 ) !=4 ) { +if (!mread_instr (bp->address, &instr)) {Are these checks made based on whether
ppc_inst_len()returns bool frommread_instr()?
No, it was meant to be the length itself returned with a length of 0 indicating an error. I will need to fix that.
Quoted 58 lines
-- Bala
Quoted 53 lines
arch/powerpc/xmon/xmon.c +1
-1printf ("Couldn't read instruction at %lx, " "disabling breakpoint there\n" , bp->address); bp->enabled =0 ;@@ -949,7 +950,7 @@ static void remove_bpts(void) for (i = 0; i < NBPTS; ++i, ++bp) { if ((bp->enabled & (BP_TRAP|BP_CIABR)) != BP_TRAP) continue; - if (mread(bp->address, &instr, 4) == 4 + if (mread_instr(bp->address, &instr) && ppc_inst_equal(instr, ppc_inst(bpinstr)) && patch_instruction( (struct ppc_inst *)bp->address, ppc_inst_read(bp-Quoted 1 line
instr)) != 0)
arch/powerpc/xmon/xmon.c +17
-2@@ -1165,7 +1166,7 @@ static int do_step(struct pt_regs *regs)force_enable_xmon ();/* check we are in 64-bit kernel mode, translation enabled */ if ((regs->msr & (MSR_64BIT |MSR_PR |MSR_IR )) == (MSR_64BIT |MSR_IR )) { -if (mread (regs->nip, &instr,4 ) ==4 ) { +if (mread_instr (regs->nip, &instr)) { stepped =emulate_step (regs, instr);if (stepped <0 ) { printf("Couldn't single-step %s instruction\n",@@ -1332,7 +1333,7 @@ static long check_bp_loc(unsigned long addr)printf ("Breakpoints may only be placed at kernel addresses\n" );return 0 ; } -if (!mread (addr, &instr,sizeof (instr))) { +if (!mread_instr (addr, &instr)) {printf ("Can't read instruction at address %lx\n" , addr);return 0 ; }@@ -2125,6 +2126,21 @@ mwrite(unsigned long adrs, void *buf, int size)return n; } +static int +mread_instr (unsigned long adrs,struct ppc_inst *instr) +{ +if (setjmp (bus_error_jmp) ==0 ) { + catch_memory_errors =1 ; +sync (); + *instr =ppc_inst_read ((struct ppc_inst *)adrs); +sync (); +/* wait a little while to see if we get a machine check */ +__delay (200 ); + } + catch_memory_errors =0 ; +return ppc_inst_len (*instr); +} +static int fault_type;static int fault_except;static char *fault_chars[] = {"--" ,"**" ,"##" };
Re: [PATCH v5 13/21] powerpc/xmon: Use a function for reading instructions
Quoted 35 lines · Jordan Niethe
Quoted 26 lines · Balamuruhan S
Quoted 25 lines · Jordan Niethe
Currently in xmon,
mread()is used for reading instructions. In preparation for prefixed instructions, create and use a new function,mread_instr(), especially for reading instructions.Signed-off-by Jordan Niethe <[email protected]>---
v5: New to series, seperated from "Add prefixed instructions to instruction data type"--- arch/powerpc/xmon/xmon.c | 24 ++++++++++++++++++++---- 1 file changed, 20 insertions(+), 4 deletions(-)arch/powerpc/xmon/xmon.c +1
-0@@ -125,6 +125,7 @@ extern unsigned int bpt_table[NBPTS * BPT_WORDS];static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );static int mwrite (unsigned long ,void *,int ); +static int mread_instr (unsigned long ,struct ppc_inst *);static int handle_fault (struct pt_regs *);static void byterev (unsigned char *,int );static void memex (void );@@ -899,7 +900,7 @@ static void insert_bpts(void)Quoted 8 lines
arch/powerpc/xmon/xmon.c static void insert_bpts(void) · line 903
Quoted 5 lines
arch/powerpc/xmon/xmon.c +1
-1for (i =0 ; i <NBPTS ; ++i, ++bp) {if ((bp->enabled & (BP_TRAP |BP_CIABR )) ==0 )continue ; -if (mread (bp->address, &instr,4 ) !=4 ) { +if (!mread_instr (bp->address, &instr)) {Are these checks made based on whether
ppc_inst_len()returns bool frommread_instr()?
Quoted 2 lines
No, it was meant to be the length itself returned with a length of 0 indicating an error. I will need to fix that.
I doubt it would return 0, whether we read instruction or not ppc_inst_len() would always return sizeof(struct ppc_inst).
can we do something like,
static intmread_instr(unsigned long adrs, struct ppc_inst *instr)
{
int size = 0;
if (setjmp(bus_error_jmp) == 0) {
catch_memory_errors = 1;
sync();
*instr = ppc_inst_read((struct ppc_inst *)adrs);
sync();
/* wait a little while to see if we get a machine check */
__delay(200);
size = ppc_inst_len(instr);
}
catch_memory_errors = 0;
return size;
}-- Bala
Quoted 60 lines
Quoted 60 lines
-- Bala
Quoted 57 lines
arch/powerpc/xmon/xmon.c +0
-0printf ("Couldn't read instruction at %lx, " "disabling breakpoint there\n" , bp- >address);bp->enabled = 0;arch/powerpc/xmon/xmon.c +1
-1@@ -949,7 +950,7 @@ static void remove_bpts(void) for (i = 0; i < NBPTS; ++i, ++bp) { if ((bp->enabled & (BP_TRAP|BP_CIABR)) != BP_TRAP) continue; - if (mread(bp->address, &instr, 4) == 4 + if (mread_instr(bp->address, &instr) && ppc_inst_equal(instr, ppc_inst(bpinstr)) && patch_instruction( (struct ppc_inst *)bp->address, ppc_inst_read(bp-Quoted 1 line
instr)) != 0)
arch/powerpc/xmon/xmon.c +1
-1@@ -1165,7 +1166,7 @@ static int do_step(struct pt_regs *regs)force_enable_xmon ();/* check we are in 64-bit kernel mode, translation enabled */ if ((regs->msr & (MSR_64BIT |MSR_PR |MSR_IR )) == (MSR_64BIT |MSR_IR )) { -if (mread (regs->nip, &instr,4 ) ==4 ) { +if (mread_instr (regs->nip, &instr)) { stepped =emulate_step (regs, instr);if (stepped <0 ) {printf("Couldn't single-step %s
instruction\n",arch/powerpc/xmon/xmon.c +1
-1@@ -1332,7 +1333,7 @@ static long check_bp_loc(unsigned long addr)printf ("Breakpoints may only be placed at kernel addresses\n");return 0 ; } -if (!mread (addr, &instr,sizeof (instr))) { +if (!mread_instr (addr, &instr)) {printf ("Can't read instruction at address %lx\n" , addr);return 0 ;}arch/powerpc/xmon/xmon.c +15
-0@@ -2125,6 +2126,21 @@ mwrite(unsigned long adrs, void *buf, int size)return n; } +static int +mread_instr (unsigned long adrs,struct ppc_inst *instr) +{ +if (setjmp (bus_error_jmp) ==0 ) { + catch_memory_errors =1 ; +sync (); + *instr =ppc_inst_read ((struct ppc_inst *)adrs); +sync (); +/* wait a little while to see if we get a machine check */ +__delay (200 ); + } + catch_memory_errors =0 ; +return ppc_inst_len (*instr); +} +static int fault_type;static int fault_except;static char *fault_chars[] = {"--" ,"**" ,"##" };
Re: [PATCH v5 13/21] powerpc/xmon: Use a function for reading instructions
Quoted 37 lines · Balamuruhan S
Quoted 35 lines · Jordan Niethe
Quoted 34 lines · Balamuruhan S
Quoted 25 lines · Jordan Niethe
Currently in xmon,
mread()is used for reading instructions. In preparation for prefixed instructions, create and use a new function,mread_instr(), especially for reading instructions.Signed-off-by Jordan Niethe <[email protected]>---
v5: New to series, seperated from "Add prefixed instructions to instruction data type"--- arch/powerpc/xmon/xmon.c | 24 ++++++++++++++++++++---- 1 file changed, 20 insertions(+), 4 deletions(-)arch/powerpc/xmon/xmon.c +1
-0@@ -125,6 +125,7 @@ extern unsigned int bpt_table[NBPTS * BPT_WORDS];static int cmds (struct pt_regs *);static int mread (unsigned long ,void *,int );static int mwrite (unsigned long ,void *,int ); +static int mread_instr (unsigned long ,struct ppc_inst *);static int handle_fault (struct pt_regs *);static void byterev (unsigned char *,int );static void memex (void );arch/powerpc/xmon/xmon.c static void insert_bpts(void) · line 903
Quoted 5 lines
arch/powerpc/xmon/xmon.c +1
-1@@ -899,7 +900,7 @@ static void insert_bpts(void)for (i =0 ; i <NBPTS ; ++i, ++bp) {if ((bp->enabled & (BP_TRAP |BP_CIABR )) ==0 )continue ; -if (mread (bp->address, &instr,4 ) !=4 ) { +if (!mread_instr (bp->address, &instr)) {Are these checks made based on whether
ppc_inst_len()returns bool frommread_instr()?
Quoted 6 lines
Quoted 2 lines
No, it was meant to be the length itself returned with a length of 0 indicating an error. I will need to fix that.
I doubt it would return 0, whether we read instruction or not
ppc_inst_len()would always returnsizeof(struct ppc_inst).
Yes, sorry I meant I would have to change the function so that it would return 0.
Quoted 5 lines
can we do something like,
static int
mread_instr(unsigned long adrs, struct ppc_inst *instr)
Quoted 14 lines
{
int size = 0;
if (setjmp(bus_error_jmp) == 0) {
catch_memory_errors = 1;
sync();
*instr = ppc_inst_read((struct ppc_inst *)adrs);
sync();
/* wait a little while to see if we get a machine check */
__delay(200);
size = ppc_inst_len(instr);
}
catch_memory_errors = 0;
return size;
}Yeah that looks right.
Quoted 63 lines
-- Bala
Quoted 60 lines
Quoted 60 lines
-- Bala
Quoted 57 lines
arch/powerpc/xmon/xmon.c +0
-0printf ("Couldn't read instruction at %lx, " "disabling breakpoint there\n" , bp- >address);bp->enabled = 0;arch/powerpc/xmon/xmon.c +1
-1@@ -949,7 +950,7 @@ static void remove_bpts(void) for (i = 0; i < NBPTS; ++i, ++bp) { if ((bp->enabled & (BP_TRAP|BP_CIABR)) != BP_TRAP) continue; - if (mread(bp->address, &instr, 4) == 4 + if (mread_instr(bp->address, &instr) && ppc_inst_equal(instr, ppc_inst(bpinstr)) && patch_instruction( (struct ppc_inst *)bp->address, ppc_inst_read(bp-Quoted 1 line
instr)) != 0)
arch/powerpc/xmon/xmon.c +1
-1@@ -1165,7 +1166,7 @@ static int do_step(struct pt_regs *regs)force_enable_xmon ();/* check we are in 64-bit kernel mode, translation enabled */ if ((regs->msr & (MSR_64BIT |MSR_PR |MSR_IR )) == (MSR_64BIT |MSR_IR )) { -if (mread (regs->nip, &instr,4 ) ==4 ) { +if (mread_instr (regs->nip, &instr)) { stepped =emulate_step (regs, instr);if (stepped <0 ) {printf("Couldn't single-step %s
instruction\n",arch/powerpc/xmon/xmon.c +1
-1@@ -1332,7 +1333,7 @@ static long check_bp_loc(unsigned long addr)printf ("Breakpoints may only be placed at kernel addresses\n");return 0 ; } -if (!mread (addr, &instr,sizeof (instr))) { +if (!mread_instr (addr, &instr)) {printf ("Can't read instruction at address %lx\n" , addr);return 0 ;}arch/powerpc/xmon/xmon.c +15
-0@@ -2125,6 +2126,21 @@ mwrite(unsigned long adrs, void *buf, int size)return n; } +static int +mread_instr (unsigned long adrs,struct ppc_inst *instr) +{ +if (setjmp (bus_error_jmp) ==0 ) { + catch_memory_errors =1 ; +sync (); + *instr =ppc_inst_read ((struct ppc_inst *)adrs); +sync (); +/* wait a little while to see if we get a machine check */ +__delay (200 ); + } + catch_memory_errors =0 ; +return ppc_inst_len (*instr); +} +static int fault_type;static int fault_except;static char *fault_chars[] = {"--" ,"**" ,"##" };
PATCH v5 14/21 powerpc/xmon: Move insertion of breakpoint for xol'ing
In reply to Jordan NietheWhen a new breakpoint is created, the second instruction of that breakpoint is patched with a trap instruction. This assumes the length of the instruction is always the same. In preparation for prefixed instructions, remove this assumption. Insert the trap instruction at the same time the first instruction is inserted.
--- arch/powerpc/xmon/xmon.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
arch/powerpc/xmon/xmon.c +1 -1
@@ -881,7 +881,6 @@ static struct bpt *new_breakpoint(unsigned long a)if (!bp->enabled &&atomic_read (&bp->ref_count) ==0 ) { bp->address = a; bp->instr = (void *)(bpt_table + ((bp - bpts) *BPT_WORDS )); -patch_instruction (bp->instr +1 ,ppc_inst (bpinstr));return bp; } }
@@ -913,6 +912,7 @@ static void insert_bpts(void)continue ; }patch_instruction (bp->instr, instr); +patch_instruction ((void *)bp->instr +ppc_inst_len (instr),ppc_inst (bpinstr));if (bp->enabled &BP_CIABR )continue ; if (patch_instruction((struct ppc_inst *)bp->address,
Signature · 1 line
2.17.1
PATCH v5 15/21 powerpc: Make test_translate_branch() independent of instruction length
In reply to Jordan Niethetest_translate_branch() uses two pointers to instructions within a buffer, p and q, to test patch_branch(). The pointer arithmetic done on them assumes a size of 4. This will not work if the instruction length changes. Instead do the arithmetic relative to the void * to the buffer.
---
v4: New to series
--- arch/powerpc/lib/code-patching.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
arch/powerpc/lib/code-patching.c +3 -3
@@ -569,7 +569,7 @@ static void __init test_branch_bform(void)static void __init test_translate_branch (void ) {unsigned long addr; -struct ppc_inst *p, *q; +void *p, *q;struct ppc_inst instr;void *buf;
@@ -583,7 +583,7 @@ static void __init test_translate_branch(void) addr = (unsigned long )p;patch_branch (p, addr,0 );check (instr_is_branch_to_addr (p, addr)); - q = p +1 ; + q = p +4 ;translate_branch (&instr, q, p);patch_instruction (q, instr);check (instr_is_branch_to_addr (q, addr));
@@ -639,7 +639,7 @@ static void __init test_translate_branch(void)create_cond_branch (&instr, p, addr,0 );patch_instruction (p, instr);check (instr_is_branch_to_addr (p, addr)); - q = p +1 ; + q = buf +4 ;translate_branch (&instr, q, p);patch_instruction (q, instr);check (instr_is_branch_to_addr (q, addr));
Signature · 1 line
2.17.1
PATCH v5 16/21 powerpc: Enable Prefixed Instructions
In reply to Jordan NietheFrom: Alistair Popple <[email protected]>
Prefix instructions have their own FSCR bit which needs to enabled via a CPU feature. The kernel will save the FSCR for problem state but it needs to be enabled initially.
If prefixed instructions are made unavailable by the [H]FSCR, attempting to use them will cause a facility unavailable exception. Add "PREFIX" to the facility_strings[].
Currently there are no prefixed instructions that are actually emulated by emulate_instruction() within facility_unavailable_exception(). However, when caused by a prefixed instructions the SRR1 PREFIXED bit is set. Prepare for dealing with emulated prefixed instructions by checking for this bit.
---
v4:
- Squash "Check for prefixed instructions in
facility_unavailable_exception()" here
- Remove dt parts for now
--- arch/powerpc/include/asm/reg.h | 3 +++ arch/powerpc/kernel/traps.c | 1 + 2 files changed, 4 insertions(+)
arch/powerpc/include/asm/reg.h +3 -0
@@ -397,6 +397,7 @@#define SPRN_RWMR 0x375/* Region-Weighting Mode Register */ /* HFSCR and FSCR bit numbers are the same */ +#define FSCR_PREFIX_LG 13/* Enable Prefix Instructions */ #define FSCR_SCV_LG 12/* Enable System Call Vectored */ #define FSCR_MSGP_LG 10/* Enable MSGP */ #define FSCR_TAR_LG 8/* Enable Target Address Register */
@@ -408,11 +409,13 @@#define FSCR_VECVSX_LG 1/* Enable VMX/VSX */ #define FSCR_FP_LG 0/* Enable Floating Point */ #define SPRN_FSCR 0x099/* Facility Status & Control Register */ +#define FSCR_PREFIX __MASK(FSCR_PREFIX_LG)#define FSCR_SCV __MASK(FSCR_SCV_LG)#define FSCR_TAR __MASK(FSCR_TAR_LG)#define FSCR_EBB __MASK(FSCR_EBB_LG)#define FSCR_DSCR __MASK(FSCR_DSCR_LG)#define SPRN_HFSCR 0xbe/* HV=1 Facility Status & Control Register */ +#define HFSCR_PREFIX __MASK(FSCR_PREFIX_LG)#define HFSCR_MSGP __MASK(FSCR_MSGP_LG)#define HFSCR_TAR __MASK(FSCR_TAR_LG)#define HFSCR_EBB __MASK(FSCR_EBB_LG)
arch/powerpc/kernel/traps.c +1 -0
@@ -1720,6 +1720,7 @@ void facility_unavailable_exception(struct pt_regs *regs) [FSCR_TAR_LG] = "TAR", [FSCR_MSGP_LG] = "MSGP", [FSCR_SCV_LG] = "SCV", + [FSCR_PREFIX_LG] = "PREFIX", };char *facility ="unknown" ;u64 value;
Signature · 1 line
2.17.1
PATCH v5 17/21 powerpc: Define new SRR1 bits for a future ISA version
In reply to Jordan NietheAdd the BOUNDARY SRR1 bit definition for when the cause of an alignment exception is a prefixed instruction that crosses a 64-byte boundary. Add the PREFIXED SRR1 bit definition for exceptions caused by prefixed instructions.
Bit 35 of SRR1 is called SRR1_ISI_N_OR_G. This name comes from it being used to indicate that an ISI was due to the access being no-exec or guarded. A future ISA version adds another purpose. It is also set if there is an access in a cache-inhibited location for prefixed instruction. Rename from SRR1_ISI_N_OR_G to SRR1_ISI_N_G_OR_CIP.
---
v2: Combined all the commits concerning SRR1 bits.
--- arch/powerpc/include/asm/reg.h | 4 +++- arch/powerpc/kvm/book3s_hv_nested.c | 2 +- arch/powerpc/kvm/book3s_hv_rm_mmu.c | 2 +- 3 files changed, 5 insertions(+), 3 deletions(-)
arch/powerpc/include/asm/reg.h +3 -1
@@ -762,7 +762,7 @@#endif #define SRR1_ISI_NOPT 0x40000000/* ISI: Not found in hash */ -#define SRR1_ISI_N_OR_G 0x10000000/* ISI: Access is no-exec or G */ +#define SRR1_ISI_N_G_OR_CIP 0x10000000/* ISI: Access is no-exec or G or CI for a prefixed instruction */ #define SRR1_ISI_PROT 0x08000000/* ISI: Other protection fault */ #define SRR1_WAKEMASK 0x00380000/* reason for wakeup */ #define SRR1_WAKEMASK_P8 0x003c0000/* reason for wakeup on POWER8 and 9 */
@@ -789,6 +789,8 @@#define SRR1_PROGADDR 0x00010000/* SRR0 contains subsequent addr */ #define SRR1_MCE_MCP 0x00080000/* Machine check signal caused interrupt */ +#define SRR1_BOUNDARY 0x10000000/* Prefixed instruction crosses 64-byte boundary */ +#define SRR1_PREFIXED 0x20000000/* Exception caused by prefixed instruction */ #define SPRN_HSRR0 0x13A/* Save/Restore Register 0 */ #define SPRN_HSRR1 0x13B/* Save/Restore Register 1 */
arch/powerpc/kvm/book3s_hv_nested.c +1 -1
@@ -1169,7 +1169,7 @@ static int kvmhv_translate_addr_nested(struct kvm_vcpu *vcpu, }else if (vcpu->arch.trap ==BOOK3S_INTERRUPT_H_INST_STORAGE ) {/* Can we execute? */ if (!gpte_p->may_execute) { - flags |=SRR1_ISI_N_OR_G ; + flags |=SRR1_ISI_N_G_OR_CIP ; goto forward_to_l1; } }else {
arch/powerpc/kvm/book3s_hv_rm_mmu.c +1 -1
@@ -1260,7 +1260,7 @@ long kvmppc_hpte_hv_fault(struct kvm_vcpu *vcpu, unsigned long addr, status &= ~DSISR_NOHPTE ;/* DSISR_NOHPTE == SRR1_ISI_NOPT */ if (!data) {if (gr & (HPTE_R_N |HPTE_R_G )) -return status |SRR1_ISI_N_OR_G ; +return status |SRR1_ISI_N_G_OR_CIP ;if (!hpte_read_permission (pp, slb_v & key))return status |SRR1_ISI_PROT ; }else if (status &DSISR_ISSTORE ) {
Signature · 1 line
2.17.1
PATCH v5 18/21 powerpc64: Add prefixed instructions to instruction data type
In reply to Jordan NietheFor powerpc64, redefine the ppc_inst type so both word and prefixed instructions can be represented. On powerpc32 the type will remain the same. Update places which had assumed instructions to be 4 bytes long.
---
v4: New to series
v5: - Distinguish normal instructions from prefixed instructions with a
0xff marker for the suffix.
- __patch_instruction() using std for prefixed instructions
--- arch/powerpc/include/asm/inst.h | 71 ++++++++++++++++++++++++++-- arch/powerpc/include/asm/kprobes.h | 2 +- arch/powerpc/include/asm/uaccess.h | 31 ++++++++++-- arch/powerpc/include/asm/uprobes.h | 2 +- arch/powerpc/kernel/optprobes.c | 42 ++++++++-------- arch/powerpc/kernel/optprobes_head.S | 3 ++ arch/powerpc/kernel/trace/ftrace.c | 26 +++++++++- arch/powerpc/lib/code-patching.c | 19 +++++--- arch/powerpc/lib/feature-fixups.c | 5 +- arch/powerpc/lib/sstep.c | 4 +- arch/powerpc/xmon/xmon.c | 6 +-- arch/powerpc/xmon/xmon_bpts.S | 4 +- 12 files changed, 171 insertions(+), 44 deletions(-)
arch/powerpc/include/asm/inst.h +66 -5
@@ -8,23 +8,67 @@struct ppc_inst {u32 val; +#ifdef __powerpc64__ +u32 suffix; +#endif /* __powerpc64__ */ } __packed; -#define ppc_inst (x) ((struct ppc_inst){ .val = x }) +static inline int ppc_inst_opcode (struct ppc_inst x) +{ +return x.val >>26 ; +}static inline u32 ppc_inst_val (struct ppc_inst x) {return x.val; } -static inline bool ppc_inst_len (struct ppc_inst x) +#ifdef __powerpc64__ +#define ppc_inst (x) ((struct ppc_inst){ .val = (x), .suffix = 0xff }) + +#define ppc_inst_prefix (x, y) ((struct ppc_inst){ .val = (x), .suffix = (y) }) + +static inline u32 ppc_inst_suffix (struct ppc_inst x) { -return sizeof (struct ppc_inst ); +return x.suffix; } -static inline int ppc_inst_opcode (struct ppc_inst x) +static inline bool ppc_inst_prefixed (struct ppc_inst x) { +return ((ppc_inst_val (x) >>26 ) ==1 ) &&ppc_inst_suffix (x) !=0xff ; +} + +static inline struct ppc_inst ppc_inst_swab (struct ppc_inst x) { -return x.val >>26 ; +return ppc_inst_prefix (swab32 (ppc_inst_val (x)), +swab32 (ppc_inst_suffix (x))); +} + +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) +{ +u32 val, suffix =0xff ; + val = *(u32 *)ptr; +if ((val >>26 ) ==1 ) + suffix = *((u32 *)ptr +1 ); +return ppc_inst_prefix (val, suffix); +} + +static inline void ppc_inst_write (struct ppc_inst *ptr,struct ppc_inst x) +{ +if (ppc_inst_prefixed (x)) { + *(u32 *)ptr = x.val; + *((u32 *)ptr +1 ) = x.suffix; + }else { + *(u32 *)ptr = x.val; + } +} + +#else + +#define ppc_inst (x) ((struct ppc_inst){ .val = x }) + +static inline bool ppc_inst_prefixed (ppc_inst x) +{ +return 0 ; }static inline struct ppc_inst ppc_inst_swab (struct ppc_inst x)
@@ -32,14 +76,31 @@ static inline struct ppc_inst ppc_inst_swab(struct ppc_inst x)return ppc_inst (swab32 (ppc_inst_val (x))); } +static inline u32 ppc_inst_val (struct ppc_inst x) +{ +return x.val; +} +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) {return *ptr; } +static inline void ppc_inst_write (struct ppc_inst *ptr,struct ppc_inst x) +{ + *ptr = x; +} + +#endif /* __powerpc64__ */ +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) {return !memcmp (&x, &y,sizeof (struct ppc_inst )); } +static inline int ppc_inst_len (struct ppc_inst x) +{ +return (ppc_inst_prefixed (x)) ?8 :4 ; +} +#endif /* _ASM_INST_H */
arch/powerpc/include/asm/kprobes.h +1 -1
@@ -43,7 +43,7 @@ extern kprobe_opcode_t optprobe_template_ret[];extern kprobe_opcode_t optprobe_template_end[];/* Fixed instruction size for powerpc */ -#define MAX_INSN_SIZE 1 +#define MAX_INSN_SIZE 2#define MAX_OPTIMIZED_LENGTH sizeof(kprobe_opcode_t)/* 4 bytes */ #define MAX_OPTINSN_SIZE (optprobe_template_end - optprobe_template_entry)#define RELATIVEJUMP_SIZE sizeof(kprobe_opcode_t)/* 4 bytes */
arch/powerpc/include/asm/uaccess.h +27 -4
@@ -105,11 +105,34 @@ static inline int __access_ok(unsigned long addr, unsigned long size,#define __put_user_inatomic (x, ptr) \ __put_user_nosleep((__typeof__(*(ptr)))(x), (ptr), sizeof(*(ptr))) -#define __get_user_instr (x, ptr) \ - __get_user_nocheck((x).val, (u32 *)(ptr), sizeof(u32), true) +#define __get_user_instr (x, ptr) \ +({ \ + long __gui_ret = 0; \ + unsigned int prefix, suffix; \ + __gui_ret = __get_user(prefix, (unsigned int __user *)ptr); \ + if (!__gui_ret && (prefix >> 26) == 1) { \ + __gui_ret = __get_user(suffix, (unsigned int __user *)ptr + 1); \ + (x) = ppc_inst_prefix(prefix, suffix); \ + } else { \ + (x) = ppc_inst(prefix); \ + } \ + __gui_ret; \ +}) + +#define __get_user_instr_inatomic (x, ptr) \ +({ \ + long __gui_ret = 0; \ + unsigned int prefix, suffix; \ + __gui_ret = __get_user_inatomic(prefix, (unsigned int __user *)ptr); \ + if (!__gui_ret && (prefix >> 26) == 1) { \ + __gui_ret = __get_user_inatomic(suffix, (unsigned int __user *)ptr + 1); \ + (x) = ppc_inst_prefix(prefix, suffix); \ + } else { \ + (x) = ppc_inst(prefix); \ + } \ + __gui_ret; \ +}) -#define __get_user_instr_inatomic (x, ptr) \ - __get_user_nosleep((x).val, (u32 *)(ptr), sizeof(u32))extern long __put_user_bad (void );/*
arch/powerpc/include/asm/uprobes.h +1 -1
@@ -15,7 +15,7 @@typedef ppc_opcode_t uprobe_opcode_t ; -#define MAX_UINSN_BYTES 4 +#define MAX_UINSN_BYTES 8#define UPROBE_XOL_SLOT_BYTES (MAX_UINSN_BYTES)/* The following alias is needed for reference from arch-agnostic code */
arch/powerpc/kernel/optprobes.c +23 -19
75 lines not on this page · raw message
arch/powerpc/kernel/optprobes_head.S +3 -0
@@ -94,6 +94,9 @@ optprobe_template_insn: /* 2, Pass instruction to be emulated in r4 */ nop nop + nop + nop + nop .global optprobe_template_call_emulate optprobe_template_call_emulate:
arch/powerpc/kernel/trace/ftrace.c +25 -1
@@ -41,11 +41,35 @@#define NUM_FTRACE_TRAMPS 8static unsigned long ftrace_tramps[NUM_FTRACE_TRAMPS ]; +#ifdef __powerpc64__static long probe_kernel_read_inst (struct ppc_inst *inst,const void *src) { -return probe_kernel_read ((void *)inst, src,MCOUNT_INSN_SIZE ); +u32 val, suffix =0 ; +long err; + + err =probe_kernel_read ((void *)&val, + src,sizeof (val)); +if (err) +return err; + +if ((val >>26 ) ==1 ) + err =probe_kernel_read ((void *)&suffix, + src +4 ,MCOUNT_INSN_SIZE ); +if (err) +return err; + + *inst =ppc_inst_prefix (val, suffix); + +return 0 ; } +#else +static long +probe_kernel_read_inst (struct ppc_inst *inst,const void *src) +{ + return probe_kernel_read((void *)inst, src, MCOUNT_INSN_SIZE) +} +#endif static struct ppc_inst ftrace_call_replace (unsigned long ip,unsigned long addr,int link)
arch/powerpc/lib/code-patching.c +13 -6
@@ -24,12 +24,19 @@ static int __patch_instruction(struct ppc_inst *exec_addr, struct ppc_inst instr {int err =0 ; -__put_user_asm (ppc_inst_val (instr), patch_addr, err,"stw" ); -if (err) -return err; - - asm ("dcbst 0, %0; sync; icbi 0,%1; sync; isync" ::"r" (patch_addr), -"r" (exec_addr)); +if (!ppc_inst_prefixed (instr)) { +__put_user_asm (ppc_inst_val (instr), patch_addr, err,"stw" ); +if (err) +return err; + asm ("dcbst 0, %0; sync; icbi 0,%1; sync; isync" ::"r" (patch_addr), +"r" (exec_addr)); + }else { +__put_user_asm ((u64 )ppc_inst_suffix (instr) <<32 |ppc_inst_val (instr), patch_addr, err,"std" ); +if (err) +return err; + asm ("dcbst 0, %0; sync; icbi 0,%1; sync; isync" ::"r" (patch_addr), +"r" (exec_addr)); + }return 0 ; }
arch/powerpc/lib/feature-fixups.c +3 -2
@@ -84,12 +84,13 @@ static int patch_feature_section(unsigned long value, struct fixup_entry *fcur) src = alt_start; dest = start; -for (; src < alt_end; src++, dest++) { +for (; src < alt_end; src = (void *)src +ppc_inst_len (ppc_inst_read (src)), + (dest = (void *)dest +ppc_inst_len (ppc_inst_read (dest)))) {if (patch_alt_instruction (src, dest, alt_start, alt_end))return 1 ; } -for (; dest < end; dest++) +for (; dest < end; dest = (void *)dest +ppc_inst_len (ppc_inst (PPC_INST_NOP )))raw_patch_instruction (dest,ppc_inst (PPC_INST_NOP ));return 0 ;
arch/powerpc/lib/sstep.c +3 -1
@@ -1169,10 +1169,12 @@ int analyse_instr(struct instruction_op *op, const struct pt_regs *regs,unsigned long int imm;unsigned long int val, val2;unsigned int mb, me, sh; -unsigned int word; +unsigned int word, suffix;long ival; word =ppc_inst_val (instr); + suffix =ppc_inst_suffix (instr); + op->type =COMPUTE ; opcode = word >>26 ;
arch/powerpc/xmon/xmon.c +3 -3
@@ -761,8 +761,8 @@ static int xmon_bpt(struct pt_regs *regs)/* Are we at the trap at bp->instr[1] for some bp? */ bp =in_breakpoint_table (regs->nip, &offset); -if (bp !=NULL && offset ==4 ) { - regs->nip = bp->address +4 ; +if (bp !=NULL && (offset ==4 || offset ==8 )) { + regs->nip = bp->address + offset;atomic_dec (&bp->ref_count);return 1 ; }
@@ -863,7 +863,7 @@ static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp)if (off >=sizeof (bpt_table))return NULL ; *offp = off %BPT_SIZE ; -if (*offp !=0 && *offp !=4 ) +if (*offp !=0 && *offp !=4 && *offp !=8 )return NULL ;return bpts + (off /BPT_SIZE ); }
arch/powerpc/xmon/xmon_bpts.S +3 -1
@@ -3,6 +3,8 @@ #include <asm/asm-compat.h> #include "xmon_bpts.h" +/* Prefixed instructions can not cross 64 byte boundaries */ +.align 6 .global bpt_table bpt_table: - .space NBPTS * 8 + .space NBPTS * 16
Signature · 1 line
2.17.1
Re: [PATCH v5 18/21] powerpc64: Add prefixed instructions to instruction data type
Quoted 92 lines
(quoted diff) +0
-0
b/arch/powerpc/include/asm/inst.hindex70b37a35a91a..7e23e7146c66100644arch/powerpc/include/asm/inst.h +54
-5@@ -8,23 +8,67 @@struct ppc_inst {u32 val; +#ifdef __powerpc64__ +u32 suffix; +#endif /* __powerpc64__ */ } __packed; -#define ppc_inst (x) ((struct ppc_inst){ .val = x }) +static inline int ppc_inst_opcode (struct ppc_inst x) +{ +return x.val >>26 ; +}static inline u32 ppc_inst_val (struct ppc_inst x) {return x.val; } -static inline bool ppc_inst_len (struct ppc_inst x) +#ifdef __powerpc64__ +#define ppc_inst (x) ((struct ppc_inst){ .val = (x), .suffix = 0xff }) + +#define ppc_inst_prefix (x, y) ((struct ppc_inst){ .val = (x), .suffix = (y) }) + +static inline u32 ppc_inst_suffix(struct ppc_inst x) { -return sizeof (struct ppc_inst ); +return x.suffix; } -static inline int ppc_inst_opcode (struct ppc_inst x) +static inline bool ppc_inst_prefixed (struct ppc_inst x) { +return ((ppc_inst_val (x) >>26 ) ==1 ) &&ppc_inst_suffix (x) !=0xff ; +} + +static inline struct ppc_inst ppc_inst_swab (struct ppc_inst x) { -return x.val >>26 ; +return ppc_inst_prefix (swab32 (ppc_inst_val (x)), +swab32 (ppc_inst_suffix (x))); +} + +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) +{ +u32 val, suffix =0xff ; + val = *(u32 *)ptr; +if ((val >>26 ) ==1 ) + suffix = *((u32 *)ptr +1 ); +return ppc_inst_prefix (val, suffix); +} + +static inline void ppc_inst_write (struct ppc_inst *ptr,struct ppc_inst x) +{ +if (ppc_inst_prefixed (x)) { + *(u32 *)ptr = x.val; + *((u32 *)ptr +1 ) = x.suffix; + }else { + *(u32 *)ptr = x.val; + } +} + +#else + +#define ppc_inst (x) ((struct ppc_inst){ .val = x }) + +static inline bool ppc_inst_prefixed (ppc_inst x) +{ +return 0 ; }static inline struct ppc_inst ppc_inst_swab (struct ppc_inst x)@@ -32,14 +76,31 @@ static inline struct ppc_inst ppc_inst_swab(struct ppc_inst x) return ppc_inst(swab32(ppc_inst_val(x))); } +static inline u32 ppc_inst_val (struct ppc_inst x) +{ +return x.val; +} +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) {return *ptr; } +static inline void ppc_inst_write (struct ppc_inst *ptr,struct ppc_inst x)
arch/powerpc/include/asm/inst.h static inline struct ppc_inst ppc_inst_swab(struct · line 99
Quoted 10 lines
arch/powerpc/include/asm/inst.h +6
-0+{ + *ptr = x; +} + +#endif /* __powerpc64__ */ +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) {return !memcmp (&x, &y,sizeof (struct ppc_inst )); }
Apologies for not picking this up earlier, I was hoping to get to the bottom of the issue I was seeing before you sent out v5. However the above definition of instruction equality does not seem correct because it does not consider the case when an instruction is not prefixed - a non-prefixed instruction should be considered equal if the first 32-bit opcode/value is the same. Something like:
if (ppc_inst_prefixed(x) != ppc_inst_prefixed(y)) return false; else if (ppc_inst_prefixed(x)) return !memcmp(&x, &y, sizeof(struct ppc_inst)); else return x.val == y.val;
This was causing failures in ftrace_modify_code() as it would falsely detect two non-prefixed instructions as being not equal due to differences in the suffix.
- Alistair
Quoted 113 lines
arch/powerpc/include/asm/inst.h +5
-0+static inline int ppc_inst_len (struct ppc_inst x) +{ +return (ppc_inst_prefixed (x)) ?8 :4 ; +} +#endif /* _ASM_INST_H */ (quoted diff) +0
-0
b/arch/powerpc/include/asm/kprobes.hindex66b3f2983b22..4fc0e15e23a5100644arch/powerpc/include/asm/kprobes.h +1
-1@@ -43,7 +43,7 @@ extern kprobe_opcode_t optprobe_template_ret[];extern kprobe_opcode_t optprobe_template_end[];/* Fixed instruction size for powerpc */ -#define MAX_INSN_SIZE 1 +#define MAX_INSN_SIZE 2#define MAX_OPTIMIZED_LENGTH sizeof(kprobe_opcode_t)/* 4 bytes */ #define MAX_OPTINSN_SIZE (optprobe_template_end - optprobe_template_entry)#define RELATIVEJUMP_SIZE sizeof(kprobe_opcode_t)/* 4 bytes */ (quoted diff) +0
-0
b/arch/powerpc/include/asm/uaccess.hindexc0a35e4586a5..5a3f486ddf02100644arch/powerpc/include/asm/uaccess.h +26
-4@@ -105,11 +105,34 @@ static inline int __access_ok(unsigned long addr, unsigned long size, #define __put_user_inatomic(x, ptr) \ __put_user_nosleep((__typeof__(*(ptr)))(x), (ptr), sizeof(*(ptr))) -#define __get_user_instr(x, ptr) \ - __get_user_nocheck((x).val, (u32 *)(ptr), sizeof(u32), true) +#define __get_user_instr(x, ptr) \ +({ \ +long __gui_ret =0 ; \ +unsigned int prefix, suffix; \ + __gui_ret = __get_user(prefix, (unsigned int __user *)ptr); \ +if (!__gui_ret && (prefix >>26 ) ==1 ) { \ + __gui_ret = __get_user(suffix, (unsigned int __user *)ptr + 1); \ + (x) =ppc_inst_prefix (prefix, suffix); \ + }else { \ + (x) =ppc_inst (prefix); \ + } \ + __gui_ret; \ +}) + +#define __get_user_instr_inatomic (x, ptr) \ +({ \ + long __gui_ret = 0; \ + unsigned int prefix, suffix; \ + __gui_ret = __get_user_inatomic(prefix, (unsigned int __user *)ptr); \ + if (!__gui_ret && (prefix >> 26) == 1) { \ + __gui_ret = __get_user_inatomic(suffix, (unsigned int __user *)ptr + 1); \ + (x) = ppc_inst_prefix(prefix, suffix); \ + } else { \ + (x) =ppc_inst (prefix); \ + } \ + __gui_ret; \ +}) -#define __get_user_instr_inatomic (x, ptr) \ - __get_user_nosleep((x).val, (u32 *)(ptr), sizeof(u32))extern long __put_user_bad (void );/* (quoted diff) +0
-0
b/arch/powerpc/include/asm/uprobes.hindex7e3b329ba2d3..5bf65f5d44a9100644arch/powerpc/include/asm/uprobes.h +1
-1@@ -15,7 +15,7 @@typedef ppc_opcode_t uprobe_opcode_t ; -#define MAX_UINSN_BYTES 4 +#define MAX_UINSN_BYTES 8#define UPROBE_XOL_SLOT_BYTES (MAX_UINSN_BYTES)/* The following alias is needed for reference from arch-agnostic code */ (quoted diff) +0
-0
b/arch/powerpc/kernel/optprobes.cindex684640b8fa2e..689daf430161100644arch/powerpc/kernel/optprobes.c +2
-4@@ -159,38 +159,38 @@ void patch_imm32_load_insns(unsigned int val, kprobe_opcode_t *addr)/* * Generate instructions to load provided immediate 64-bit value -* to register 'r3' and patch these instructions at 'addr'. +* to register 'reg' and patch these instructions at 'addr'. */ -void patch_imm64_load_insns (unsigned long val,kprobe_opcode_t *addr) +void patch_imm64_load_insns (unsigned long val,int reg,kprobe_opcode_t *addr) { -/* lis r3,(op)@highest */ - patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ADDIS |
___PPC_RT(3)| + /* lis reg,(op)@highest */arch/powerpc/kernel/optprobes.c +1
-0+ patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ADDIS |
___PPC_RT(reg)| ((val >> 48) &0xffff)));arch/powerpc/kernel/optprobes.c +0
-2addr++; -/* ori r3,r3,(op)@higher */ - patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(3)| -___PPC_RS(3)| ((val >> 32) &0xffff)));arch/powerpc/kernel/optprobes.c +2
-0+/* ori reg,reg,(op)@higher */ + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(reg)| +___PPC_RS(reg)| ((val >> 32) &0xffff)));arch/powerpc/kernel/optprobes.c +0
-2addr++; -/* rldicr r3,r3,32,31 */ - patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_RLDICR |
___PPC_RA(3)| -___PPC_RS(3)|__PPC_SH64(32)|__PPC_ME64(31)));arch/powerpc/kernel/optprobes.c +2
-0+/* rldicr reg,reg,32,31 */ + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_RLDICR |
Quoted 1 line
___PPC_RA(reg)| +___PPC_RS(reg)|__PPC_SH64(32)|
__PPC_ME64(31)));
Quoted 213 lines
arch/powerpc/kernel/optprobes.c +0
-2addr++; -/* oris r3,r3,(op)@h */ - patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORIS |
___PPC_RA(3)| -___PPC_RS(3)| ((val >> 16) &0xffff)));arch/powerpc/kernel/optprobes.c +2
-0+/* oris reg,reg,(op)@h */ + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORIS |
___PPC_RA(reg)| +___PPC_RS(reg)| ((val >> 16) &0xffff)));arch/powerpc/kernel/optprobes.c +0
-2addr++; -/* ori r3,r3,(op)@l */ - patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(3)| -___PPC_RS(3)| (val &0xffff)));arch/powerpc/kernel/optprobes.c +2
-0+/* ori reg,reg,(op)@l */ + patch_instruction((struct ppc_inst *)addr, ppc_inst(PPC_INST_ORI |
___PPC_RA(reg)| +___PPC_RS(reg)| (val &0xffff)));
}int arch_prepare_optimized_kprobe(struct
optimized_kprobe*op, struct
kprobe *p) {arch/powerpc/kernel/optprobes.c +1
-1-struct ppc_inst branch_op_callback, branch_emulate_step; +struct ppc_inst branch_op_callback, branch_emulate_step, temp;kprobe_opcode_t *op_callback_addr, *emulate_step_addr, *buff;long b_offset;unsigned long nip, size;@@ -240,7 +240,7 @@ int arch_prepare_optimized_kprobe(struct
optimized_kprobe*op, struct kprobe *p) * Fixup the template with instructions to:arch/powerpc/kernel/optprobes.c +1
-1* 1. load the address of the actual probepoint */ -patch_imm64_load_insns ((unsigned long )op, buff +TMPL_OP_IDX ); +patch_imm64_load_insns ((unsigned long )op,3 , buff +TMPL_OP_IDX );/* * 2. branch to optimized_callback() and emulate_step() @@ -271,7 +271,11 @@ int arch_prepare_optimized_kprobe(struct
optimized_kprobe*op, struct kprobe *p) /*arch/powerpc/kernel/optprobes.c +5
-1* 3. load instruction to be emulated into relevant register, and */ -patch_imm32_load_insns (*p->ainsn.insn, buff +TMPL_INSN_IDX ); + temp =ppc_inst_read ((struct ppc_inst *)p->ainsn.insn); +patch_imm64_load_insns (ppc_inst_val (temp) | + ((u64 )ppc_inst_suffix (temp) <<32 ), +4 , + buff +TMPL_INSN_IDX );/* * 4. branch back from trampoline (quoted diff) +0
-0
b/arch/powerpc/kernel/optprobes_head.Sindexcf383520843f..ff8ba4d3824d100644arch/powerpc/kernel/optprobes_head.S +3
-0@@ -94,6 +94,9 @@ optprobe_template_insn: /* 2, Pass instruction to be emulated in r4 */ nop nop + nop + nop + nop .global optprobe_template_call_emulate optprobe_template_call_emulate:(quoted diff) +0
-0
b/arch/powerpc/kernel/trace/ftrace.cindexe78742613b36..16041a5c86d5100644arch/powerpc/kernel/trace/ftrace.c +25
-1@@ -41,11 +41,35 @@#define NUM_FTRACE_TRAMPS 8static unsigned long ftrace_tramps[NUM_FTRACE_TRAMPS ]; +#ifdef __powerpc64__static long probe_kernel_read_inst (struct ppc_inst *inst,const void *src) { -return probe_kernel_read ((void *)inst, src,MCOUNT_INSN_SIZE ); +u32 val, suffix =0 ; +long err; + + err =probe_kernel_read ((void *)&val, + src,sizeof (val)); +if (err) +return err; + +if ((val >>26 ) ==1 ) + err =probe_kernel_read ((void *)&suffix, + src +4 ,MCOUNT_INSN_SIZE ); +if (err) +return err; + + *inst =ppc_inst_prefix (val, suffix); + +return 0 ; } +#else +static long +probe_kernel_read_inst (struct ppc_inst *inst,const void *src) +{ + return probe_kernel_read((void *)inst, src, MCOUNT_INSN_SIZE) +} +#endif static struct ppc_inst ftrace_call_replace (unsigned long ip,unsigned long addr,int link)(quoted diff) +0
-0
b/arch/powerpc/lib/code-patching.cindexc329ad657302..b4007e03d8fa100644arch/powerpc/lib/code-patching.c +12
-6@@ -24,12 +24,19 @@ static int __patch_instruction(struct ppc_inst *exec_addr, struct ppc_inst instr {int err =0 ; -__put_user_asm (ppc_inst_val (instr), patch_addr, err,"stw" ); -if (err) -return err; - - asm ("dcbst 0, %0; sync; icbi 0,%1; sync; isync" ::"r" (patch_addr), -"r" (exec_addr)); +if (!ppc_inst_prefixed (instr)) { +__put_user_asm (ppc_inst_val (instr), patch_addr, err,"stw" ); +if (err) +return err; + asm ("dcbst 0, %0; sync; icbi 0,%1; sync; isync" ::"r" (patch_addr), +"r" (exec_addr)); + }else { +__put_user_asm ((u64 )ppc_inst_suffix (instr) <<32 |ppc_inst_val (instr), patch_addr, err, "std"); + if (err) +return err; + asm ("dcbst 0, %0; sync; icbi 0,%1; sync; isync" ::"r" (patch_addr), +"r" (exec_addr)); + }return 0 ; }(quoted diff) +0
-0
b/arch/powerpc/lib/feature-fixups.cindexf00dd13b1c3c..5519cec83cc8100644arch/powerpc/lib/feature-fixups.c +1
-1@@ -84,12 +84,13 @@ static int patch_feature_section(unsigned long value, struct fixup_entry *fcur) src = alt_start; dest = start; -for (; src < alt_end; src++, dest++) { + for (; src < alt_end; src = (void *)src +ppc_inst_len(ppc_inst_read(src)), + (dest = (void *)dest +
ppc_inst_len(ppc_inst_read(dest)))) { if (patch_alt_instruction(src, dest, alt_start, alt_end))arch/powerpc/lib/feature-fixups.c +1
-1return 1 ; } -for (; dest < end; dest++) + for (; dest < end; dest = (void *)dest +ppc_inst_len(ppc_inst(PPC_INST_NOP)))
raw_patch_instruction(dest, ppc_inst(PPC_INST_NOP));arch/powerpc/lib/feature-fixups.c +0
-0return 0 ;arch/powerpc/lib/sstep.c +3
-1@@ -1169,10 +1169,12 @@ int analyse_instr(struct instruction_op *op, const struct pt_regs *regs, unsigned long int imm;unsigned long int val, val2;unsigned int mb, me, sh; -unsigned int word; +unsigned int word, suffix;long ival; word =ppc_inst_val (instr); + suffix =ppc_inst_suffix (instr); + op->type =COMPUTE ; opcode = word >>26 ;arch/powerpc/xmon/xmon.c +3
-3@@ -761,8 +761,8 @@ static int xmon_bpt(struct pt_regs *regs)/* Are we at the trap at bp->instr[1] for some bp? */ bp =in_breakpoint_table (regs->nip, &offset); -if (bp !=NULL && offset ==4 ) { - regs->nip = bp->address +4 ; +if (bp !=NULL && (offset ==4 || offset ==8 )) { + regs->nip = bp->address + offset;atomic_dec (&bp->ref_count);return 1 ; }@@ -863,7 +863,7 @@ static struct bpt *in_breakpoint_table(unsigned long nip, unsigned long *offp) if (off >= sizeof(bpt_table))return NULL ; *offp = off %BPT_SIZE ; -if (*offp !=0 && *offp !=4 ) +if (*offp !=0 && *offp !=4 && *offp !=8 )return NULL ;return bpts + (off /BPT_SIZE ); }arch/powerpc/xmon/xmon_bpts.S +3
-1@@ -3,6 +3,8 @@ #include <asm/asm-compat.h> #include "xmon_bpts.h" +/* Prefixed instructions can not cross 64 byte boundaries */ +.align 6 .global bpt_table bpt_table: - .space NBPTS * 8 + .space NBPTS * 16
Re: [PATCH v5 18/21] powerpc64: Add prefixed instructions to instruction data type
Le 06/04/2020 à 11:52, Alistair Popple a écrit :
[...]
Quoted 32 lines
Quoted 15 lines
arch/powerpc/include/asm/inst.h +6
-0@@ -32,14 +76,31 @@ static inline struct ppc_inst ppc_inst_swab(struct ppc_inst x) return ppc_inst(swab32(ppc_inst_val(x))); } +static inline u32 ppc_inst_val (struct ppc_inst x) +{ +return x.val; +} +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) {return *ptr; } +static inline void ppc_inst_write (struct ppc_inst *ptr,struct ppc_inst x)arch/powerpc/include/asm/inst.h static inline struct ppc_inst ppc_inst_swab(struct · line 99
Quoted 10 lines
arch/powerpc/include/asm/inst.h +6
-0+{ + *ptr = x; +} + +#endif /* __powerpc64__ */ +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) {return !memcmp (&x, &y,sizeof (struct ppc_inst )); }Apologies for not picking this up earlier, I was hoping to get to the bottom of the issue I was seeing before you sent out v5. However the above definition of instruction equality does not seem correct because it does not consider the case when an instruction is not prefixed - a non-prefixed instruction should be considered equal if the first 32-bit opcode/value is the same. Something like:
Quoted 4 lines
if (ppc_inst_prefixed(x) != ppc_inst_prefixed(y)) return false; else if (ppc_inst_prefixed(x)) return !memcmp(&x, &y, sizeof(struct ppc_inst));
Are we sure memcmp() is a good candidate for the comparison ? Can we do simpler ? Especially, I understood a prefixed instruction is a 64 bits properly aligned instruction, can we do a simple u64 compare ? Or is GCC intelligent enough to do that without calling memcmp() function which is heavy ?
Quoted 6 lines
else return x.val == y.val;This was causing failures in
ftrace_modify_code()as it would falsely detect two non-prefixed instructions as being not equal due to differences in the suffix.
Christophe
Re: [PATCH v5 18/21] powerpc64: Add prefixed instructions to instruction data type
Quoted 44 lines · Christophe Leroy
Le 06/04/2020 à 11:52, Alistair Popple a écrit :
[...]
Quoted 32 lines
Quoted 15 lines
arch/powerpc/include/asm/inst.h +6
-0@@ -32,14 +76,31 @@ static inline struct ppc_inst ppc_inst_swab(struct ppc_inst x) return ppc_inst(swab32(ppc_inst_val(x))); } +static inline u32 ppc_inst_val (struct ppc_inst x) +{ +return x.val; +} +static inline struct ppc_inst ppc_inst_read (const struct ppc_inst *ptr) {return *ptr; } +static inline void ppc_inst_write (struct ppc_inst *ptr,struct ppc_inst x)arch/powerpc/include/asm/inst.h static inline struct ppc_inst ppc_inst_swab(struct · line 99
Quoted 10 lines
arch/powerpc/include/asm/inst.h +6
-0+{ + *ptr = x; +} + +#endif /* __powerpc64__ */ +static inline bool ppc_inst_equal (struct ppc_inst x,struct ppc_inst y) {return !memcmp (&x, &y,sizeof (struct ppc_inst )); }Apologies for not picking this up earlier, I was hoping to get to the bottom of the issue I was seeing before you sent out v5. However the above definition of instruction equality does not seem correct because it does not consider the case when an instruction is not prefixed - a non-prefixed instruction should be considered equal if the first 32-bit opcode/value is the same. Something like:
Quoted 4 lines
if (ppc_inst_prefixed(x) != ppc_inst_prefixed(y)) return false; else if (ppc_inst_prefixed(x)) return !memcmp(&x, &y, sizeof(struct ppc_inst));
Quoted 5 lines
Are we sure
memcmp()is a good candidate for the comparison ? Can we do simpler ? Especially, I understood a prefixed instruction is a 64 bits properly aligned instruction, can we do a simple u64 compare ? Or is GCC intelligent enough to do that without callingmemcmp()function which is heavy ?
As it is GCC does call memcmp(). I'll try to make it simpler.
Quoted 9 lines
Quoted 7 lines
else return x.val == y.val;This was causing failures in
ftrace_modify_code()as it would falsely detect two non-prefixed instructions as being not equal due to differences in the suffix.Christophe
Re: [PATCH v5 18/21] powerpc64: Add prefixed instructions to instruction data type
In reply to Christophe LeroyQuoted 10 lines · Christophe Leroy
Quoted 4 lines
if (ppc_inst_prefixed(x) != ppc_inst_prefixed(y)) return false; else if (ppc_inst_prefixed(x)) return !memcmp(&x, &y, sizeof(struct ppc_inst));Are we sure
memcmp()is a good candidate for the comparison ? Can we do simpler ? Especially, I understood a prefixed instruction is a 64 bits properly aligned instruction, can we do a simple u64 compare ? Or is GCC intelligent enough to do that without callingmemcmp()function which is heavy ?
A prefixed insn is *not* 8-byte aligned, it is 4-byte aligned, fwiw.
memcmp() isn't as heavy as you fear, not with a non-ancient GCC at least. But this could be written in a nicer way, sure :-)
Segher
Re: [PATCH v5 18/21] powerpc64: Add prefixed instructions to instruction data type
Le 08/04/2020 à 20:11, Segher Boessenkool a écrit :
Quoted 6 lines · Christophe Leroy
Quoted 5 lines
Quoted 4 lines
if (ppc_inst_prefixed(x) != ppc_inst_prefixed(y)) return false; else if (ppc_inst_prefixed(x)) return !memcmp(&x, &y, sizeof(struct ppc_inst));
Quoted 7 lines
Quoted 5 lines
Are we sure
memcmp()is a good candidate for the comparison ? Can we do simpler ? Especially, I understood a prefixed instruction is a 64 bits properly aligned instruction, can we do a simple u64 compare ? Or is GCC intelligent enough to do that without callingmemcmp()function which is heavy ?A prefixed insn is *not* 8-byte aligned, it is 4-byte aligned, fwiw.
Ah, yes, I read too fast https://patchwork.ozlabs.org/patch/1266721/
It's not 64 bits, it is 64 bytes.
Quoted 7 lines
memcmp()isn't as heavy as you fear, not with a non-ancient GCC at least. But this could be written in a nicer way, sure :-)Segher
Christophe