RTAS maintenance
Subsystems (2)
cover RTAS maintenance
A collection of loosely-related RTAS code changes, most notably:
* Fixing misuses of rtas_token() for non-function properties.
* The stronger validation for sys_rtas() offered by the PPC_RTAS_FILTER config option is always enabled.
* Improved function token lookups, including efficient "reverse" token-to-name mappings.
* Static tracepoints for RTAS entry and exit.
Nathan Lynch (13):
powerpc/rtas: document rtas_call()
powerpc/rtasd: use correct OF API for event scan rate powerpc/rtas: avoid device tree lookups in rtas_os_term() powerpc/rtas: avoid scheduling in rtas_os_term() powerpc/pseries/eeh: use correct API for error log size powerpc/rtas: clean up rtas_error_log_max initialization powerpc/rtas: clean up includes
powerpc/rtas: define pr_fmt and convert printk call sites powerpc/rtas: mandate RTAS syscall filtering powerpc/rtas: improve function information lookups powerpc/rtas: strengthen do_enter_rtas() type safety, drop inline powerpc/tracing: tracepoints for RTAS entry and exit powerpc/rtas: place tracepoints in do_enter_rtas()
arch/powerpc/Kconfig | 13 - arch/powerpc/include/asm/rtas.h | 102 +- arch/powerpc/include/asm/trace.h | 116 +++ arch/powerpc/kernel/rtas.c | 961 +++++++++++++++---- arch/powerpc/kernel/rtasd.c | 7 +- arch/powerpc/platforms/pseries/eeh_pseries.c | 2 +- 6 files changed, 986 insertions(+), 215 deletions(-)
Signature · 1 line
2.37.1
PATCH 1/13 powerpc/rtas: document rtas_call()
rtas_call() has a complex calling convention, non-standard return values, and many users. Add kernel-doc for it and remove the less structured commentary from rtas.h.
--- arch/powerpc/include/asm/rtas.h | 15 --------- arch/powerpc/kernel/rtas.c | 58 +++++++++++++++++++++++++++++++++ 2 files changed, 58 insertions(+), 15 deletions(-)
arch/powerpc/include/asm/rtas.h +0 -15
@@ -33,21 +33,6 @@#define RTAS_THREADS_ACTIVE -9005/* Multiple processor threads active */ #define RTAS_OUTSTANDING_COPROC -9006/* Outstanding coprocessor operations */ -/* -* In general to call RTAS use rtas_token("string") to lookup -* an RTAS token for the given string (e.g. "event-scan"). -* To actually perform the call use -* ret = rtas_call(token, n_in, n_out, ...) -* Where n_in is the number of input parameters and -* n_out is the number of output parameters -* -* If the "string" is invalid on this system, RTAS_UNKNOWN_SERVICE -* will be returned as a token. rtas_call() does look for this -* token and error out gracefully so rtas_call(rtas_token("str"), ...) -* may be safely used for one-shot calls to RTAS. -* -*/ -/* RTAS event classes */ #define RTAS_INTERNAL_ERROR 0x80000000/* set bit 0 */ #define RTAS_EPOW_WARNING 0x40000000/* set bit 1 */
arch/powerpc/kernel/rtas.c +58 -0
64 lines not on this page · raw message
Signature · 1 line
2.37.1
Re: [PATCH 01/13] powerpc/rtas: document rtas_call()
Quoted 5 lines · Nathan Lynch
rtas_call()has a complex calling convention, non-standard return values, and many users. Add kernel-doc for it and remove the less structured commentary fromrtas.h.Signed-off-by Nathan Lynch <[email protected]>
Excellent work!
I'm not overly familiar with some of the RTAS internal stuff you describe, but I've checked the status codes against my copy of PAPR and they concur, so I'll give this a:
Quoted 131 lines
---
arch/powerpc/include/asm/rtas.h | 15 ---------
arch/powerpc/kernel/rtas.c | 58
+++++++++++++++++++++++++++++++++2 files changed, 58 insertions(+), 15 deletions(-)arch/powerpc/include/asm/rtas.h +0
-0@@ -33,21 +33,6 @@ #define RTAS_THREADS_ACTIVE -9005 /* Multiple processor threadsactive */
#defineRTAS_OUTSTANDING_COPROC-9006 /* Outstanding coprocessor operations */
-/*
- * In general to call RTAS usertas_token("string")to lookup
- * an RTAS token for the given string (e.g. "event-scan").
- * To actually perform the call use
- * ret =rtas_call(token, n_in, n_out, ...)
- * Wheren_inis the number of input parameters and
- *n_outis the number of output parameters
- *
- * If the "string" is invalid on this system,RTAS_UNKNOWN_SERVICE
- * will be returned as a token.rtas_call()does look for this
- * token and error out gracefully sortas_call(rtas_token("str"), ...)
- * may be safely used for one-shot calls to RTAS.
- *
- */
-
/* RTAS event classes */
#define RTAS_INTERNAL_ERROR 0x80000000 /* set bit 0 */ #define RTAS_EPOW_WARNING 0x40000000 /* set bit 1 */arch/powerpc/kernel/rtas.c +0
-0@@ -467,6 +467,64 @@ void rtas_call_unlocked(struct rtas_args *args, int token, int nargs, int nret, static int ibm_open_errinjct_token; static int ibm_errinjct_token;
+/**
+ *rtas_call()- Invoke an RTAS firmware function.
+ * @token: Identifies the function being invoked.
+ * @nargs: Number of input parameters. Does not include token.
+ * @nret: Number of output parameters, including the call status.
+ * @outputs: Array of @nret output words.
+ * @....: List of @nargs input parameters.
+ *
+ * Invokes the RTAS function indicated by @token, which the caller
+ * should obtain viartas_token().
+ *
+ * The @nargs and @nret arguments must match the number of input and
+ * output parameters specified for the RTAS function.
+ *
+ *rtas_call()returns RTAS status codes, not conventional Linux errno
+ * values. Callers must translate any failure to an appropriate errno
+ * in syscall context. Most callers of RTAS functions that can return
+ * -2 or 990x should usertas_busy_delay()to correctly handle those
+ * statuses before calling again.
+ *
+ * The return value descriptions are adapted from 7.2.8 [RTAS] Return
+ * Codes of the PAPR and CHRP specifications.
+ *
+ * Context: Process context preferably, interrupt context if
+ * necessary. Acquires an internal spinlock and may perform
+ *GFP_ATOMICslab allocation in error path. Unsafe for NMI
+ * context.
+ * Return:
+ * * 0 - RTAS function call succeeded.
+ * * -1 - RTAS function encountered a hardware or
+ * platform error, or the token is invalid,
+ * or the function is restricted by kernel policy.
+ * * -2 - Specs say "A necessary hardware device was busy,
+ * and the requested function could not be
+ * performed. The operation should be retried at
+ * a later time." This is misleading, at least with
+ * respect to current RTAS implementations. What it
+ * usually means in practice is that the function
+ * could not be completed while meeting RTAS's
+ * deadline for returning control to the OS (250us
+ * for PAPR/PowerVM, typically), but the call may be
+ * immediately reattempted to resume work on it.
+ * * -3 - Parameter error.
+ * * -7 - Unexpected state change.
+ * * 9000...9899 - Vendor-specific success codes.
+ * * 9900...9905 - Advisory extended delay. Caller should try
+ * again after ~10^x ms has elapsed, where x is
+ * the last digit of the status [0- 5]. Again going
+ * beyond the PAPR text, 990x on PowerVM indicates
+ * contention for RTAS-internal resources. Other
+ * RTAS call sequences in progress should be
+ * allowed to complete before reattempting the
+ * call.
+ * * -9000 - Multi-level isolation error.
+ * * -9999...-9004 - Vendor-specific error codes.
+ * * Additional negative values - Function-specific error.
+ * * Additional positive values - Function-specific success.
+ */
intrtas_call(int token, int nargs, int nret, int *outputs, ...){
va_list list;
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
PATCH 2/13 powerpc/rtasd: use correct OF API for event scan rate
In reply to Nathan Lynchrtas_token() should be used only for properties that are RTAS function tokens. "rtas-event-scan-rate" does not contain a function token, but it has the same size/format as token properties so reading it with rtas_token() happens to work.
Convert to of_property_read_u32().
--- arch/powerpc/kernel/rtasd.c | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-)
arch/powerpc/kernel/rtasd.c +5 -2
@@ -9,6 +9,7 @@#include <linux/errno.h> #include <linux/sched.h> #include <linux/kernel.h> +#include <linux/of.h> #include <linux/poll.h> #include <linux/proc_fs.h> #include <linux/init.h>
@@ -499,6 +500,8 @@ EXPORT_SYMBOL_GPL(rtas_cancel_event_scan);static int __init rtas_event_scan_init (void ) { +int err; +if (!machine_is (pseries) && !machine_is (chrp))return 0 ;
@@ -509,8 +512,8 @@ static int __init rtas_event_scan_init(void)return -ENODEV ; } - rtas_event_scan_rate =rtas_token ("rtas-event-scan-rate" ); -if (rtas_event_scan_rate ==RTAS_UNKNOWN_SERVICE ) { + err =of_property_read_u32 (rtas.dev,"rtas-event-scan-rate" , &rtas_event_scan_rate); +if (err) {printk (KERN_ERR "rtasd: no rtas-event-scan-rate on system\n" );return -ENODEV ; }
Signature · 1 line
2.37.1
Re: [PATCH 02/13] powerpc/rtasd: use correct OF API for event scan rate
Quoted 10 lines · Nathan Lynch
rtas_token()should be used only for properties that are RTAS function
tokens. "rtas-event-scan-rate" does not contain a function token, but it
has the same size/format as token properties so reading it withrtas_token()happens to work.Convert to
of_property_read_u32().Signed-off-by Nathan Lynch <[email protected]>
Did a quick grep for the other OF device tree properties listed in R1- 7.2.6-3 of PAPR to see if we make the same mistake elsewhere, and the only other one is rtas-error-log-max which I see you clean up later in the series.
Quoted 39 lines
---
arch/powerpc/kernel/rtasd.c | 7 +++++--1 file changed, 5 insertions(+), 2 deletions(-)arch/powerpc/kernel/rtasd.c +1
-0@@ -9,6 +9,7 @@ #include <linux/errno.h> #include <linux/sched.h> #include <linux/kernel.h> +#include <linux/of.h> #include <linux/poll.h> #include <linux/proc_fs.h> #include <linux/init.h>@@ -499,6 +500,8 @@ EXPORT_SYMBOL_GPL(rtas_cancel_event_scan);
static int__initrtas_event_scan_init(void){
+ int err;
+
if (!machine_is(pseries) && !machine_is(chrp)) return 0;arch/powerpc/kernel/rtasd.c +0
-0@@ -509,8 +512,8 @@ static int __init rtas_event_scan_init(void) return -ENODEV; }
- rtas_event_scan_rate =rtas_token("rtas-event-scan-rate"); - if (rtas_event_scan_rate==RTAS_UNKNOWN_SERVICE) { + err =of_property_read_u32(rtas.dev, "rtas-event-scan-rate", &rtas_event_scan_rate);
+ if (err) {
printk(KERN_ERR "rtasd: no rtas-event-scan-rate on system\n");
return-ENODEV;
}
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
PATCH 3/13 powerpc/rtas: avoid device tree lookups in rtas_os_term()
In reply to Nathan Lynchrtas_os_term() is called during panic. Its behavior depends on a couple of conditions in the /rtas node of the device tree, the traversal of which entails locking and local IRQ state changes. If the kernel panics while devtree_lock is held, rtas_os_term() as currently written could hang.
Instead of discovering the relevant characteristics at panic time, cache them in file-static variables at boot. Note the lookup for "ibm,extended-os-term" is converted to of_property_read_bool() since it is a boolean property, not a RTAS function token.
--- arch/powerpc/kernel/rtas.c | 14 +++++++++++--- 1 file changed, 11 insertions(+), 3 deletions(-)
arch/powerpc/kernel/rtas.c +11 -3
@@ -947,6 +947,8 @@ void __noreturn rtas_halt(void)/* Must be in the RMO region, so we place it here */ static char rtas_os_term_buf[2048 ]; +static s32 ibm_os_term_token =RTAS_UNKNOWN_SERVICE ; +static bool ibm_extended_os_term;void rtas_os_term (char *str) {
@@ -958,14 +960,13 @@ void rtas_os_term(char *str)* this property may terminate the partition which we want to avoid * since it interferes with panic_timeout. */ -if (RTAS_UNKNOWN_SERVICE ==rtas_token ("ibm,os-term" ) || -RTAS_UNKNOWN_SERVICE ==rtas_token ("ibm,extended-os-term" )) +if (ibm_os_term_token ==RTAS_UNKNOWN_SERVICE || !ibm_extended_os_term)return ;snprintf (rtas_os_term_buf,2048 ,"OS panic: %s" , str);do { - status =rtas_call (rtas_token ("ibm,os-term" ),1 ,1 ,NULL , + status =rtas_call (ibm_os_term_token,1 ,1 ,NULL ,__pa (rtas_os_term_buf)); }while (rtas_busy_delay (status));
@@ -1335,6 +1336,13 @@ void __init rtas_initialize(void) no_entry =of_property_read_u32 (rtas.dev,"linux,rtas-entry" , &entry); rtas.entry = no_entry ? rtas.base : entry; +/* +* Discover these now to avoid device tree lookups in the +* panic path. +*/ + ibm_os_term_token =rtas_token ("ibm,os-term" ); + ibm_extended_os_term =of_property_read_bool (rtas.dev,"ibm,extended-os-term" ); +/* If RTAS was found, allocate the RMO buffer for it and look for * the stop-self token if any */
Signature · 1 line
2.37.1
Re: [PATCH 03/13] powerpc/rtas: avoid device tree lookups in rtas_os_term()
Quoted 7 lines · Nathan Lynch
rtas_os_term()is called during panic. Its behavior depends on a couple of conditions in the /rtas node of the device tree, the traversal of which entails locking and local IRQ state changes. If the
kernel panics whiledevtree_lockis held,rtas_os_term()as currently written could hang.
Quoted 6 lines
Instead of discovering the relevant characteristics at panic time, cache them in file-static variables at boot. Note the lookup for "ibm,extended-os-term" is converted to
of_property_read_bool()since it is a boolean property, not a RTAS function token.Signed-off-by Nathan Lynch <[email protected]>
This seems sensible, minor comment below.
Quoted 9 lines
---
arch/powerpc/kernel/rtas.c | 14 +++++++++++---1 file changed, 11 insertions(+), 3 deletions(-)arch/powerpc/kernel/rtas.c +0
-0@@ -947,6 +947,8 @@ void __noreturn rtas_halt(void)
Quoted 4 lines
/* Must be in the RMO region, so we place it here */ static char rtas_os_term_buf[2048];
+static s32ibm_os_term_token=RTAS_UNKNOWN_SERVICE;
s32 and int are obviously identical, but rtas_token is declared using int, as are the other variables where we cache various tokens.
Quoted 42 lines
+static bool
ibm_extended_os_term;
voidrtas_os_term(char *str)
{arch/powerpc/kernel/rtas.c +0
-0@@ -958,14 +960,13 @@ void rtas_os_term(char *str) * this property may terminate the partition which we want toavoid
* since it interferes withpanic_timeout.
*/
- if (RTAS_UNKNOWN_SERVICE==rtas_token("ibm,os-term")|| -RTAS_UNKNOWN_SERVICE==rtas_token("ibm,extended-os- term"))
+ if (ibm_os_term_token==RTAS_UNKNOWN_SERVICE|| !ibm_extended_os_term)
return;
snprintf(rtas_os_term_buf, 2048, "OS panic: %s", str);
do {
- status = rtas_call(rtas_token("ibm,os-term"), 1, 1, NULL,
+ status =rtas_call(ibm_os_term_token, 1, 1, NULL, __pa(rtas_os_term_buf)); } while (rtas_busy_delay(status));arch/powerpc/kernel/rtas.c +0
-0@@ -1335,6 +1336,13 @@ void __init rtas_initialize(void) no_entry = of_property_read_u32(rtas.dev, "linux,rtas-entry", &entry); rtas.entry = no_entry ? rtas.base : entry;
+ /*
+ * Discover these now to avoid device tree lookups in the + * panic path.
+ */
+ ibm_os_term_token =rtas_token("ibm,os-term");
+ ibm_extended_os_term =of_property_read_bool(rtas.dev, "ibm,extended-os-term");
+
/* If RTAS was found, allocate the RMO buffer for it and look for
* the stop-self token if any
*/
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
Re: [PATCH 03/13] powerpc/rtas: avoid device tree lookups in rtas_os_term()
Quoted 4 lines · Andrew Donnellan
Quoted 4 lines
arch/powerpc/kernel/rtas.c +0
-0
Quoted 8 lines
Quoted 5 lines
arch/powerpc/kernel/rtas.c +0
-0@@ -947,6 +947,8 @@ void __noreturn rtas_halt(void)
/* Must be in the RMO region, so we place it here */ static char rtas_os_term_buf[2048];
+static s32ibm_os_term_token=RTAS_UNKNOWN_SERVICE;s32 and int are obviously identical, but
rtas_tokenis declared using int, as are the other variables where we cache various tokens.
Right... I think it's better practice to use an explicitly sized type where the data is directly derived from the device tree and ultimately passed to the firmware call interface. Gradually enacting this while tolerating some cosmetic inconsistency in the code seems OK to me, but I'm open to other opinions.
Re: [PATCH 03/13] powerpc/rtas: avoid device tree lookups in rtas_os_term()
In reply to Nathan LynchQuoted 5 lines · Nathan Lynch
rtas_os_term()is called during panic. Its behavior depends on a couple of conditions in the /rtas node of the device tree, the traversal of which entails locking and local IRQ state changes. If the kernel panics whiledevtree_lockis held,rtas_os_term()as currently written could hang.
Nice.
Quoted 5 lines
Instead of discovering the relevant characteristics at panic time, cache them in file-static variables at boot. Note the lookup for "ibm,extended-os-term" is converted to
of_property_read_bool()since it is a boolean property, not a RTAS function token.
Small nit, but you could do that at the query site unless you were going to start using ibm,os-term without the extended capability.
Quoted 52 lines
Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 14 +++++++++++--- 1 file changed, 11 insertions(+), 3 deletions(-)arch/powerpc/kernel/rtas.c +11
-3@@ -947,6 +947,8 @@ void __noreturn rtas_halt(void)/* Must be in the RMO region, so we place it here */ static char rtas_os_term_buf[2048 ]; +static s32 ibm_os_term_token =RTAS_UNKNOWN_SERVICE ; +static bool ibm_extended_os_term;void rtas_os_term (char *str) {@@ -958,14 +960,13 @@ void rtas_os_term(char *str)* this property may terminate the partition which we want to avoid * since it interferes with panic_timeout. */ -if (RTAS_UNKNOWN_SERVICE ==rtas_token ("ibm,os-term" ) || -RTAS_UNKNOWN_SERVICE ==rtas_token ("ibm,extended-os-term" )) +if (ibm_os_term_token ==RTAS_UNKNOWN_SERVICE || !ibm_extended_os_term)return ;snprintf (rtas_os_term_buf,2048 ,"OS panic: %s" , str);do { - status =rtas_call (rtas_token ("ibm,os-term" ),1 ,1 ,NULL , + status =rtas_call (ibm_os_term_token,1 ,1 ,NULL ,__pa (rtas_os_term_buf)); }while (rtas_busy_delay (status));@@ -1335,6 +1336,13 @@ void __init rtas_initialize(void) no_entry =of_property_read_u32 (rtas.dev,"linux,rtas-entry" , &entry); rtas.entry = no_entry ? rtas.base : entry; +/* +* Discover these now to avoid device tree lookups in the +* panic path. +*/ + ibm_os_term_token =rtas_token ("ibm,os-term" ); + ibm_extended_os_term =of_property_read_bool (rtas.dev,"ibm,extended-os-term" ); +/* If RTAS was found, allocate the RMO buffer for it and look for * the stop-self token if any */ Signature · 1 line
2.37.1
Re: [PATCH 03/13] powerpc/rtas: avoid device tree lookups in rtas_os_term()
Quoted 10 lines · Nicholas Piggin
Quoted 5 lines · Nathan Lynch
rtas_os_term()is called during panic. Its behavior depends on a couple of conditions in the /rtas node of the device tree, the traversal of which entails locking and local IRQ state changes. If the kernel panics whiledevtree_lockis held,rtas_os_term()as currently written could hang.Nice.
Quoted 1 line
Quoted 8 lines
Quoted 4 lines
Instead of discovering the relevant characteristics at panic time, cache them in file-static variables at boot. Note the lookup for "ibm,extended-os-term" is converted to
of_property_read_bool()since it is a boolean property, not a RTAS function token.Small nit, but you could do that at the query site unless you were going to start using ibm,os-term without the extended capability.
I'm unsure that this is what you're suggesting, but we don't want to use of_property_read_bool() in this context either, because it has the same undesirable qualities as rtas_token().
Quoted 1 line
Reviewed-by Nicholas Piggin <[email protected]>
Thanks!
Nicholas Piggin
reviewerRe: [PATCH 03/13] powerpc/rtas: avoid device tree lookups in rtas_os_term()
Quoted 16 lines · Nathan Lynch
Quoted 15 lines · Nicholas Piggin
Quoted 5 lines · Nathan Lynch
rtas_os_term()is called during panic. Its behavior depends on a couple of conditions in the /rtas node of the device tree, the traversal of which entails locking and local IRQ state changes. If the kernel panics whiledevtree_lockis held,rtas_os_term()as currently written could hang.Nice.
Quoted 5 lines
Instead of discovering the relevant characteristics at panic time, cache them in file-static variables at boot. Note the lookup for "ibm,extended-os-term" is converted to
of_property_read_bool()since it is a boolean property, not a RTAS function token.
Quoted 7 lines
Quoted 3 lines
Small nit, but you could do that at the query site unless you were going to start using ibm,os-term without the extended capability.
I'm unsure that this is what you're suggesting, but we don't want to use
of_property_read_bool()in this context either, because it has the same undesirable qualities asrtas_token().
I mean rtas_initialize() could do
if (of_property_read_bool(rtas.dev, "ibm,extended-os-term"))
ibm_os_term_token = rtas_token("ibm,os-term");Thanks,
Nick
Re: [PATCH 03/13] powerpc/rtas: avoid device tree lookups in rtas_os_term()
Quoted 21 lines · Nicholas Piggin
Quoted 20 lines · Nathan Lynch
Quoted 18 lines · Nicholas Piggin
Quoted 5 lines · Nathan Lynch
rtas_os_term()is called during panic. Its behavior depends on a couple of conditions in the /rtas node of the device tree, the traversal of which entails locking and local IRQ state changes. If the kernel panics whiledevtree_lockis held,rtas_os_term()as currently written could hang.Nice.
Quoted 5 lines
Instead of discovering the relevant characteristics at panic time, cache them in file-static variables at boot. Note the lookup for "ibm,extended-os-term" is converted to
of_property_read_bool()since it is a boolean property, not a RTAS function token.Small nit, but you could do that at the query site unless you were going to start using ibm,os-term without the extended capability.
Quoted 8 lines
Quoted 3 lines
I'm unsure that this is what you're suggesting, but we don't want to use
of_property_read_bool()in this context either, because it has the same undesirable qualities asrtas_token().I mean
rtas_initialize()could doif (of_property_read_bool(rtas.dev, "ibm,extended-os-term")) ibm_os_term_token = rtas_token("ibm,os-term");
Oh of course, thanks. Since I need to do a v2 anyway, I'll make that change.
PATCH 4/13 powerpc/rtas: avoid scheduling in rtas_os_term()
In reply to Nathan LynchIt's unsafe to use rtas_busy_delay() to handle a busy status from the ibm,os-term RTAS function in rtas_os_term():
Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b BUG: sleeping function called from invalid context at arch/powerpc/kernel/rtas.c:618 in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 preempt_count: 2, expected: 0 CPU: 7 PID: 1 Comm: swapper/0 Tainted: G D 6.0.0-rc5-02182-gf8553a572277-dirty #9 Call Trace: [c000000007b8f000] [c000000001337110] dump_stack_lvl+0xb4/0x110 (unreliable) [c000000007b8f040] [c0000000002440e4] __might_resched+0x394/0x3c0 [c000000007b8f0e0] [c00000000004f680] rtas_busy_delay+0x120/0x1b0 [c000000007b8f100] [c000000000052d04] rtas_os_term+0xb8/0xf4 [c000000007b8f180] [c0000000001150fc] pseries_panic+0x50/0x68 [c000000007b8f1f0] [c000000000036354] ppc_panic_platform_handler+0x34/0x50 [c000000007b8f210] [c0000000002303c4] notifier_call_chain+0xd4/0x1c0 [c000000007b8f2b0] [c0000000002306cc] atomic_notifier_call_chain+0xac/0x1c0 [c000000007b8f2f0] [c0000000001d62b8] panic+0x228/0x4d0 [c000000007b8f390] [c0000000001e573c] do_exit+0x140c/0x1420 [c000000007b8f480] [c0000000001e586c] make_task_dead+0xdc/0x200
Use rtas_busy_delay_time() instead, which signals without side effects whether to attempt the ibm,os-term RTAS call again.
--- arch/powerpc/kernel/rtas.c | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-)
arch/powerpc/kernel/rtas.c +6 -1
@@ -965,10 +965,15 @@ void rtas_os_term(char *str)snprintf (rtas_os_term_buf,2048 ,"OS panic: %s" , str); +/* +* Keep calling as long as RTAS returns a "try again" status, +* but don't use rtas_busy_delay(), which potentially +* schedules. +*/ do { status =rtas_call (ibm_os_term_token,1 ,1 ,NULL ,__pa (rtas_os_term_buf)); - }while (rtas_busy_delay (status)); + }while (rtas_busy_delay_time (status));if (status !=0 )printk (KERN_EMERG "ibm,os-term call failed %d\n" , status);
Signature · 1 line
2.37.1
Re: [PATCH 04/13] powerpc/rtas: avoid scheduling in rtas_os_term()
Quoted 28 lines · Nathan Lynch
It's unsafe to use
rtas_busy_delay()to handle a busy status from the ibm,os-term RTAS function inrtas_os_term():Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b BUG: sleeping function called from invalid context at
arch/powerpc/kernel/rtas.c:618in_atomic(): 1,irqs_disabled(): 1,non_block: 0, pid: 1, name:
swapper/0preempt_count: 2, expected: 0CPU: 7 PID: 1 Comm: swapper/0 Tainted: G D 6.0.0-rc5- 02182-gf8553a572277-dirty #9 Call Trace: [c000000007b8f000] [c000000001337110] dump_stack_lvl+0xb4/0x110(unreliable)
[c000000007b8f040] [c0000000002440e4]__might_resched+0x394/0x3c0[c000000007b8f0e0] [c00000000004f680]rtas_busy_delay+0x120/0x1b0[c000000007b8f100] [c000000000052d04]rtas_os_term+0xb8/0xf4[c000000007b8f180] [c0000000001150fc]pseries_panic+0x50/0x68[c000000007b8f1f0] [c000000000036354]ppc_panic_platform_handler+0x34/0x50 [c000000007b8f210] [c0000000002303c4] notifier_call_chain+0xd4/0x1c0 [c000000007b8f2b0] [c0000000002306cc] atomic_notifier_call_chain+0xac/0x1c0 [c000000007b8f2f0] [c0000000001d62b8] panic+0x228/0x4d0 [c000000007b8f390] [c0000000001e573c] do_exit+0x140c/0x1420 [c000000007b8f480] [c0000000001e586c] make_task_dead+0xdc/0x200
Quoted 5 lines
Use
rtas_busy_delay_time()instead, which signals without side effects
whether to attempt the ibm,os-term RTAS call again.Signed-off-by Nathan Lynch <[email protected]>
Makes sense.
Quoted 26 lines
---
arch/powerpc/kernel/rtas.c | 7 ++++++-1 file changed, 6 insertions(+), 1 deletion(-)arch/powerpc/kernel/rtas.c +0
-0@@ -965,10 +965,15 @@ void rtas_os_term(char *str)
snprintf(rtas_os_term_buf, 2048, "OS panic: %s", str);
+ /*
+ * Keep calling as long as RTAS returns a "try again" status, + * but don't usertas_busy_delay(), which potentially + * schedules.
+ */
do {
status =rtas_call(ibm_os_term_token, 1, 1, NULL, __pa(rtas_os_term_buf)); - } while (rtas_busy_delay(status));
+ } while (rtas_busy_delay_time(status));
if (status != 0)
printk(KERN_EMERG "ibm,os-term call failed %d\n", status);
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
Re: [PATCH 04/13] powerpc/rtas: avoid scheduling in rtas_os_term()
In reply to Nathan LynchQuoted 21 lines · Nathan Lynch
It's unsafe to use
rtas_busy_delay()to handle a busy status from the ibm,os-term RTAS function inrtas_os_term():Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b BUG: sleeping function called from invalid context at arch/powerpc/kernel/rtas.c:618 in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 preempt_count: 2, expected: 0 CPU: 7 PID: 1 Comm: swapper/0 Tainted: G D 6.0.0-rc5-02182-gf8553a572277-dirty #9 Call Trace: [c000000007b8f000] [c000000001337110] dump_stack_lvl+0xb4/0x110 (unreliable) [c000000007b8f040] [c0000000002440e4] __might_resched+0x394/0x3c0 [c000000007b8f0e0] [c00000000004f680] rtas_busy_delay+0x120/0x1b0 [c000000007b8f100] [c000000000052d04] rtas_os_term+0xb8/0xf4 [c000000007b8f180] [c0000000001150fc] pseries_panic+0x50/0x68 [c000000007b8f1f0] [c000000000036354] ppc_panic_platform_handler+0x34/0x50 [c000000007b8f210] [c0000000002303c4] notifier_call_chain+0xd4/0x1c0 [c000000007b8f2b0] [c0000000002306cc] atomic_notifier_call_chain+0xac/0x1c0 [c000000007b8f2f0] [c0000000001d62b8] panic+0x228/0x4d0 [c000000007b8f390] [c0000000001e573c] do_exit+0x140c/0x1420 [c000000007b8f480] [c0000000001e586c] make_task_dead+0xdc/0x200
Quoted 2 lines
Use
rtas_busy_delay_time()instead, which signals without side effects whether to attempt the ibm,os-term RTAS call again.
rtas_busy_delay should probably be renamed to rtas_busy_sleep, to make that self-documenting that it can schedule. You could then add a rtas_busy_delay which doesn't sleep, which a few other places could use...
But that's a bigger chance and there is precedent for using this call this way, so looks okay to me. Maybe you could open-code an mdelay though, although I guess firmware should be tolerant of calling it in a loop.
Quoted 29 lines
Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-)arch/powerpc/kernel/rtas.c +6
-1@@ -965,10 +965,15 @@ void rtas_os_term(char *str)snprintf (rtas_os_term_buf,2048 ,"OS panic: %s" , str); +/* +* Keep calling as long as RTAS returns a "try again" status, +* but don't use rtas_busy_delay(), which potentially +* schedules. +*/ do { status =rtas_call (ibm_os_term_token,1 ,1 ,NULL ,__pa (rtas_os_term_buf)); - }while (rtas_busy_delay (status)); + }while (rtas_busy_delay_time (status));if (status !=0 )printk (KERN_EMERG "ibm,os-term call failed %d\n" , status);Signature · 1 line
2.37.1
PATCH 5/13 powerpc/pseries/eeh: use correct API for error log size
In reply to Nathan Lynchrtas-error-log-max is not the name of an RTAS function, so rtas_token() is not the appropriate API for retrieving its value. We already have rtas_get_error_log_max() which returns a sensible value if the property is absent for any reason, so use that instead.
--- arch/powerpc/platforms/pseries/eeh_pseries.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
arch/powerpc/platforms/pseries/eeh_pseries.c +1 -1
@@ -848,7 +848,7 @@ static int __init eeh_pseries_init(void) }/* Initialize error log size */ - eeh_error_buf_size =rtas_token ("rtas-error-log-max" ); + eeh_error_buf_size =rtas_get_error_log_max ();if (eeh_error_buf_size ==RTAS_UNKNOWN_SERVICE ) {pr_info ("%s: unknown EEH error log size\n" , __func__);
Signature · 1 line
2.37.1
Re: [PATCH 05/13] powerpc/pseries/eeh: use correct API for error log size
Quoted 19 lines · Nathan Lynch
rtas-error-log-max is not the name of an RTAS function, so
rtas_token()is not the appropriate API for retrieving its value. We already havertas_get_error_log_max()which returns a sensible value if the property is absent for any reason, so use that instead.Signed-off-by Nathan Lynch <[email protected]>Fixes 8d633291b4fc ("powerpc/eeh: pseries platform EEH error logretrieval")
---
arch/powerpc/platforms/pseries/eeh_pseries.c | 2 +-1 file changed, 1 insertion(+), 1 deletion(-)arch/powerpc/platforms/pseries/eeh_pseries.c +0
-0@@ -848,7 +848,7 @@ static int __init eeh_pseries_init(void) }
Quoted 5 lines
/* Initialize error log size */
- eeh_error_buf_size =rtas_token("rtas-error-log-max"); + eeh_error_buf_size =rtas_get_error_log_max(); if (eeh_error_buf_size==RTAS_UNKNOWN_SERVICE) {
This is now impossible, and the whole block makes little sense after the next patch
Quoted 2 lines
pr_info("%s: unknown EEH error log size\n",
__func__);
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
Re: [PATCH 05/13] powerpc/pseries/eeh: use correct API for error log size
Quoted 13 lines · Andrew Donnellan
Quoted 12 lines · Nathan Lynch
rtas-error-log-max is not the name of an RTAS function, so
rtas_token()is not the appropriate API for retrieving its value. We already havertas_get_error_log_max()which returns a sensible value if the property is absent for any reason, so use that instead.Signed-off-by Nathan Lynch <[email protected]>Fixes 8d633291b4fc ("powerpc/eeh: pseries platform EEH error logretrieval")
---
arch/powerpc/platforms/pseries/eeh_pseries.c | 2 +-1 file changed, 1 insertion(+), 1 deletion(-)
Quoted 15 lines
Quoted 7 lines
arch/powerpc/platforms/pseries/eeh_pseries.c +0
-0@@ -848,7 +848,7 @@ static int __init eeh_pseries_init(void) }Quoted 5 lines
/* Initialize error log size */
- eeh_error_buf_size =rtas_token("rtas-error-log-max"); + eeh_error_buf_size =rtas_get_error_log_max(); if (eeh_error_buf_size==RTAS_UNKNOWN_SERVICE) {This is now impossible, and the whole block makes little sense after the next patch
Indeed, will fix in v2, thanks.
PATCH 6/13 powerpc/rtas: clean up rtas_error_log_max initialization
In reply to Nathan LynchThe code in rtas_get_error_log_max() doesn't cause problems in practice, but there are no measures to ensure that the lazy initialization of the static rtas_error_log_max variable is atomic, and it's not worth adding them.
Initialize the static rtas_error_log_max variable at boot when we're single-threaded instead of lazily on first use. Use the more appropriate of_property_read_u32() API instead of rtas_token() to consult the "rtas-error-log-max" property, which is not the name of an RTAS function. Convert use of printk() to pr_warn() and distinguish the possible error cases.
--- arch/powerpc/kernel/rtas.c | 37 ++++++++++++++++++++++++++----------- 1 file changed, 26 insertions(+), 11 deletions(-)
arch/powerpc/kernel/rtas.c +26 -11
@@ -353,6 +353,9 @@ int rtas_service_present(const char *service)EXPORT_SYMBOL (rtas_service_present);#ifdef CONFIG_RTAS_ERROR_LOGGING + +static u32 rtas_error_log_max__ro_after_init =RTAS_ERROR_LOG_MAX ; +/* * Return the firmware-specified size of the error log buffer * for all rtas calls that require an error buffer argument.
@@ -360,21 +363,30 @@ EXPORT_SYMBOL(rtas_service_present);*/ int rtas_get_error_log_max (void ) { -static int rtas_error_log_max; -if (rtas_error_log_max) -return rtas_error_log_max; - - rtas_error_log_max =rtas_token ("rtas-error-log-max" ); -if ((rtas_error_log_max ==RTAS_UNKNOWN_SERVICE ) || - (rtas_error_log_max >RTAS_ERROR_LOG_MAX )) { -printk (KERN_WARNING "RTAS: bad log buffer size %d\n" , - rtas_error_log_max); - rtas_error_log_max =RTAS_ERROR_LOG_MAX ; - }return rtas_error_log_max; }EXPORT_SYMBOL (rtas_get_error_log_max); +static void __init init_error_log_max (void ) +{ +static const char propname[]__initconst ="rtas-error-log-max" ; +u32 max; + +if (of_property_read_u32 (rtas.dev, propname, &max)) { +pr_warn ("%s not found, using default of %u\n" , + propname,RTAS_ERROR_LOG_MAX ); + max =RTAS_ERROR_LOG_MAX ; + } + +if (max >RTAS_ERROR_LOG_MAX ) { +pr_warn ("%s = %u, clamping max error log size to %u\n" , + propname, max,RTAS_ERROR_LOG_MAX ); + max =RTAS_ERROR_LOG_MAX ; + } + + rtas_error_log_max = max; +} +static char rtas_err_buf[RTAS_ERROR_LOG_MAX ];static int rtas_last_error_token;
@@ -432,6 +444,7 @@ static char *__fetch_rtas_last_error(char *altbuf)#else /* CONFIG_RTAS_ERROR_LOGGING */ #define __fetch_rtas_last_error (x) NULL#define get_errorlog_buffer () NULL +static void __init init_error_log_max (void ) {}#endif
@@ -1341,6 +1354,8 @@ void __init rtas_initialize(void) no_entry =of_property_read_u32 (rtas.dev,"linux,rtas-entry" , &entry); rtas.entry = no_entry ? rtas.base : entry; +init_error_log_max (); +/* * Discover these now to avoid device tree lookups in the * panic path.
Signature · 1 line
2.37.1
Re: [PATCH 06/13] powerpc/rtas: clean up rtas_error_log_max initialization
Quoted 13 lines · Nathan Lynch
The code in
rtas_get_error_log_max()doesn't cause problems in practice, but there are no measures to ensure that the lazy initialization of the staticrtas_error_log_maxvariable is atomic, and it's not worth adding them.Initialize the static
rtas_error_log_maxvariable at boot when we're single-threaded instead of lazily on first use. Use the more appropriateof_property_read_u32()API instead ofrtas_token()to consult the "rtas-error-log-max" property, which is not the name of an
RTAS function. Convert use ofprintk()topr_warn()and distinguish the possible error cases.
Quoted 1 line
Signed-off-by Nathan Lynch <[email protected]>
Quoted 83 lines
---
arch/powerpc/kernel/rtas.c | 37 ++++++++++++++++++++++++++---------- -1 file changed, 26 insertions(+), 11 deletions(-)arch/powerpc/kernel/rtas.c +0
-0@@ -353,6 +353,9 @@ int rtas_service_present(const char *service) EXPORT_SYMBOL(rtas_service_present);
#ifdefCONFIG_RTAS_ERROR_LOGGINGarch/powerpc/kernel/rtas.c +3
-0+ +static u32 rtas_error_log_max__ro_after_init =RTAS_ERROR_LOG_MAX ; +/*
* Return the firmware-specified size of the error log buffer * for all rtas calls that require an error buffer argument.arch/powerpc/kernel/rtas.c +0
-11@@ -360,21 +363,30 @@ EXPORT_SYMBOL(rtas_service_present);*/ int rtas_get_error_log_max(void) { - static int rtas_error_log_max; - if (rtas_error_log_max) - return rtas_error_log_max; - - rtas_error_log_max = rtas_token ("rtas-error-log-max"); - if ((rtas_error_log_max == RTAS_UNKNOWN_SERVICE) || - (rtas_error_log_max > RTAS_ERROR_LOG_MAX)) { - printk (KERN_WARNING "RTAS: bad log buffer size %d\n", - rtas_error_log_max); - rtas_error_log_max = RTAS_ERROR_LOG_MAX; - } return rtas_error_log_max; } EXPORT_SYMBOL(rtas_get_error_log_max);arch/powerpc/kernel/rtas.c +3
-0+static void __init init_error_log_max (void ) +{ + static const char propname[] __initconst = "rtas-error-log-max";
+ u32 max;arch/powerpc/kernel/rtas.c +9
-0+ + if (of_property_read_u32(rtas.dev, propname, &max)) { + pr_warn("%s not found, using default of %u\n", + propname, RTAS_ERROR_LOG_MAX); + max = RTAS_ERROR_LOG_MAX; + } + + if (max > RTAS_ERROR_LOG_MAX) { + pr_warn("%s = %u, clamping max error log size to%u\n",
+ propname, max,RTAS_ERROR_LOG_MAX); + max =RTAS_ERROR_LOG_MAX;
+ }arch/powerpc/kernel/rtas.c +4
-0+ + rtas_error_log_max = max; +} +
static char rtas_err_buf[RTAS_ERROR_LOG_MAX];
static intrtas_last_error_token;arch/powerpc/kernel/rtas.c +1
-0@@ -432,6 +444,7 @@ static char *__fetch_rtas_last_error(char *altbuf) #else /* CONFIG_RTAS_ERROR_LOGGING */ #define __fetch_rtas_last_error(x) NULL #define get_errorlog_buffer() NULL +static void __init init_error_log_max (void ) {} #endif
arch/powerpc/kernel/rtas.c +0
-0@@ -1341,6 +1354,8 @@ void __init rtas_initialize(void) no_entry = of_property_read_u32(rtas.dev, "linux,rtas-entry", &entry); rtas.entry = no_entry ? rtas.base : entry;
+ init_error_log_max();
+
/*
* Discover these now to avoid device tree lookups in the
* panic path.
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
PATCH 7/13 powerpc/rtas: clean up includes
In reply to Nathan Lynchrtas.c used to host complex code related to pseries-specific guest migration and suspend, which used atomics, completions, hcalls, and CPU hotplug APIs. That's all been deleted or moved, so remove the include directives that have been rendered unnecessary. Sort the remainder (with linux/ before asm/) to impose some order on where future additions go.
--- arch/powerpc/kernel/rtas.c | 42 +++++++++++++++----------------------- 1 file changed, 16 insertions(+), 26 deletions(-)
arch/powerpc/kernel/rtas.c +16 -26
@@ -7,43 +7,33 @@* Copyright (C) 2001 IBM. */ -#include <linux/stdarg.h> -#include <linux/kernel.h> -#include <linux/types.h> -#include <linux/spinlock.h> -#include <linux/export.h> -#include <linux/init.h> #include <linux/capability.h> #include <linux/delay.h> -#include <linux/cpu.h> -#include <linux/sched.h> -#include <linux/smp.h> -#include <linux/completion.h> -#include <linux/cpumask.h> +#include <linux/export.h> +#include <linux/init.h> +#include <linux/kernel.h> #include <linux/memblock.h> -#include <linux/slab.h> +#include <linux/of.h> +#include <linux/of_fdt.h> #include <linux/reboot.h> +#include <linux/sched.h> #include <linux/security.h> +#include <linux/slab.h> +#include <linux/spinlock.h> +#include <linux/stdarg.h> #include <linux/syscalls.h> -#include <linux/of.h> -#include <linux/of_fdt.h> +#include <linux/types.h> +#include <linux/uaccess.h> +#include <asm/delay.h> +#include <asm/firmware.h> #include <asm/interrupt.h> -#include <asm/rtas.h> -#include <asm/hvcall.h> #include <asm/machdep.h> -#include <asm/firmware.h> +#include <asm/mmu.h> #include <asm/page.h> -#include <asm/param.h> -#include <asm/delay.h> -#include <linux/uaccess.h> -#include <asm/udbg.h> -#include <asm/syscalls.h> -#include <asm/smp.h> -#include <linux/atomic.h> +#include <asm/rtas.h> #include <asm/time.h> -#include <asm/mmu.h> -#include <asm/topology.h> +#include <asm/udbg.h> /* This is here deliberately so it's only used in this file */ void enter_rtas (unsigned long );
Signature · 1 line
2.37.1
Re: [PATCH 07/13] powerpc/rtas: clean up includes
Quoted 8 lines · Nathan Lynch
rtas.cused to host complex code related to pseries-specific guest migration and suspend, which used atomics, completions, hcalls, and CPU hotplug APIs. That's all been deleted or moved, so remove the include directives that have been rendered unnecessary. Sort the remainder (with linux/ before asm/) to impose some order on where future additions go.Signed-off-by Nathan Lynch <[email protected]>
Compiles for me.
Quoted 69 lines
---
arch/powerpc/kernel/rtas.c | 42 +++++++++++++++--------------------- --1 file changed, 16 insertions(+), 26 deletions(-)arch/powerpc/kernel/rtas.c +0
-0@@ -7,43 +7,33 @@* Copyright (C) 2001 IBM. */ arch/powerpc/kernel/rtas.c +0
-6-#include <linux/stdarg.h> -#include <linux/kernel.h> -#include <linux/types.h> -#include <linux/spinlock.h> -#include <linux/export.h> -#include <linux/init.h> #include <
linux/capability.h>
#include <linux/delay.h>arch/powerpc/kernel/rtas.c +3
-5-#include <linux/cpu.h> -#include <linux/sched.h> -#include <linux/smp.h> -#include <linux/completion.h> -#include <linux/cpumask.h> +#include <linux/export.h> +#include <linux/init.h> +#include <linux/kernel.h> #include <
linux/memblock.h>arch/powerpc/kernel/rtas.c +2
-1-#include <linux/slab.h> +#include <linux/of.h> +#include <linux/of_fdt.h> #include <
linux/reboot.h>
+#include <linux/sched.h>
#include <linux/security.h>arch/powerpc/kernel/rtas.c +3
-0+#include <linux/slab.h> +#include <linux/spinlock.h> +#include <linux/stdarg.h> #include <
linux/syscalls.h>arch/powerpc/kernel/rtas.c +2
-2-#include <linux/of.h> -#include <linux/of_fdt.h> +#include <linux/types.h> +#include <linux/uaccess.h> arch/powerpc/kernel/rtas.c +2
-0+#include <asm/delay.h> +#include <asm/firmware.h> #include <
asm/interrupt.h>arch/powerpc/kernel/rtas.c +0
-2-#include <asm/rtas.h> -#include <asm/hvcall.h> #include <
asm/machdep.h>arch/powerpc/kernel/rtas.c +1
-1-#include <asm/firmware.h> +#include <asm/mmu.h> #include <
asm/page.h>arch/powerpc/kernel/rtas.c +1
-7-#include <asm/param.h> -#include <asm/delay.h> -#include <linux/uaccess.h> -#include <asm/udbg.h> -#include <asm/syscalls.h> -#include <asm/smp.h> -#include <linux/atomic.h> +#include <asm/rtas.h> #include <
asm/time.h>arch/powerpc/kernel/rtas.c +1
-2-#include <asm/mmu.h> -#include <asm/topology.h> +#include <asm/udbg.h>
/* This is here deliberately so it's only used in this file */ voidenter_rtas(unsigned long);
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
PATCH 8/13 powerpc/rtas: define pr_fmt and convert printk call sites
In reply to Nathan LynchSet pr_fmt to "rtas: " and convert the handful of printk() uses in rtas.c, adjusting the messages to remove now-redundant "RTAS" strings.
Note that rtas_restart(), rtas_power_off(), and rtas_halt() all currently use printk() without specifying a log level. These have been changed to use pr_emerg(), which matches the behavior of rtas_os_term().
--- arch/powerpc/kernel/rtas.c | 19 ++++++++++--------- 1 file changed, 10 insertions(+), 9 deletions(-)
arch/powerpc/kernel/rtas.c +10 -9
@@ -7,6 +7,8 @@* Copyright (C) 2001 IBM. */ +#define pr_fmt (fmt) "rtas: " fmt +#include <linux/capability.h> #include <linux/delay.h> #include <linux/export.h>
@@ -718,8 +720,7 @@ static int rtas_error_rc(int rtas_rc) rc = -ENODEV ;break ;default : -printk (KERN_ERR "%s: unexpected RTAS error %d\n" , - __func__, rtas_rc); +pr_err ("%s: unexpected error %d\n" , __func__, rtas_rc); rc = -ERANGE ;break ; }
@@ -923,8 +924,8 @@ void __noreturn rtas_restart(char *cmd) {if (rtas_flash_term_hook)rtas_flash_term_hook (SYS_RESTART ); -printk ("RTAS system-reboot returned %d\n" , -rtas_call (rtas_token ("system-reboot" ),0 ,1 ,NULL )); +pr_emerg ("system-reboot returned %d\n" , +rtas_call (rtas_token ("system-reboot" ),0 ,1 ,NULL ));for (;;); }
@@ -933,8 +934,8 @@ void rtas_power_off(void)if (rtas_flash_term_hook)rtas_flash_term_hook (SYS_POWER_OFF );/* allow power on only with power button press */ -printk ("RTAS power-off returned %d\n" , -rtas_call (rtas_token ("power-off" ),2 ,1 ,NULL ,-1 ,-1 )); +pr_emerg ("power-off returned %d\n" , +rtas_call (rtas_token ("power-off" ),2 ,1 ,NULL ,-1 ,-1 ));for (;;); }
@@ -943,8 +944,8 @@ void __noreturn rtas_halt(void)if (rtas_flash_term_hook)rtas_flash_term_hook (SYS_HALT );/* allow power on only with power button press */ -printk ("RTAS power-off returned %d\n" , -rtas_call (rtas_token ("power-off" ),2 ,1 ,NULL ,-1 ,-1 )); +pr_emerg ("power-off returned %d\n" , +rtas_call (rtas_token ("power-off" ),2 ,1 ,NULL ,-1 ,-1 ));for (;;); }
@@ -979,7 +980,7 @@ void rtas_os_term(char *str) }while (rtas_busy_delay_time (status));if (status !=0 ) -printk (KERN_EMERG "ibm,os-term call failed %d\n" , status); +pr_emerg ("ibm,os-term call failed %d\n" , status); }/**
Signature · 1 line
2.37.1
Re: [PATCH 08/13] powerpc/rtas: define pr_fmt and convert printk call sites
Quoted 11 lines · Nathan Lynch
Set
pr_fmtto "rtas: " and convert the handful ofprintk()uses inrtas.c, adjusting the messages to remove now-redundant "RTAS" strings.Note that
rtas_restart(),rtas_power_off(), andrtas_halt()all currently useprintk()without specifying a log level. These have been
changed to usepr_emerg(), which matches the behavior ofrtas_os_term().Signed-off-by Nathan Lynch <[email protected]>
Quoted 76 lines
---
arch/powerpc/kernel/rtas.c | 19 ++++++++++---------1 file changed, 10 insertions(+), 9 deletions(-)arch/powerpc/kernel/rtas.c +0
-0@@ -7,6 +7,8 @@* Copyright (C) 2001 IBM. */ arch/powerpc/kernel/rtas.c +2
-0+#define pr_fmt (fmt) "rtas: " fmt +#include <
linux/capability.h>
#include <linux/delay.h>
#include <linux/export.h>arch/powerpc/kernel/rtas.c +0
-0@@ -718,8 +720,7 @@ static int rtas_error_rc(int rtas_rc) rc = -ENODEV; break;default:
- printk(KERN_ERR "%s: unexpected RTAS error %d\n",
- __func__,rtas_rc); + pr_err("%s: unexpected error %d\n",__func__,rtas_rc);
rc =-ERANGE;
break;
}arch/powerpc/kernel/rtas.c +2
-2@@ -923,8 +924,8 @@ void __noreturn rtas_restart(char *cmd) { if (rtas_flash_term_hook) rtas_flash_term_hook(SYS_RESTART); - printk("RTAS system-reboot returned %d\n", - rtas_call(rtas_token("system-reboot"), 0, 1, NULL)); + pr_emerg("system-reboot returned %d\n", + rtas_call(rtas_token("system-reboot"), 0, 1, NULL)); for (;;); }arch/powerpc/kernel/rtas.c +2
-2@@ -933,8 +934,8 @@ void rtas_power_off(void) if (rtas_flash_term_hook) rtas_flash_term_hook(SYS_POWER_OFF); /* allow power on only with power button press */ - printk("RTAS power-off returned %d\n", - rtas_call(rtas_token("power-off"), 2, 1, NULL, -1, - 1)); + pr_emerg("power-off returned %d\n", + rtas_call(rtas_token("power-off"), 2, 1, NULL, -1, -1 )); for (;;);}
arch/powerpc/kernel/rtas.c +2
-2@@ -943,8 +944,8 @@ void __noreturn rtas_halt(void) if (rtas_flash_term_hook) rtas_flash_term_hook(SYS_HALT); /* allow power on only with power button press */ - printk("RTAS power-off returned %d\n", - rtas_call(rtas_token("power-off"), 2, 1, NULL, -1, - 1)); + pr_emerg("power-off returned %d\n", + rtas_call(rtas_token("power-off"), 2, 1, NULL, -1, -1 )); for (;;);}
arch/powerpc/kernel/rtas.c +0
-0@@ -979,7 +980,7 @@ void rtas_os_term(char *str) } while (rtas_busy_delay_time(status));
if (status != 0)
- printk(KERN_EMERG "ibm,os-term call failed %d\n", status);
+ pr_emerg("ibm,os-term call failed %d\n", status); }
/**
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
PATCH 9/13 powerpc/rtas: mandate RTAS syscall filtering
In reply to Nathan LynchCONFIG_PPC_RTAS_FILTER has been optional but default-enabled since its introduction. It's been enabled in enterprise distro kernels for a while without causing ABI breakage that wasn't easily fixed, and it prevents harmful abuses of the rtas syscall.
Let's make it unconditional.
--- arch/powerpc/Kconfig | 13 ------------- arch/powerpc/kernel/rtas.c | 16 ---------------- 2 files changed, 29 deletions(-)
arch/powerpc/Kconfig +0 -13
@@ -1012,19 +1012,6 @@ config PPC_SECVAR_SYSFS read/write operations on these variables. Say Y if you have secure boot enabled and want to expose variables to userspace. -config PPC_RTAS_FILTER - bool "Enable filtering of RTAS syscalls" - default y - depends on PPC_RTAS - help - The RTAS syscall API has security issues that could be used to - compromise system integrity. This option enforces restrictions on the - RTAS calls and arguments passed by userspace programs to mitigate - these issues. - - Say Y unless you know what you are doing and the filter is causing - problems for you. - endmenu config ISA_DMA_API
arch/powerpc/kernel/rtas.c +0 -16
@@ -1051,8 +1051,6 @@ noinstr struct pseries_errorlog *get_pseries_errorlog(struct rtas_error_log *logreturn NULL ; } -#ifdef CONFIG_PPC_RTAS_FILTER -/* * The sys_rtas syscall, as originally designed, allows root to pass * arbitrary physical addresses to RTAS calls. A number of RTAS calls
@@ -1201,20 +1199,6 @@ static void __init rtas_syscall_filter_init(void) rtas_filters[i].token =rtas_token (rtas_filters[i].name); } -#else - -static bool block_rtas_call (int token,int nargs, -struct rtas_args *args) -{ -return false; -} - -static void __init rtas_syscall_filter_init (void ) -{ -} - -#endif /* CONFIG_PPC_RTAS_FILTER */ -/* We assume to be passed big endian arguments */ SYSCALL_DEFINE1(rtas, struct rtas_args __user *, uargs) {
Signature · 1 line
2.37.1
Re: [PATCH 09/13] powerpc/rtas: mandate RTAS syscall filtering
Quoted 9 lines · Nathan Lynch
CONFIG_PPC_RTAS_FILTERhas been optional but default-enabled since its
introduction. It's been enabled in enterprise distro kernels for a while without causing ABI breakage that wasn't easily fixed, and it prevents harmful abuses of the rtas syscall.Let's make it unconditional.
Signed-off-by Nathan Lynch <[email protected]>
Agreed.
Quoted 72 lines
---
arch/powerpc/Kconfig | 13 -------------
arch/powerpc/kernel/rtas.c | 16 ----------------2 files changed, 29 deletions(-)arch/powerpc/Kconfig +0
-0@@ -1012,19 +1012,6 @@ config PPC_SECVAR_SYSFSread/write operations on these variables. Say Y if you have secure boot enabled and want to expose variables to userspace.
-configPPC_RTAS_FILTER
- bool "Enable filtering of RTAS syscalls"
- default y
- depends onPPC_RTAS
- help
- The RTAS syscall API has security issues that could be used to
- compromise system integrity. This option enforces restrictions on the
- RTAS calls and arguments passed by userspace programs to mitigate
- these issues.
-
- Say Y unless you know what you are doing and the filter is causing
- problems for you.
-
endmenu
configISA_DMA_APIarch/powerpc/kernel/rtas.c +0
-0@@ -1051,8 +1051,6 @@ noinstr struct pseries_errorlog *get_pseries_errorlog(struct rtas_error_log *log return NULL; }arch/powerpc/kernel/rtas.c +0
-2-#ifdef CONFIG_PPC_RTAS_FILTER -/*
* Thesys_rtassyscall, as originally designed, allows root to pass
* arbitrary physical addresses to RTAS calls. A number of RTAS callsarch/powerpc/kernel/rtas.c +0
-0@@ -1201,20 +1199,6 @@ static void __initrtas_syscall_filter_init (void)rtas_filters[i].token =
rtas_token(rtas_filters[i].name);
}arch/powerpc/kernel/rtas.c +0
-14-#else - -static bool block_rtas_call (int token,int nargs, - struct rtas_args *args) -{ - return false; -} - -static void __init rtas_syscall_filter_init (void ) -{ -} - -#endif /* CONFIG_PPC_RTAS_FILTER */ -/* We assume to be passed big endian arguments */
SYSCALL_DEFINE1(rtas, struct rtas_args __user *, uargs){
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
PATCH 10/13 powerpc/rtas: improve function information lookups
In reply to Nathan LynchThe core RTAS support code and its clients perform two types of lookup for RTAS firmware function information.
First, mapping a known function name to a token. The typical use case invokes rtas_token() to retrieve the token value to pass to rtas_call(). rtas_token() relies on of_get_property(), which performs a linear search of the /rtas node's property list under a lock with IRQs disabled.
Second, and less common: given a token value, looking up some information about the function. The primary example is the sys_rtas filter path, which linearly scans a small table to match the token to a rtas_filter struct. Another use case to come is RTAS entry/exit tracepoints, which will require efficient lookup of function names from token values. Currently there is no general API for this.
We need something much like the existing rtas_filters table, but more general and organized to facilitate efficient lookups.
Introduce:
* A new rtas_function type, aggregating function name, token, and filter. Other function characteristics could be added in the future.
* An array of rtas_function, where each element corresponds to a known RTAS function. All information in the table is static save the token values, which are derived from the device tree at boot. The array is sorted by function name to allow binary search.
* A named constant for each known RTAS function, used to index the function array. These also will be used in a client-facing API to be added later.
* An xarray that maps valid tokens to rtas_function objects.
Fold the existing rtas_filter table into the new rtas_function array, with the appropriate adjustments to block_rtas_call(). Remove now-redundant fields from struct rtas_filter.
Convert rtas_token() to use a lockless binary search on the function table. Fall back to the old behavior for lookups against names that are not known to be RTAS functions, but issue a warning. rtas_token() is for function names; it is not a general facility for accessing arbitrary properties of the /rtas node. All known misuses of rtas_token() have been converted to more appropriate of_ APIs in preceding changes.
--- arch/powerpc/include/asm/rtas.h | 87 ++++ arch/powerpc/kernel/rtas.c | 735 +++++++++++++++++++++++++++----- 2 files changed, 709 insertions(+), 113 deletions(-)
arch/powerpc/include/asm/rtas.h +87 -0
@@ -16,6 +16,93 @@* Copyright (C) 2001 PPC 64 Team, IBM Corp */ +#define rtas_fnidx (x_) RTAS_FNIDX__ ## x_ + +enum rtas_function_index { + rtas_fnidx(CHECK_EXCEPTION), + rtas_fnidx(DISPLAY_CHARACTER), + rtas_fnidx(EVENT_SCAN), + rtas_fnidx(FREEZE_TIME_BASE), + rtas_fnidx(GET_POWER_LEVEL), + rtas_fnidx(GET_SENSOR_STATE), + rtas_fnidx(GET_TERM_CHAR), + rtas_fnidx(GET_TIME_OF_DAY), + rtas_fnidx(IBM_ACTIVATE_FIRMWARE), + rtas_fnidx(IBM_CBE_START_PTCAL), + rtas_fnidx(IBM_CBE_STOP_PTCAL), + rtas_fnidx(IBM_CHANGE_MSI), + rtas_fnidx(IBM_CLOSE_ERRINJCT), + rtas_fnidx(IBM_CONFIGURE_BRIDGE), + rtas_fnidx(IBM_CONFIGURE_CONNECTOR), + rtas_fnidx(IBM_CONFIGURE_KERNEL_DUMP), + rtas_fnidx(IBM_CONFIGURE_PE), + rtas_fnidx(IBM_CREATE_PE_DMA_WINDOW), + rtas_fnidx(IBM_DISPLAY_MESSAGE), + rtas_fnidx(IBM_ERRINJCT), + rtas_fnidx(IBM_EXTI2C), + rtas_fnidx(IBM_GET_CONFIG_ADDR_INFO), + rtas_fnidx(IBM_GET_CONFIG_ADDR_INFO2), + rtas_fnidx(IBM_GET_DYNAMIC_SENSOR_STATE), + rtas_fnidx(IBM_GET_INDICES), + rtas_fnidx(IBM_GET_RIO_TOPOLOGY), + rtas_fnidx(IBM_GET_SYSTEM_PARAMETER), + rtas_fnidx(IBM_GET_VPD), + rtas_fnidx(IBM_GET_XIVE), + rtas_fnidx(IBM_INT_OFF), + rtas_fnidx(IBM_INT_ON), + rtas_fnidx(IBM_IO_QUIESCE_ACK), + rtas_fnidx(IBM_LPAR_PERFTOOLS), + rtas_fnidx(IBM_MANAGE_FLASH_IMAGE), + rtas_fnidx(IBM_MANAGE_STORAGE_PRESERVATION), + rtas_fnidx(IBM_NMI_INTERLOCK), + rtas_fnidx(IBM_NMI_REGISTER), + rtas_fnidx(IBM_OPEN_ERRINJCT), + rtas_fnidx(IBM_OPEN_SRIOV_ALLOW_UNFREEZE), + rtas_fnidx(IBM_OPEN_SRIOV_MAP_PE_NUMBER), + rtas_fnidx(IBM_OS_TERM), + rtas_fnidx(IBM_PARTNER_CONTROL), + rtas_fnidx(IBM_PHYSICAL_ATTESTATION), + rtas_fnidx(IBM_PLATFORM_DUMP), + rtas_fnidx(IBM_POWER_OFF_UPS), + rtas_fnidx(IBM_QUERY_INTERRUPT_SOURCE_NUMBER), + rtas_fnidx(IBM_QUERY_PE_DMA_WINDOW), + rtas_fnidx(IBM_READ_PCI_CONFIG), + rtas_fnidx(IBM_READ_SLOT_RESET_STATE), + rtas_fnidx(IBM_READ_SLOT_RESET_STATE2), + rtas_fnidx(IBM_REMOVE_PE_DMA_WINDOW), + rtas_fnidx(IBM_RESET_PE_DMA_WINDOWS), + rtas_fnidx(IBM_SCAN_LOG_DUMP), + rtas_fnidx(IBM_SET_DYNAMIC_INDICATOR), + rtas_fnidx(IBM_SET_EEH_OPTION), + rtas_fnidx(IBM_SET_SLOT_RESET), + rtas_fnidx(IBM_SET_SYSTEM_PARAMETER), + rtas_fnidx(IBM_SET_XIVE), + rtas_fnidx(IBM_SLOT_ERROR_DETAIL), + rtas_fnidx(IBM_SUSPEND_ME), + rtas_fnidx(IBM_TUNE_DMA_PARMS), + rtas_fnidx(IBM_UPDATE_FLASH_64_AND_REBOOT), + rtas_fnidx(IBM_UPDATE_NODES), + rtas_fnidx(IBM_UPDATE_PROPERTIES), + rtas_fnidx(IBM_VALIDATE_FLASH_IMAGE), + rtas_fnidx(IBM_WRITE_PCI_CONFIG), + rtas_fnidx(NVRAM_FETCH), + rtas_fnidx(NVRAM_STORE), + rtas_fnidx(POWER_OFF), + rtas_fnidx(PUT_TERM_CHAR), + rtas_fnidx(QUERY_CPU_STOPPED_STATE), + rtas_fnidx(READ_PCI_CONFIG), + rtas_fnidx(RTAS_LAST_ERROR), + rtas_fnidx(SET_INDICATOR), + rtas_fnidx(SET_POWER_LEVEL), + rtas_fnidx(SET_TIME_FOR_POWER_ON), + rtas_fnidx(SET_TIME_OF_DAY), + rtas_fnidx(START_CPU), + rtas_fnidx(STOP_SELF), + rtas_fnidx(SYSTEM_REBOOT), + rtas_fnidx(THAW_TIME_BASE), + rtas_fnidx(WRITE_PCI_CONFIG), +}; +#define RTAS_UNKNOWN_SERVICE (-1)#define RTAS_INSTANTIATE_MAX (1ULL<<30)/* Don't instantiate rtas at/above this value */
arch/powerpc/kernel/rtas.c +622 -113
805 lines not on this page · raw message
Signature · 1 line
2.37.1
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
Quoted 7 lines · Nathan Lynch
Convert
rtas_token()to use a lockless binary search on the function table. Fall back to the old behavior for lookups against names that are not known to be RTAS functions, but issue a warning.rtas_token()is for function names; it is not a general facility for accessing arbitrary properties of the /rtas node. All known misuses ofrtas_token()have been converted to more appropriateof_APIs in preceding changes.
For in-kernel users, why not go all the way: make rtas_token() static and use it purely for the userspace API, and switch kernel users over to using rtas_function_index directly?
arch/powerpc/kernel/rtas.c line 45
Quoted 3 lines
arch/powerpc/kernel/rtas.c +3
-0+enum rtas_function_flags { + RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE = (1 << 0), +};
This seems to be new, what's the justification?
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
Quoted 7 lines · Andrew Donnellan
arch/powerpc/kernel/rtas.c line 45
Quoted 3 lines · Nathan Lynch
arch/powerpc/kernel/rtas.c +3
-0+enum rtas_function_flags { + RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE = (1 << 0), +};This seems to be new, what's the justification?
Seems to be a run-time replacement of:
#ifdef CONFIG_CPU_BIG_ENDIAN
{ "ibm,suspend-me", -1, -1, -1, -1, -1 },
{ "ibm,update-nodes", -1, 0, -1, -1, -1, 4096 },
{ "ibm,update-properties", -1, 0, -1, -1, -1, 4096 },#endif
It looks to be handled logically:
+ if (IS_ENABLED(CONFIG_CPU_LITTLE_ENDIAN) &&
+ (func->flags & RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE))
+ goto err;
Perhaps, also allow the addition of any future special cases for rtas functions easier to maintain?
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
Quoted 16 lines · Nick Child
Quoted 7 lines · Andrew Donnellan
arch/powerpc/kernel/rtas.c line 45
Quoted 3 lines · Nathan Lynch
arch/powerpc/kernel/rtas.c +3
-0+enum rtas_function_flags { + RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE = (1 << 0), +};This seems to be new, what's the justification?
Seems to be a run-time replacement of:
#ifdefCONFIG_CPU_BIG_ENDIAN
{ "ibm,suspend-me", -1, -1, -1, -1, -1 },
{ "ibm,update-nodes", -1, 0, -1, -1, -1, 4096 }, { "ibm,update-properties", -1, 0, -1, -1, -1, 4096 }, #endif
Quoted 7 lines
It looks to be handled logically:
+ if (IS_ENABLED(CONFIG_CPU_LITTLE_ENDIAN)&&
+ (func->flags&RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE)) + goto err;Perhaps, also allow the addition of any future special cases for rtas functions easier to maintain?
Makes sense, though I'm slightly confused about the original rationale for the ifdef and why it's not being fixed in userspace.
Slightly clunky name though, something like RTAS_FN_FLAG_SYSCALL_BE_ONLY might be less clunky?
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
Quoted 22 lines · Andrew Donnellan
Quoted 21 lines · Nick Child
Quoted 7 lines · Andrew Donnellan
arch/powerpc/kernel/rtas.c line 45
Quoted 3 lines · Nathan Lynch
arch/powerpc/kernel/rtas.c +3
-0+enum rtas_function_flags { + RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE = (1 << 0), +};This seems to be new, what's the justification?
Seems to be a run-time replacement of:
#ifdefCONFIG_CPU_BIG_ENDIAN
{ "ibm,suspend-me", -1, -1, -1, -1, -1 },
{ "ibm,update-nodes", -1, 0, -1, -1, -1, 4096 }, { "ibm,update-properties", -1, 0, -1, -1, -1, 4096 }, #endifIt looks to be handled logically:
+ if (IS_ENABLED(CONFIG_CPU_LITTLE_ENDIAN)&&
+ (func->flags&RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE)) + goto err;
Quoted 5 lines
Quoted 2 lines
Perhaps, also allow the addition of any future special cases for rtas functions easier to maintain?
Makes sense, though I'm slightly confused about the original rationale for the ifdef and why it's not being fixed in userspace.
Nick C's explanation is correct. I will make the commit message more explicit about the conversion, and document the flag in the code.
The original rationale:
commit de0f7349a0dd072e54b5fc04c305907b22d28a5f
Author: Nathan Lynch <[email protected]> Date: Mon Dec 7 15:51:33 2020 -0600
powerpc/rtas: prevent suspend-related sys_rtas use on LE
While drmgr has had work in some areas to make its RTAS syscall interactions endian-neutral, its code for performing partition migration via the syscall has never worked on LE. While it is able to complete ibm,suspend-me successfully, it crashes when attempting the subsequent ibm,update-nodes call.
drmgr is the only known (or plausible) user of ibm,suspend-me, ibm,update-nodes, and ibm,update-properties, so allow them only in big-endian configurations.
To summarize: we know these functions have never had working users via sys_rtas on ppc64le, and we want to keep it that way.
Quoted 2 lines
Slightly clunky name though, something like
RTAS_FN_FLAG_SYSCALL_BE_ONLYmight be less clunky?
RTAS_FN_FLAG_BANNED_FOR_SYSCALL_ON_LE is verbose, but I think it communicates better that we are consciously imposing a policy in a specific context.
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
In reply to Andrew DonnellanQuoted 11 lines · Andrew Donnellan
Quoted 7 lines · Nathan Lynch
Convert
rtas_token()to use a lockless binary search on the function table. Fall back to the old behavior for lookups against names that are not known to be RTAS functions, but issue a warning.rtas_token()is for function names; it is not a general facility for accessing arbitrary properties of the /rtas node. All known misuses ofrtas_token()have been converted to more appropriateof_APIs in preceding changes.For in-kernel users, why not go all the way: make
rtas_token()static and use it purely for the userspace API,
Not sure what userspace API refers to here, can you be more specific? I don't think rtas_token() is exposed to user space.
Quoted 2 lines
and switch kernel users over
to usingrtas_function_indexdirectly?
Well, I have work in progress to transition all rtas_token() users to a different API, but using opaque symbolic handles rather than exposing the indexes. Something like:
/*
* Opaque handle for client code to refer to RTAS functions. All valid
* function handles are build-time constants prefixed with RTAS_FN_. */
typedef struct {
enum rtas_function_index index;
} rtas_fn_handle_t;#define rtas_fn_handle(x_) (const rtas_fn_handle_t) { .index = rtas_fnidx(x_), }
#define RTAS_FN_CHECK_EXCEPTION rtas_fn_handle(CHECK_EXCEPTION) #define RTAS_FN_DISPLAY_CHARACTER rtas_fn_handle(DISPLAY_CHARACTER) #define RTAS_FN_EVENT_SCAN rtas_fn_handle(EVENT_SCAN)
...
/**
* rtas_function_token() - RTAS function token lookup.
* @handle: Function handle, e.g. RTAS_FN_EVENT_SCAN.
*
* Context: Any context.
* Return: the token value for the function if implemented by this platform,
* otherwise RTAS_UNKNOWN_SERVICE.
*/
s32 rtas_function_token(const rtas_fn_handle_t handle)
{
const size_t index = handle.index;
const bool out_of_bounds = index >= ARRAY_SIZE(rtas_function_table);
if (WARN_ONCE(out_of_bounds, "invalid function index %zu", index))
return RTAS_UNKNOWN_SERVICE;
return rtas_function_table[index].token;
}But that's a tree-wide change that would touch various drivers, and I feel like the current series is what I can reasonably hope to get applied right now.
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
Quoted 13 lines · Nathan Lynch
Quoted 12 lines · Andrew Donnellan
Quoted 10 lines · Nathan Lynch
Convert
rtas_token()to use a lockless binary search on the function
table. Fall back to the old behavior for lookups against names that
are not known to be RTAS functions, but issue a warning.rtas_token()
is for function names; it is not a general facility for accessing arbitrary properties of the /rtas node. All known misuses ofrtas_token()have been converted to more appropriateof_APIs in preceding changes.
Quoted 7 lines
Quoted 3 lines
For in-kernel users, why not go all the way: make
rtas_token()static
and use it purely for the userspace API,Not sure what userspace API refers to here, can you be more specific? I
don't thinkrtas_token()is exposed to user space.
Right, what I actually meant to refer to here is the fact that sys_rtas takes a token, but when I wrote this I forgot that userspace doesn't pass a string, rather librtas implements rtas_token itself using the /proc interface to the device tree.
Quoted 49 lines
Quoted 3 lines
and switch kernel users over
to usingrtas_function_indexdirectly?Well, I have work in progress to transition all
rtas_token()users to a
different API, but using opaque symbolic handles rather than exposing the indexes. Something like:/*
* Opaque handle for client code to refer to RTAS functions. All valid
* function handles are build-time constants prefixed withRTAS_FN_. */
typedef struct {
enumrtas_function_indexindex;
}rtas_fn_handle_t;#define
rtas_fn_handle(x_)(constrtas_fn_handle_t) { .index =rtas_fnidx(x_), }#define
RTAS_FN_CHECK_EXCEPTIONrtas_fn_handle(CHECK_EXCEPTION)
#defineRTAS_FN_DISPLAY_CHARACTERrtas_fn_handle(DISPLAY_CHARACTER)
#defineRTAS_FN_EVENT_SCANrtas_fn_handle(EVENT_SCAN)...
/**
*rtas_function_token()- RTAS function token lookup.
* @handle: Function handle, e.g.RTAS_FN_EVENT_SCAN.
*
* Context: Any context.
* Return: the token value for the function if implemented by this platform,
* otherwiseRTAS_UNKNOWN_SERVICE.
*/
s32rtas_function_token(const rtas_fn_handle_t handle){
constsize_tindex = handle.index;
const boolout_of_bounds= index >=ARRAY_SIZE(rtas_function_table);if (
WARN_ONCE(out_of_bounds, "invalid function index %zu", index))
returnRTAS_UNKNOWN_SERVICE;
Quoted 6 lines
return rtas_function_table[index].token;
}But that's a tree-wide change that would touch various drivers, and I feel like the current series is what I can reasonably hope to get applied right now.
It's not clear to me what the benefit of adding this additional layer of indirection would be.
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
Quoted 62 lines · Andrew Donnellan
Quoted 61 lines · Nathan Lynch
Quoted 9 lines · Andrew Donnellan
Quoted 7 lines · Nathan Lynch
Convert
rtas_token()to use a lockless binary search on the function table. Fall back to the old behavior for lookups against names that are not known to be RTAS functions, but issue a warning.rtas_token()is for function names; it is not a general facility for accessing arbitrary properties of the /rtas node. All known misuses ofrtas_token()have been converted to more appropriateof_APIs in preceding changes.Quoted 3 lines
For in-kernel users, why not go all the way: make
rtas_token()static and use it purely for the userspace API, and switch kernel users over to usingrtas_function_indexdirectly?Well, I have work in progress to transition all
rtas_token()users to a different API, but using opaque symbolic handles rather than exposing the indexes. Something like:/*
* Opaque handle for client code to refer to RTAS functions. All valid
* function handles are build-time constants prefixed withRTAS_FN_. */
typedef struct {
enumrtas_function_indexindex;
}rtas_fn_handle_t;#define
rtas_fn_handle(x_)(constrtas_fn_handle_t) { .index =rtas_fnidx(x_), }#define
RTAS_FN_CHECK_EXCEPTIONrtas_fn_handle(CHECK_EXCEPTION)
#defineRTAS_FN_DISPLAY_CHARACTERrtas_fn_handle(DISPLAY_CHARACTER)
#defineRTAS_FN_EVENT_SCANrtas_fn_handle(EVENT_SCAN)...
/**
*rtas_function_token()- RTAS function token lookup.
* @handle: Function handle, e.g.RTAS_FN_EVENT_SCAN.
*
* Context: Any context.
* Return: the token value for the function if implemented by this platform,
* otherwiseRTAS_UNKNOWN_SERVICE.
*/
s32rtas_function_token(const rtas_fn_handle_t handle){
constsize_tindex = handle.index;
const boolout_of_bounds= index >=ARRAY_SIZE(rtas_function_table);if (
WARN_ONCE(out_of_bounds, "invalid function index %zu", index))
returnRTAS_UNKNOWN_SERVICE;return rtas_function_table[index].token;
}
Quoted 6 lines
Quoted 3 lines
But that's a tree-wide change that would touch various drivers, and I feel like the current series is what I can reasonably hope to get applied right now.
It's not clear to me what the benefit of adding this additional layer of indirection would be.
One benefit would be that the type system won't let you use a token (int) where you meant to use a handle (struct), and vice versa. I anticipate that property being valuable for making API changes. But also it's just good interface hygiene: how the token lookup is implemented isn't the concern of code outside of rtas.c.
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
In reply to Nathan LynchQuoted 20 lines · Nathan Lynch
arch/powerpc/kernel/rtas.c +20
-0+static int __init rtas_token_to_function_xarray_init (void ) +{ +int err =0 ; + +for (size_t i =0 ; i <ARRAY_SIZE (rtas_function_table); ++i) { +const struct rtas_function *func = &rtas_function_table[i]; +const s32 token = func->token; + +if (token ==RTAS_UNKNOWN_SERVICE ) +continue ; + + err =xa_err (xa_store (&rtas_token_to_function_xarray, + token, (void *)func,GFP_KERNEL )); +if (err) +break ; + } + +return err; +} +arch_initcall (rtas_token_to_function_xarray_init);
arch/powerpc/kernel/rtas.c line 515
Quoted 10 lines
arch/powerpc/kernel/rtas.c +10
-0+ +static const struct rtas_function *rtas_token_to_function (s32 token) +{ +const struct rtas_function *func; + +if (WARN_ONCE (token <0 ,"invalid token %d" , token)) +return NULL ; + + func =xa_load (&rtas_token_to_function_xarray, (unsigned long )token); +
Why typecast token here and not in xa_store?
Quoted 21 lines
arch/powerpc/kernel/rtas.c +21
-0+static void __init rtas_function_table_init (void ) +{ +struct property *prop; + +for (size_t i =0 ; i <ARRAY_SIZE (rtas_function_table); ++i) { +struct rtas_function *curr = &rtas_function_table[i]; +struct rtas_function *prior; +int cmp; + + curr->token =RTAS_UNKNOWN_SERVICE ; + +if (i ==0 ) +continue ; +/* +* Ensure table is sorted correctly for binary search +* on function names. +*/ + prior = &rtas_function_table[i -1 ]; + + cmp =strcmp (prior->name, curr->name); +if (cmp <0 )
arch/powerpc/kernel/rtas.c SYSCALL_DEFINE1(rtas, struct rtas_args __user *, uargs) · line 1790
Quoted 10 lines
arch/powerpc/kernel/rtas.c +10
-0+continue ; + +if (cmp ==0 ) { +pr_err ("'%s' has duplicate function table entries\n" , + curr->name); + }else { +pr_err ("function table unsorted: '%s' wrongly precedes '%s'\n" , + prior->name, curr->name); + } + }
Just a thought, would it be simpler to use sort()? you already have the cmp_func implemented for bsearch().
As for the series as a whole:
I am no RTAS expert but was able to build, boot and mess around with new tracepoints without errors:
Re: [PATCH 10/13] powerpc/rtas: improve function information lookups
Quoted 24 lines · Nick Child
Quoted 23 lines · Nathan Lynch
arch/powerpc/kernel/rtas.c +23
-0+static int __init rtas_token_to_function_xarray_init (void ) +{ +int err =0 ; + +for (size_t i =0 ; i <ARRAY_SIZE (rtas_function_table); ++i) { +const struct rtas_function *func = &rtas_function_table[i]; +const s32 token = func->token; + +if (token ==RTAS_UNKNOWN_SERVICE ) +continue ; + + err =xa_err (xa_store (&rtas_token_to_function_xarray, + token, (void *)func,GFP_KERNEL )); +if (err) +break ; + } + +return err; +} +arch_initcall (rtas_token_to_function_xarray_init); + +static const struct rtas_function *rtas_token_to_function (s32 token) +{
Quoted 8 lines
arch/powerpc/kernel/rtas.c line 515
Quoted 7 lines
arch/powerpc/kernel/rtas.c +7
-0+const struct rtas_function *func; + +if (WARN_ONCE (token <0 ,"invalid token %d" , token)) +return NULL ; + + func =xa_load (&rtas_token_to_function_xarray, (unsigned long )token); +Why typecast token here and not in
xa_store?
No good reason. I'll add it to the xa_store() call site.
Quoted 25 lines
Quoted 25 lines
arch/powerpc/kernel/rtas.c +25
-0+static void __init rtas_function_table_init (void ) +{ +struct property *prop; + +for (size_t i =0 ; i <ARRAY_SIZE (rtas_function_table); ++i) { +struct rtas_function *curr = &rtas_function_table[i]; +struct rtas_function *prior; +int cmp; + + curr->token =RTAS_UNKNOWN_SERVICE ; + +if (i ==0 ) +continue ; +/* +* Ensure table is sorted correctly for binary search +* on function names. +*/ + prior = &rtas_function_table[i -1 ]; + + cmp =strcmp (prior->name, curr->name); +if (cmp <0 ) +continue ; + +if (cmp ==0 ) { + pr_err("'%s' has duplicate function table entries\n",
Quoted 8 lines
arch/powerpc/kernel/rtas.c SYSCALL_DEFINE1(rtas, struct rtas_args __user *, uargs) · line 1790
Quoted 6 lines
arch/powerpc/kernel/rtas.c +6
-0+ curr->name); + }else { +pr_err ("function table unsorted: '%s' wrongly precedes '%s'\n" , + prior->name, curr->name); + } + }Just a thought, would it be simpler to use
sort()? you already have thecmp_funcimplemented forbsearch().
It's an option, but I think a tradeoff is that we would have to sacrifice some const-ness in the data structures (i.e. remove the const qualifier from struct rtas_function's fields). And the table has to be in *some* order, so it may as well be sorted by name from the start.
That said, I don't love resorting to a boot-time check for this. We could sidestep the issue by generating the C code for the table and indexes at build time, but it's hard to justify the effort when the set of RTAS functions changes very slowly over time.
Quoted 5 lines
As for the series as a whole:
I am no RTAS expert but was able to build, boot and mess around with new tracepoints without errors:Tested-by Nick Child <[email protected]>
Thanks for testing and reviewing!
PATCH 11/13 powerpc/rtas: strengthen do_enter_rtas() type safety, drop inline
In reply to Nathan LynchMake do_enter_rtas() take a pointer to struct rtas_args and do the __pa() conversion in one place instead of leaving it to callers. This also makes it possible to introduce enter/exit tracepoints that access the rtas_args struct fields.
There's no apparent reason to force inlining of do_enter_rtas() either, and it seems to bloat the code a bit. Let the compiler decide.
--- arch/powerpc/kernel/rtas.c | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-)
arch/powerpc/kernel/rtas.c +5 -5
@@ -522,7 +522,7 @@ static const struct rtas_function *rtas_token_to_function(s32 token)/* This is here deliberately so it's only used in this file */ void enter_rtas (unsigned long ); -static inline void do_enter_rtas (unsigned long args) +static void do_enter_rtas (struct rtas_args *args) {unsigned long msr;
@@ -537,7 +537,7 @@ static inline void do_enter_rtas(unsigned long args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ -enter_rtas (args); +enter_rtas (__pa (args));srr_regs_clobbered ();/* rtas uses SRRs, invalidate */ }
@@ -908,7 +908,7 @@ static char *__fetch_rtas_last_error(char *altbuf) save_args = rtas.args; rtas.args = err_args; -do_enter_rtas (__pa (&rtas.args)); +do_enter_rtas (&rtas.args); err_args = rtas.args; rtas.args = save_args;
@@ -955,7 +955,7 @@ va_rtas_call_unlocked(struct rtas_args *args, int token, int nargs, int nret,for (i =0 ; i < nret; ++i) args->rets[i] =0 ; -do_enter_rtas (__pa (args)); +do_enter_rtas (args); }void rtas_call_unlocked (struct rtas_args *args,int token,int nargs,int nret, ...)
@@ -1731,7 +1731,7 @@ SYSCALL_DEFINE1(rtas, struct rtas_args __user *, uargs) flags =lock_rtas (); rtas.args = args; -do_enter_rtas (__pa (&rtas.args)); +do_enter_rtas (&rtas.args); args = rtas.args;/* A -1 return code indicates that the last command couldn't
Signature · 1 line
2.37.1
Re: [PATCH 11/13] powerpc/rtas: strengthen do_enter_rtas() type safety, drop inline
Quoted 11 lines · Nathan Lynch
Make
do_enter_rtas()take a pointer to structrtas_argsand do the__pa()conversion in one place instead of leaving it to callers. This also makes it possible to introduce enter/exit tracepoints that access
thertas_argsstruct fields.There's no apparent reason to force inlining of
do_enter_rtas()either, and it seems to bloat the code a bit. Let the compiler decide.Signed-off-by Nathan Lynch <[email protected]>
Makes sense!
Quoted 59 lines
---
arch/powerpc/kernel/rtas.c | 10 +++++-----1 file changed, 5 insertions(+), 5 deletions(-)arch/powerpc/kernel/rtas.c +0
-0@@ -522,7 +522,7 @@ static const struct rtas_function *rtas_token_to_function(s32 token) /* This is here deliberately so it's only used in this file */ void enter_rtas(unsigned long);arch/powerpc/kernel/rtas.c +1
-1-static inline void do_enter_rtas (unsigned long args) +static void do_enter_rtas (struct rtas_args *args){
unsigned long msr;arch/powerpc/kernel/rtas.c +0
-0@@ -537,7 +537,7 @@ static inline void do_enter_rtas(unsigned long args)
hard_irq_disable(); /* Ensure MSR[EE] is disabled on PPC64 */
- enter_rtas(args);
+ enter_rtas(__pa(args));
srr_regs_clobbered(); /* rtas uses SRRs, invalidate */ }arch/powerpc/kernel/rtas.c +0
-0@@ -908,7 +908,7 @@ static char *__fetch_rtas_last_error(char *altbuf) save_args = rtas.args; rtas.args = err_args;
- do_enter_rtas(__pa(&rtas.args));
+ do_enter_rtas(&rtas.args);
err_args = rtas.args;
rtas.args =save_args;arch/powerpc/kernel/rtas.c +0
-0@@ -955,7 +955,7 @@ va_rtas_call_unlocked(struct rtas_args *args, int token, int nargs, int nret, for (i = 0; i < nret; ++i) args->rets[i] = 0;
- do_enter_rtas(__pa(args));
+ do_enter_rtas(args);
}
voidrtas_call_unlocked(struct rtas_args *args, int token, int nargs, int nret, ...)arch/powerpc/kernel/rtas.c +0
-0@@ -1731,7 +1731,7 @@ SYSCALL_DEFINE1(rtas, struct rtas_args __user *, uargs) flags = lock_rtas();
rtas.args = args;
- do_enter_rtas(__pa(&rtas.args));
+ do_enter_rtas(&rtas.args);
args = rtas.args;
/* A -1 return code indicates that the last command couldn't
Signature · 2 lines
Andrew Donnellan OzLabs, ADL Canberra [email protected] IBM Australia Limited
Re: [PATCH 11/13] powerpc/rtas: strengthen do_enter_rtas() type safety, drop inline
In reply to Nathan LynchQuoted 7 lines · Nathan Lynch
Make
do_enter_rtas()take a pointer to structrtas_argsand do the__pa()conversion in one place instead of leaving it to callers. This also makes it possible to introduce enter/exit tracepoints that access thertas_argsstruct fields.There's no apparent reason to force inlining of
do_enter_rtas()either, and it seems to bloat the code a bit. Let the compiler decide.
Quoted 57 lines
Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-)arch/powerpc/kernel/rtas.c +5
-5@@ -522,7 +522,7 @@ static const struct rtas_function *rtas_token_to_function(s32 token)/* This is here deliberately so it's only used in this file */ void enter_rtas (unsigned long ); -static inline void do_enter_rtas (unsigned long args) +static void do_enter_rtas (struct rtas_args *args) {unsigned long msr;@@ -537,7 +537,7 @@ static inline void do_enter_rtas(unsigned long args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ -enter_rtas (args); +enter_rtas (__pa (args));srr_regs_clobbered ();/* rtas uses SRRs, invalidate */ }@@ -908,7 +908,7 @@ static char *__fetch_rtas_last_error(char *altbuf) save_args = rtas.args; rtas.args = err_args; -do_enter_rtas (__pa (&rtas.args)); +do_enter_rtas (&rtas.args); err_args = rtas.args; rtas.args = save_args;@@ -955,7 +955,7 @@ va_rtas_call_unlocked(struct rtas_args *args, int token, int nargs, int nret,for (i =0 ; i < nret; ++i) args->rets[i] =0 ; -do_enter_rtas (__pa (args)); +do_enter_rtas (args); }void rtas_call_unlocked (struct rtas_args *args,int token,int nargs,int nret, ...)@@ -1731,7 +1731,7 @@ SYSCALL_DEFINE1(rtas, struct rtas_args __user *, uargs) flags =lock_rtas (); rtas.args = args; -do_enter_rtas (__pa (&rtas.args)); +do_enter_rtas (&rtas.args); args = rtas.args;/* A -1 return code indicates that the last command couldn't Signature · 1 line
2.37.1
PATCH 12/13 powerpc/tracing: tracepoints for RTAS entry and exit
In reply to Nathan LynchAdd two sets of tracepoints to be used around RTAS entry:
* rtas_input/rtas_output, which emit the function name, its inputs, the returned status, and any other outputs. These produce an API-level record of OS<->RTAS activity.
* rtas_ll_entry/rtas_ll_exit, which are lower-level and emit the entire contents of the parameter block (aka rtas_args) on entry and exit. Likely useful only for debugging.
With uses of these tracepoints in do_enter_rtas() to be added in the following patch, examples of get-time-of-day and event-scan functions as rendered by trace-cmd (with some multi-line formatting manually imposed on the rtas_ll_* entries to avoid extremely long lines in the commit message):
cat-36800 [059] 4978.518303: rtas_input: get-time-of-day arguments:
cat-36800 [059] 4978.518306: rtas_ll_entry: token=3 nargs=0 nret=8
params: [0]=0x00000000 [1]=0x00000000 [2]=0x00000000 [3]=0x00000000
[4]=0x00000000 [5]=0x00000000 [6]=0x00000000 [7]=0x00000000
[8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000
[12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000
cat-36800 [059] 4978.518366: rtas_ll_exit: token=3 nargs=0 nret=8
params: [0]=0x00000000 [1]=0x000007e6 [2]=0x0000000b [3]=0x00000001
[4]=0x00000000 [5]=0x0000000e [6]=0x00000008 [7]=0x2e0dac40
[8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000
[12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000cat-36800 [059] 4978.518366: rtas_output: get-time-of-day status: 0, other outputs: 2022 11 1 0 14 8 772648000
kworker/39:1-336 [039] 4982.731623: rtas_input: event-scan arguments: 4294967295 0 80484920 2048
kworker/39:1-336 [039] 4982.731626: rtas_ll_entry: token=6 nargs=4 nret=1
params: [0]=0xffffffff [1]=0x00000000 [2]=0x04cc1a38 [3]=0x00000800
[4]=0x00000000 [5]=0x0000000e [6]=0x00000008 [7]=0x2e0dac40
[8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000
[12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000
kworker/39:1-336 [039] 4982.731676: rtas_ll_exit: token=6 nargs=4 nret=1
params: [0]=0xffffffff [1]=0x00000000 [2]=0x04cc1a38 [3]=0x00000800
[4]=0x00000001 [5]=0x0000000e [6]=0x00000008 [7]=0x2e0dac40
[8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000
[12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000kworker/39:1-336 [039] 4982.731677: rtas_output: event-scan status: 1, other outputs:
--- arch/powerpc/include/asm/trace.h | 116 +++++++++++++++++++++++++++++++ 1 file changed, 116 insertions(+)
arch/powerpc/include/asm/trace.h +116 -0
@@ -119,6 +119,122 @@ TRACE_EVENT_FN_COND(hcall_exit, );#endif +#ifdef CONFIG_PPC_RTAS + +#include <asm/rtas-types.h> + +/* +* Since stop-self is how CPUs go offline on RTAS platforms, +* these tracepoints are conditional. +*/ + +TRACE_EVENT_CONDITION (rtas_input, + + TP_PROTO(struct rtas_args *rtas_args, const char *name), + +TP_ARGS (rtas_args, name), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())), + +TP_STRUCT__entry ( + __field(__u32, nargs) + __string(name, name) +__dynamic_array (__u32, inputs,be32_to_cpu (rtas_args->nargs)) + ), + +TP_fast_assign ( + __entry->nargs = be32_to_cpu(rtas_args->nargs); + __assign_str(name, name); + be32_to_cpu_array(__get_dynamic_array(inputs), rtas_args->args, __entry->nargs); + ), + +TP_printk ("%s arguments: %s" ,__get_str (name), +__print_array (__get_dynamic_array (inputs), __entry->nargs,4 ) + ) +); + +TRACE_EVENT_CONDITION (rtas_output, + + TP_PROTO(struct rtas_args *rtas_args, const char *name), + +TP_ARGS (rtas_args, name), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())), + +TP_STRUCT__entry ( + __field(__u32, nr_other) + __field(__s32, status) + __string(name, name) +__dynamic_array (__u32, other_outputs,be32_to_cpu (rtas_args->nret) -1 ) + ), + +TP_fast_assign ( + __entry->nr_other = be32_to_cpu(rtas_args->nret) - 1; + __entry->status = be32_to_cpu(rtas_args->rets[0]); + __assign_str(name, name); +be32_to_cpu_array (__get_dynamic_array (other_outputs), + &rtas_args->rets[1], __entry->nr_other); + ), + +TP_printk ("%s status: %d, other outputs: %s" ,__get_str (name), __entry->status, +__print_array (__get_dynamic_array (other_outputs), + __entry->nr_other,4 ) + ) +); + +DECLARE_EVENT_CLASS (rtas_parameter_block, + + TP_PROTO(struct rtas_args *rtas_args), + +TP_ARGS (rtas_args), + +TP_STRUCT__entry ( + __field(u32, token) + __field(u32, nargs) + __field(u32, nret) +__array (__u32, params,16 ) + ), + +TP_fast_assign ( + __entry->token = be32_to_cpu(rtas_args->token); + __entry->nargs = be32_to_cpu(rtas_args->nargs); + __entry->nret = be32_to_cpu(rtas_args->nret); + be32_to_cpu_array(__entry->params, rtas_args->args, ARRAY_SIZE(rtas_args->args)); + ), + +TP_printk ("token=%u nargs=%u nret=%u params:" +" [0]=0x%08x [1]=0x%08x [2]=0x%08x [3]=0x%08x" +" [4]=0x%08x [5]=0x%08x [6]=0x%08x [7]=0x%08x" +" [8]=0x%08x [9]=0x%08x [10]=0x%08x [11]=0x%08x" +" [12]=0x%08x [13]=0x%08x [14]=0x%08x [15]=0x%08x" , + __entry->token, __entry->nargs, __entry->nret, + __entry->params[0 ], __entry->params[1 ], __entry->params[2 ], __entry->params[3 ], + __entry->params[4 ], __entry->params[5 ], __entry->params[6 ], __entry->params[7 ], + __entry->params[8 ], __entry->params[9 ], __entry->params[10 ], __entry->params[11 ], + __entry->params[12 ], __entry->params[13 ], __entry->params[14 ], __entry->params[15 ] + ) +); + +DEFINE_EVENT_CONDITION (rtas_parameter_block, rtas_ll_entry, + + TP_PROTO(struct rtas_args *rtas_args), + +TP_ARGS (rtas_args), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())) +); + +DEFINE_EVENT_CONDITION (rtas_parameter_block, rtas_ll_exit, + + TP_PROTO(struct rtas_args *rtas_args), + +TP_ARGS (rtas_args), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())) +); + +#endif /* CONFIG_PPC_RTAS */ +#ifdef CONFIG_PPC_POWERNV extern int opal_tracepoint_regfunc (void );extern void opal_tracepoint_unregfunc (void );
Signature · 1 line
2.37.1
Re: [PATCH 12/13] powerpc/tracing: tracepoints for RTAS entry and exit
Quoted 133 lines · Nathan Lynch
Add two sets of tracepoints to be used around RTAS entry:
* rtas_input/rtas_output, which emit the function name, its inputs, the returned status, and any other outputs. These produce an API-level record of OS<->RTAS activity.
* rtas_ll_entry/rtas_ll_exit, which are lower-level and emit the entire contents of the parameter block (aka
rtas_args) on entry and exit. Likely useful only for debugging.With uses of these tracepoints in
do_enter_rtas()to be added in the following patch, examples of get-time-of-day and event-scan functions as rendered by trace-cmd (with some multi-line formatting manually imposed on the rtas_ll_* entries to avoid extremely long lines in the commit message):cat-36800 [059] 4978.518303: rtas_input: get-time-of-day arguments: cat-36800 [059] 4978.518306: rtas_ll_entry: token=3 nargs=0 nret=8 params: [0]=0x00000000 [1]=0x00000000 [2]=0x00000000 [3]=0x00000000 [4]=0x00000000 [5]=0x00000000 [6]=0x00000000 [7]=0x00000000 [8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000 [12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000 cat-36800 [059] 4978.518366: rtas_ll_exit: token=3 nargs=0 nret=8 params: [0]=0x00000000 [1]=0x000007e6 [2]=0x0000000b [3]=0x00000001 [4]=0x00000000 [5]=0x0000000e [6]=0x00000008 [7]=0x2e0dac40 [8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000 [12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000cat-36800 [059] 4978.518366:
rtas_output: get-time-of-day status: 0, other outputs: 2022 11 1 0 14 8 772648000kworker/39:1-336 [039] 4982.731623: rtas_input: event-scan arguments: 4294967295 0 80484920 2048 kworker/39:1-336 [039] 4982.731626: rtas_ll_entry: token=6 nargs=4 nret=1 params: [0]=0xffffffff [1]=0x00000000 [2]=0x04cc1a38 [3]=0x00000800 [4]=0x00000000 [5]=0x0000000e [6]=0x00000008 [7]=0x2e0dac40 [8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000 [12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000 kworker/39:1-336 [039] 4982.731676: rtas_ll_exit: token=6 nargs=4 nret=1 params: [0]=0xffffffff [1]=0x00000000 [2]=0x04cc1a38 [3]=0x00000800 [4]=0x00000001 [5]=0x0000000e [6]=0x00000008 [7]=0x2e0dac40 [8]=0x00000000 [9]=0x00000000 [10]=0x00000000 [11]=0x00000000 [12]=0x00000000 [13]=0x00000000 [14]=0x00000000 [15]=0x00000000kworker/39:1-336 [039] 4982.731677:
rtas_output: event-scan status: 1, other outputs:Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/include/asm/trace.h | 116 +++++++++++++++++++++++++++++++ 1 file changed, 116 insertions(+)arch/powerpc/include/asm/trace.h +78
-0@@ -119,6 +119,122 @@ TRACE_EVENT_FN_COND(hcall_exit, );#endif +#ifdef CONFIG_PPC_RTAS + +#include <asm/rtas-types.h> + +/* +* Since stop-self is how CPUs go offline on RTAS platforms, +* these tracepoints are conditional. +*/ + +TRACE_EVENT_CONDITION (rtas_input, + + TP_PROTO(struct rtas_args *rtas_args, const char *name), + +TP_ARGS (rtas_args, name), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())), + +TP_STRUCT__entry ( + __field(__u32, nargs) + __string(name, name) +__dynamic_array (__u32, inputs,be32_to_cpu (rtas_args->nargs)) + ), + +TP_fast_assign ( + __entry->nargs = be32_to_cpu(rtas_args->nargs); + __assign_str(name, name); + be32_to_cpu_array(__get_dynamic_array(inputs), rtas_args->args, __entry->nargs); + ), + +TP_printk ("%s arguments: %s" ,__get_str (name), +__print_array (__get_dynamic_array (inputs), __entry->nargs,4 ) + ) +); + +TRACE_EVENT_CONDITION (rtas_output, + + TP_PROTO(struct rtas_args *rtas_args, const char *name), + +TP_ARGS (rtas_args, name), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())), + +TP_STRUCT__entry ( + __field(__u32, nr_other) + __field(__s32, status) + __string(name, name) +__dynamic_array (__u32, other_outputs,be32_to_cpu (rtas_args->nret) -1 ) + ), + +TP_fast_assign ( + __entry->nr_other = be32_to_cpu(rtas_args->nret) - 1; + __entry->status = be32_to_cpu(rtas_args->rets[0]); + __assign_str(name, name); +be32_to_cpu_array (__get_dynamic_array (other_outputs), + &rtas_args->rets[1], __entry->nr_other); + ), + +TP_printk ("%s status: %d, other outputs: %s" ,__get_str (name), __entry->status, +__print_array (__get_dynamic_array (other_outputs), + __entry->nr_other,4 ) + ) +); + +DECLARE_EVENT_CLASS(rtas_parameter_block, + + TP_PROTO(struct rtas_args *rtas_args), + + TP_ARGS(rtas_args), + + TP_STRUCT__entry( + __field(u32, token) + __field(u32, nargs) + __field(u32, nret) + __array(__u32, params, 16) + ), + + TP_fast_assign( + __entry->token = be32_to_cpu(rtas_args->token);
arch/powerpc/include/asm/trace.h TRACE_EVENT_FN_COND(hcall_exit, · line 209
Quoted 10 lines
arch/powerpc/include/asm/trace.h +10
-0+ __entry->nargs =be32_to_cpu (rtas_args->nargs); + __entry->nret =be32_to_cpu (rtas_args->nret); +be32_to_cpu_array (__entry->params, rtas_args->args,ARRAY_SIZE (rtas_args->args)); + ), + + TP_printk("token=%u nargs=%u nret=%u params:" + " [0]=0x%08x [1]=0x%08x [2]=0x%08x [3]=0x%08x" + " [4]=0x%08x [5]=0x%08x [6]=0x%08x [7]=0x%08x" + " [8]=0x%08x [9]=0x%08x [10]=0x%08x [11]=0x%08x" + " [12]=0x%08x [13]=0x%08x [14]=0x%08x [15]=0x%08x",
You could justify these since you went to the trouble to format them nicely. Not a big deal though.
Quoted 33 lines
arch/powerpc/include/asm/trace.h +28
-0+ __entry->token, __entry->nargs, __entry->nret, + __entry->params[0 ], __entry->params[1 ], __entry->params[2 ], __entry->params[3 ], + __entry->params[4 ], __entry->params[5 ], __entry->params[6 ], __entry->params[7 ], + __entry->params[8 ], __entry->params[9 ], __entry->params[10 ], __entry->params[11 ], + __entry->params[12 ], __entry->params[13 ], __entry->params[14 ], __entry->params[15 ] + ) +); + +DEFINE_EVENT_CONDITION (rtas_parameter_block, rtas_ll_entry, + + TP_PROTO(struct rtas_args *rtas_args), + +TP_ARGS (rtas_args), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())) +); + +DEFINE_EVENT_CONDITION (rtas_parameter_block, rtas_ll_exit, + + TP_PROTO(struct rtas_args *rtas_args), + +TP_ARGS (rtas_args), + +TP_CONDITION (cpu_online (raw_smp_processor_id ())) +); + +#endif /* CONFIG_PPC_RTAS */ +#ifdef CONFIG_PPC_POWERNV extern int opal_tracepoint_regfunc (void );extern void opal_tracepoint_unregfunc (void );Signature · 1 line
2.37.1
PATCH 13/13 powerpc/rtas: place tracepoints in do_enter_rtas()
In reply to Nathan LynchCall the just-added rtas tracepoints in do_enter_rtas(), taking care to avoid function name lookups in the CPU offline path.
--- arch/powerpc/kernel/rtas.c | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)
arch/powerpc/kernel/rtas.c +23 -0
@@ -38,6 +38,7 @@#include <asm/page.h> #include <asm/rtas.h> #include <asm/time.h> +#include <asm/trace.h> #include <asm/udbg.h> enum rtas_function_flags {
@@ -525,6 +526,7 @@ void enter_rtas(unsigned long);static void do_enter_rtas (struct rtas_args *args) {unsigned long msr; +const char *name =NULL ;/* * Make sure MSR[RI] is currently enabled as it will be forced later
@@ -537,9 +539,30 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ +if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { +/* +* rtas_token_to_function() uses xarray which uses RCU, +* but this code can run in the CPU offline path +* (e.g. stop-self), after it's become invalid to call +* RCU APIs. +*/ +if (cpu_online (smp_processor_id ())) { +const s32 token =be32_to_cpu (args->token); +const struct rtas_function *func =rtas_token_to_function (token); + + name = func->name; + } + } + +trace_rtas_input (args, name); +trace_rtas_ll_entry (args); +enter_rtas (__pa (args));srr_regs_clobbered ();/* rtas uses SRRs, invalidate */ + +trace_rtas_ll_exit (args); +trace_rtas_output (args, name); }struct rtas_t rtas = {
Signature · 1 line
2.37.1
Nicholas Piggin
reviewerRe: [PATCH 13/13] powerpc/rtas: place tracepoints in do_enter_rtas()
Quoted 29 lines · Nathan Lynch
Call the just-added rtas tracepoints in
do_enter_rtas(), taking care to avoid function name lookups in the CPU offline path.Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)arch/powerpc/kernel/rtas.c +2
-0@@ -38,6 +38,7 @@#include <asm/page.h> #include <asm/rtas.h> #include <asm/time.h> +#include <asm/trace.h> #include <asm/udbg.h> enum rtas_function_flags {@@ -525,6 +526,7 @@ void enter_rtas(unsigned long);static void do_enter_rtas (struct rtas_args *args) {unsigned long msr; +const char *name =NULL ;/* * Make sure MSR[RI] is currently enabled as it will be forced later
arch/powerpc/kernel/rtas.c static void do_enter_rtas(struct rtas_args *args) · line 548
Quoted 10 lines
arch/powerpc/kernel/rtas.c +7
-0@@ -537,9 +539,30 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ +if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { +/* +* rtas_token_to_function() uses xarray which uses RCU, +* but this code can run in the CPU offline path +* (e.g. stop-self), after it's become invalid to call +* RCU APIs. +*/
We can call this in real-mode via pseries_machine_check_realmode -> fwnmi_release_errinfo, so tracing should be disabled for that case too... Does this_cpu_set_ftrace_enabled(0) in the early machine check handler cover that sufficiently?
Thanks,
Nick
Re: [PATCH 13/13] powerpc/rtas: place tracepoints in do_enter_rtas()
Quoted 33 lines · Nicholas Piggin
Quoted 32 lines · Nathan Lynch
Call the just-added rtas tracepoints in
do_enter_rtas(), taking care to avoid function name lookups in the CPU offline path.Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)arch/powerpc/kernel/rtas.c +2
-0@@ -38,6 +38,7 @@#include <asm/page.h> #include <asm/rtas.h> #include <asm/time.h> +#include <asm/trace.h> #include <asm/udbg.h> enum rtas_function_flags {@@ -525,6 +526,7 @@ void enter_rtas(unsigned long);static void do_enter_rtas (struct rtas_args *args) {unsigned long msr; +const char *name =NULL ;/* * Make sure MSR[RI] is currently enabled as it will be forced later @@ -537,9 +539,30 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */
Quoted 12 lines
arch/powerpc/kernel/rtas.c static void do_enter_rtas(struct rtas_args *args) · line 548
Quoted 7 lines
arch/powerpc/kernel/rtas.c +7
-0+if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { +/* +* rtas_token_to_function() uses xarray which uses RCU, +* but this code can run in the CPU offline path +* (e.g. stop-self), after it's become invalid to call +* RCU APIs. +*/ We can call this in real-mode via
pseries_machine_check_realmode->fwnmi_release_errinfo, so tracing should be disabled for that case too... Doesthis_cpu_set_ftrace_enabled(0)in the early machine check handler cover that sufficiently?
I suspect so, but I'd like to verify. Do you know how I could exercise this path in qemu or LPAR?
Michael Ellerman
reviewerRe: [PATCH 13/13] powerpc/rtas: place tracepoints in do_enter_rtas()
Quoted 47 lines · Nathan Lynch
Quoted 33 lines · Nicholas Piggin
Quoted 32 lines · Nathan Lynch
Call the just-added rtas tracepoints in
do_enter_rtas(), taking care to avoid function name lookups in the CPU offline path.Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)arch/powerpc/kernel/rtas.c +2
-0@@ -38,6 +38,7 @@#include <asm/page.h> #include <asm/rtas.h> #include <asm/time.h> +#include <asm/trace.h> #include <asm/udbg.h> enum rtas_function_flags {@@ -525,6 +526,7 @@ void enter_rtas(unsigned long);static void do_enter_rtas (struct rtas_args *args) {unsigned long msr; +const char *name =NULL ;/* * Make sure MSR[RI] is currently enabled as it will be forced later @@ -537,9 +539,30 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ Quoted 12 lines
arch/powerpc/kernel/rtas.c static void do_enter_rtas(struct rtas_args *args) · line 548
Quoted 7 lines
arch/powerpc/kernel/rtas.c +7
-0+if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { +/* +* rtas_token_to_function() uses xarray which uses RCU, +* but this code can run in the CPU offline path +* (e.g. stop-self), after it's become invalid to call +* RCU APIs. +*/ We can call this in real-mode via
pseries_machine_check_realmode->fwnmi_release_errinfo, so tracing should be disabled for that case too... Doesthis_cpu_set_ftrace_enabled(0)in the early machine check handler cover that sufficiently?
Quoted 2 lines
I suspect so, but I'd like to verify. Do you know how I could exercise this path in qemu or LPAR?
On a P9 or P10 LPAR you should be able to use tools/testing/selftests/powerpc/mce/inject-ra-err
cheers
Re: [PATCH 13/13] powerpc/rtas: place tracepoints in do_enter_rtas()
Quoted 48 lines · Michael Ellerman
Quoted 47 lines · Nathan Lynch
Quoted 45 lines · Nicholas Piggin
Quoted 29 lines · Nathan Lynch
Call the just-added rtas tracepoints in
do_enter_rtas(), taking care to avoid function name lookups in the CPU offline path.Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)arch/powerpc/kernel/rtas.c +2
-0@@ -38,6 +38,7 @@#include <asm/page.h> #include <asm/rtas.h> #include <asm/time.h> +#include <asm/trace.h> #include <asm/udbg.h> enum rtas_function_flags {@@ -525,6 +526,7 @@ void enter_rtas(unsigned long);static void do_enter_rtas (struct rtas_args *args) {unsigned long msr; +const char *name =NULL ;/* * Make sure MSR[RI] is currently enabled as it will be forced later arch/powerpc/kernel/rtas.c static void do_enter_rtas(struct rtas_args *args) · line 548
Quoted 10 lines
arch/powerpc/kernel/rtas.c +7
-0@@ -537,9 +539,30 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ +if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { +/* +* rtas_token_to_function() uses xarray which uses RCU, +* but this code can run in the CPU offline path +* (e.g. stop-self), after it's become invalid to call +* RCU APIs. +*/ We can call this in real-mode via
pseries_machine_check_realmode->fwnmi_release_errinfo, so tracing should be disabled for that case too... Doesthis_cpu_set_ftrace_enabled(0)in the early machine check handler cover that sufficiently?
Quoted 4 lines
Quoted 2 lines
I suspect so, but I'd like to verify. Do you know how I could exercise this path in qemu or LPAR?
On a P9 or P10 LPAR you should be able to use
tools/testing/selftests/powerpc/mce/inject-ra-err
Nice. Looks like I was too optimistic. From a P10 LPAR:
# trace-cmd record -T -e powerpc:rtas_input -- \
sh -c 'sleep 10; ./inject-ra-err' && trace-cmd report
kworker/7:1-73 [007] 72.882159: rtas_input: event-scan arguments: 4294967295 0 80419368 2048
kworker/7:1-73 [007] 72.882165: kernel_stack: <stack trace >
=> do_enter_rtas (c000000000045180)
=> rtas_call (c000000000045da8)
=> rtas_event_scan (c000000000049458)
=> process_one_work (c0000000001c7618)
=> worker_thread (c0000000001c7bd8)
=> kthread (c0000000001d6858)
=> ret_from_kernel_thread (c00000000000cf5c)
inject-ra-err-1080 [001] 78.386947: rtas_input: ibm,nmi-interlock arguments:
inject-ra-err-1080 [001] 78.386950: kernel_stack: <stack trace >
=> do_enter_rtas (c000000000045180)
=> rtas_call_unlocked (c000000000046ff4)
=> pseries_machine_check_realmode (c0000000000e8db8)
=> machine_check_early (c0000000000400c4)
=> machine_check_early_common (c00000000000836c)So... that's bad. (right?)
I guess this patch needs something like this?
arch/powerpc/kernel/rtas.c +12 -5
@@ -541,6 +541,7 @@ static void do_enter_rtas(struct rtas_args *args) {unsigned long msr;const char *name =NULL ; +bool can_trace;/* * Make sure MSR[RI] is currently enabled as it will be forced later
@@ -553,7 +554,9 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ -if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { + can_trace = (msr &MSR_IR ) && (msr &MSR_DR ); + +if (can_trace && (trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) {/* * rtas_token_to_function() uses xarray which uses RCU, * but this code can run in the CPU offline path
@@ -568,15 +571,19 @@ static void do_enter_rtas(struct rtas_args *args) } } -trace_rtas_input (args, name); -trace_rtas_ll_entry (args); +if (can_trace) { +trace_rtas_input (args, name); +trace_rtas_ll_entry (args); + }enter_rtas (__pa (args));srr_regs_clobbered ();/* rtas uses SRRs, invalidate */ -trace_rtas_ll_exit (args); -trace_rtas_output (args, name); +if (can_trace) { +trace_rtas_ll_exit (args); +trace_rtas_output (args, name); + } }struct rtas_t rtas = {
Michael Ellerman
reviewerRe: [PATCH 13/13] powerpc/rtas: place tracepoints in do_enter_rtas()
Quoted 75 lines · Nathan Lynch
Quoted 48 lines · Michael Ellerman
Quoted 47 lines · Nathan Lynch
Quoted 45 lines · Nicholas Piggin
Quoted 29 lines · Nathan Lynch
Call the just-added rtas tracepoints in
do_enter_rtas(), taking care to avoid function name lookups in the CPU offline path.Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)arch/powerpc/kernel/rtas.c +2
-0@@ -38,6 +38,7 @@#include <asm/page.h> #include <asm/rtas.h> #include <asm/time.h> +#include <asm/trace.h> #include <asm/udbg.h> enum rtas_function_flags {@@ -525,6 +526,7 @@ void enter_rtas(unsigned long);static void do_enter_rtas (struct rtas_args *args) {unsigned long msr; +const char *name =NULL ;/* * Make sure MSR[RI] is currently enabled as it will be forced later arch/powerpc/kernel/rtas.c static void do_enter_rtas(struct rtas_args *args) · line 548
Quoted 10 lines
arch/powerpc/kernel/rtas.c +7
-0@@ -537,9 +539,30 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ +if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { +/* +* rtas_token_to_function() uses xarray which uses RCU, +* but this code can run in the CPU offline path +* (e.g. stop-self), after it's become invalid to call +* RCU APIs. +*/ We can call this in real-mode via
pseries_machine_check_realmode->fwnmi_release_errinfo, so tracing should be disabled for that case too... Doesthis_cpu_set_ftrace_enabled(0)in the early machine check handler cover that sufficiently?Quoted 4 lines
Quoted 2 lines
I suspect so, but I'd like to verify. Do you know how I could exercise this path in qemu or LPAR?
On a P9 or P10 LPAR you should be able to use
tools/testing/selftests/powerpc/mce/inject-ra-errNice. Looks like I was too optimistic. From a P10 LPAR:
# trace-cmd record -T -e powerpc:rtas_input -- \ sh -c 'sleep 10; ./inject-ra-err' && trace-cmd report kworker/7:1-73 [007] 72.882159: rtas_input: event-scan arguments: 4294967295 0 80419368 2048 kworker/7:1-73 [007] 72.882165: kernel_stack: <stack trace > => do_enter_rtas (c000000000045180) => rtas_call (c000000000045da8) => rtas_event_scan (c000000000049458) => process_one_work (c0000000001c7618) => worker_thread (c0000000001c7bd8) => kthread (c0000000001d6858) => ret_from_kernel_thread (c00000000000cf5c) inject-ra-err-1080 [001] 78.386947: rtas_input: ibm,nmi-interlock arguments: inject-ra-err-1080 [001] 78.386950: kernel_stack: <stack trace > => do_enter_rtas (c000000000045180) => rtas_call_unlocked (c000000000046ff4) => pseries_machine_check_realmode (c0000000000e8db8) => machine_check_early (c0000000000400c4) => machine_check_early_common (c00000000000836c)
Quoted 1 line
So... that's bad. (right?)
Potentially. If you booted in hash mode it might crash, if the tracing causes accesses outside the RMO, or to vmalloc etc.
Quoted 1 line
I guess this patch needs something like this?
Yeah I think that's probably the easiest solution.
You could split do_enter_rtas() into a tracing and non-tracing version, but I don't think that would be any cleaner.
cheers
Quoted 47 lines
arch/powerpc/kernel/rtas.c +12
-5@@ -541,6 +541,7 @@ static void do_enter_rtas(struct rtas_args *args) {unsigned long msr;const char *name =NULL ; +bool can_trace;/* * Make sure MSR[RI] is currently enabled as it will be forced later @@ -553,7 +554,9 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ -if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { + can_trace = (msr &MSR_IR ) && (msr &MSR_DR ); + +if (can_trace && (trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) {/* * rtas_token_to_function() uses xarray which uses RCU, * but this code can run in the CPU offline path @@ -568,15 +571,19 @@ static void do_enter_rtas(struct rtas_args *args) } } -trace_rtas_input (args, name); -trace_rtas_ll_entry (args); +if (can_trace) { +trace_rtas_input (args, name); +trace_rtas_ll_entry (args); + }enter_rtas (__pa (args));srr_regs_clobbered ();/* rtas uses SRRs, invalidate */ -trace_rtas_ll_exit (args); -trace_rtas_output (args, name); +if (can_trace) { +trace_rtas_ll_exit (args); +trace_rtas_output (args, name); + } }struct rtas_t rtas = {
Nicholas Piggin
reviewerRe: [PATCH 13/13] powerpc/rtas: place tracepoints in do_enter_rtas()
In reply to Nathan LynchQuoted 48 lines · Nathan Lynch
Quoted 33 lines · Nicholas Piggin
Quoted 32 lines · Nathan Lynch
Call the just-added rtas tracepoints in
do_enter_rtas(), taking care to avoid function name lookups in the CPU offline path.Signed-off-by Nathan Lynch <[email protected]>--- arch/powerpc/kernel/rtas.c | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+)arch/powerpc/kernel/rtas.c +2
-0@@ -38,6 +38,7 @@#include <asm/page.h> #include <asm/rtas.h> #include <asm/time.h> +#include <asm/trace.h> #include <asm/udbg.h> enum rtas_function_flags {@@ -525,6 +526,7 @@ void enter_rtas(unsigned long);static void do_enter_rtas (struct rtas_args *args) {unsigned long msr; +const char *name =NULL ;/* * Make sure MSR[RI] is currently enabled as it will be forced later @@ -537,9 +539,30 @@ static void do_enter_rtas(struct rtas_args *args)hard_irq_disable ();/* Ensure MSR[EE] is disabled on PPC64 */ Quoted 12 lines
arch/powerpc/kernel/rtas.c static void do_enter_rtas(struct rtas_args *args) · line 548
Quoted 7 lines
arch/powerpc/kernel/rtas.c +7
-0+if ((trace_rtas_input_enabled () ||trace_rtas_output_enabled ())) { +/* +* rtas_token_to_function() uses xarray which uses RCU, +* but this code can run in the CPU offline path +* (e.g. stop-self), after it's become invalid to call +* RCU APIs. +*/ We can call this in real-mode via
pseries_machine_check_realmode->fwnmi_release_errinfo, so tracing should be disabled for that case too... Doesthis_cpu_set_ftrace_enabled(0)in the early machine check handler cover that sufficiently?
Quoted 2 lines
I suspect so, but I'd like to verify. Do you know how I could exercise this path in qemu or LPAR?
I have some machine check injection patches for qemu but they never got merged... I can point you to them if you need.
Should try get those merged again.
Thanks,
Nick
Quoted 10 lines · Nathan Lynch
A collection of loosely-related RTAS code changes, most notably:
* Fixing misuses of
rtas_token()for non-function properties.
* The stronger validation forsys_rtas()offered by thePPC_RTAS_FILTERconfig option is always enabled.
* Improved function token lookups, including efficient "reverse" token-to-name mappings.
* Static tracepoints for RTAS entry and exit.[...]
Patches 1-9 applied to powerpc/next.
[01/13] powerpc/rtas: document rtas_call()
https://git.kernel.org/powerpc/c/336e2554ec99eb97616004c791ee89abe96bdab2 [02/13] powerpc/rtasd: use correct OF API for event scan rate https://git.kernel.org/powerpc/c/b10af504a2015d12c566b6b0a4c7e3b602949eeb [03/13] powerpc/rtas: avoid device tree lookups in rtas_os_term() https://git.kernel.org/powerpc/c/ed2213bfb192ab51f09f12e9b49b5d482c6493f3 [04/13] powerpc/rtas: avoid scheduling in rtas_os_term() https://git.kernel.org/powerpc/c/6c606e57eecc37d6b36d732b1ff7e55b7dc32dd4 [05/13] powerpc/pseries/eeh: use correct API for error log size https://git.kernel.org/powerpc/c/9aafbfa5f57a4b75bafd3bed0191e8429c5fa618 [06/13] powerpc/rtas: clean up rtas_error_log_max initialization https://git.kernel.org/powerpc/c/c67a0e411d0ffe0648fe84e25e9f899ce770feb3 [07/13] powerpc/rtas: clean up includes https://git.kernel.org/powerpc/c/9581f8a00777a073fdd8146659a51ca007cae8d6 [08/13] powerpc/rtas: define pr_fmt and convert printk call sites https://git.kernel.org/powerpc/c/f975b6559bac510f1b1b39637997bb240f0a9969 [09/13] powerpc/rtas: mandate RTAS syscall filtering https://git.kernel.org/powerpc/c/98c738c8cee6e5a58d4060862e2f8cf3cdc8a328
cheers