Skip to contentSkip to conversation

rseq: Out-of-line rseq_exit_user_update() for KMSAN

PATCH In review Ilya Leoshkevich 2 participants 3 messages Aug 18

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

PATCH 1/1 rseq: Out-of-line rseq_exit_user_update() for KMSAN

KMSAN produces the following false positive on s390x:

    [    4.232136] Kernel panic - not syncing: kmsan.panic set ...
    [    4.232339] CPU: 7 UID: 0 PID: 1 Comm: virtme-init Tainted: G    B            N  7.2.0-rc6-virtme #27 PREEMPTLAZY
    [    4.232676] Tainted: [B]=BAD_PAGE, [N]=TEST
    [    4.232808] Hardware name: IBM 3931 A01 701 (KVM/Linux)
    [    4.232971] Call Trace:
    [    4.233065]  [<000002dcfb993140>] vpanic+0xb50/0x1080
    [    4.239698]  [<000002dcfb9925ec>] panic+0x22c/0x230
    [    4.239879]  [<000002dcfcec5d32>] kmsan_report+0x322/0x330
    [    4.240081]  [<000002dcfcec3592>] kmsan_internal_check_memory+0x222/0x280
    [    4.240304]  [<000002dcffe3444e>] irqentry_exit+0x50e/0x8f0
    [    4.240522]  [<000002dcffe33454>] __do_pgm_check+0x1b4/0x2b0
    [    4.240740]  [<000002dcffe75304>] pgm_check_handler+0x114/0x160

The reason is that the following call chain inlined into the noinstr irqentry_exit() function:

    irqentry_exit()
      irqentry_exit_to_user_mode()
        irqentry_exit_to_user_mode_prepare()
          __exit_to_user_mode_prepare()
            exit_to_user_mode_loop()
              rseq_exit_to_user_mode_restart()
                __rseq_exit_to_user_mode_restart()
                  rseq_exit_user_update()

does not set KMSAN shadow on struct rseq_ids, which is then verified by

rseq_exit_user_update()
rseq_update_usr()
rseq_set_ids_get_csaddr()
unsafe_put_user()

regardless of presence of KMSAN instrumentation.

Fix by out-of-lining rseq_exit_user_update() and compiling the out-of-lined version with KMSAN instrumentation.

This should affect other architectures as well, but whether one actually sees it depends on the leftover shadow of struct rseq_ids stack location: s390 is not special here.

Fixes 05b44aef709c ("rseq: Implement fast path for exit to user")
---
 include/linux/rseq_entry.h | 9 ++++++++-
 kernel/rseq.c              | 7 +++++++
 2 files changed, 15 insertions(+), 1 deletion(-)
include/linux/rseq_entry.h +8 -1
index ed9da6e41a2aa..a396050f771cc 100644
@@ -595,7 +595,8 @@ static rseq_inline bool rseq_update_usr(struct task_struct *t, struct pt_regs *r
  * tells the caller to loop back into exit_to_user_mode_loop(). The rseq
  * slow path there will handle the failure.
  */
-static __always_inline bool rseq_exit_user_update(struct pt_regs *regs, struct task_struct *t)
+static __always_inline bool rseq_exit_user_update_inline(struct pt_regs *regs,
+							 struct task_struct *t)
 {
 	/*
 	 * Page faults need to be disabled as this is called with
@@ -647,6 +648,12 @@ static __always_inline bool rseq_exit_user_update(struct pt_regs *regs, struct t
 	return false;
 }
 
+#ifdef CONFIG_KMSAN
+bool rseq_exit_user_update(struct pt_regs *regs, struct task_struct *t);
+#else
+#define rseq_exit_user_update rseq_exit_user_update_inline
+#endif
+
 static __always_inline bool __rseq_exit_to_user_mode_restart(struct pt_regs *regs)
 {
 	struct task_struct *t = current;
kernel/rseq.c +7 -0
index e75e3a5e312c8..be759d7d266b5 100644
@@ -329,6 +329,13 @@ void __rseq_handle_slowpath(struct pt_regs *regs)
 	rseq_slowpath_update_usr(regs);
 }
 
+#if defined(CONFIG_KMSAN) && defined(CONFIG_GENERIC_ENTRY)
+bool rseq_exit_user_update(struct pt_regs *regs, struct task_struct *t)
+{
+	return rseq_exit_user_update_inline(regs, t);
+}
+#endif
+
 void __rseq_signal_deliver(int sig, struct pt_regs *regs)
 {
 	rseq_stat_inc(rseq_stats.signal);
Signature · 1 line
2.55.0
#1 lore raw
Thank you for your contribution! Sashiko AI review found 1 potential issue(s) to consider:

Thank you for your contribution! Sashiko AI review found 1 potential issue(s) to consider:

Pre-existing issues:
- [High] KMSAN false positive in __rseq_grant_slice_extension due to missing out-of-line wrapper in noinstr context. --

--- Patch [1]: [PATCH] rseq: Out-of-line rseq_exit_user_update() for KMSAN --- commit 34d84b6249995289ac0487f7b7677244a859e66c
Author: Ilya Leoshkevich <[email protected]>

rseq: Out-of-line rseq_exit_user_update() for KMSAN

This patch fixes a KMSAN false positive on s390x caused by rseq_exit_user_update() being inlined into a noinstr context, which leaves KMSAN shadow memory uninitialized for stack variables. It resolves the false positive by out-of-lining rseq_exit_user_update() and compiling it with KMSAN instrumentation.

include/linux/rseq_entry.h static rseq_inline bool rseq_update_usr(struct task_struct *t, struct pt_regs *r · line 601

Quoted 12 lines
include/linux/rseq_entry.h +2 -1
index 31ce349ed42ce..defe1900e041a 100644
@@ -596,7 +596,8 @@ static rseq_inline bool rseq_update_usr(struct task_struct *t, struct pt_regs *r
  * tells the caller to loop back into exit_to_user_mode_loop(). The rseq
  * slow path there will handle the failure.
  */
-static __always_inline bool rseq_exit_user_update(struct pt_regs *regs, struct task_struct *t)
+static __always_inline bool rseq_exit_user_update_inline(struct pt_regs *regs,
+							 struct task_struct *t)
 {

[Severity: High]
This isn't a regression introduced by this patch, but __rseq_grant_slice_extension() appears to have the same KMSAN false positive.

In include/linux/rseq_entry.h:__rseq_grant_slice_extension():

	struct rseq_slice_ctrl usr_ctrl;
	...
		unsafe_get_user(usr_ctrl.all, &rseq->slice_ctrl.all, efault);
		if (likely(!(usr_ctrl.request)))
			return false;

		/* Grant the slice extention */
		usr_ctrl.request = 0;
		usr_ctrl.granted = 1;
		unsafe_put_user(usr_ctrl.all, &rseq->slice_ctrl.all, efault);

Because __rseq_grant_slice_extension() is unconditionally __always_inline, it gets inlined into the noinstr function irqentry_exit(). The unsafe_get_user() call reads into the local stack variable usr_ctrl, but KMSAN's instrumentation is disabled here, leaving the shadow memory uninitialized.

When unsafe_put_user() is called with usr_ctrl.all, it invokes instrument_put_user() which explicitly calls kmsan_copy_to_user(). This evaluates the shadow memory of usr_ctrl.all, sees it as uninitialized, and produces a false positive.

Should __rseq_grant_slice_extension() also be out-of-lined similar to how this patch handles rseq_exit_user_update() to prevent this?

Signature · 1 line
Sashiko AI review · https://sashiko.dev/#/patchset/[email protected]?part=1
#2 lore raw
Quoted 55 lines · On 8/18/26 20:32, [email protected] wrote:

Thank you for your contribution! Sashiko AI review found 1 potential issue(s) to consider:

Pre-existing issues:
- [High] KMSAN false positive in __rseq_grant_slice_extension due to missing out-of-line wrapper in noinstr context. --

--- Patch [1]: [PATCH] rseq: Out-of-line rseq_exit_user_update() for KMSAN --- commit 34d84b6249995289ac0487f7b7677244a859e66c
Author: Ilya Leoshkevich <[email protected]>

rseq: Out-of-line rseq_exit_user_update() for KMSAN

This patch fixes a KMSAN false positive on s390x caused by rseq_exit_user_update() being inlined into a noinstr context, which leaves KMSAN shadow memory uninitialized for stack variables. It resolves the false positive by out-of-lining rseq_exit_user_update() and compiling it with KMSAN instrumentation.

include/linux/rseq_entry.h static rseq_inline bool rseq_update_usr(struct task_struct *t, struct pt_regs *r · line 601

Quoted 12 lines
include/linux/rseq_entry.h +2 -1
index 31ce349ed42ce..defe1900e041a 100644
@@ -596,7 +596,8 @@ static rseq_inline bool rseq_update_usr(struct task_struct *t, struct pt_regs *r
   * tells the caller to loop back into exit_to_user_mode_loop(). The rseq
   * slow path there will handle the failure.
   */
-static __always_inline bool rseq_exit_user_update(struct pt_regs *regs, struct task_struct *t)
+static __always_inline bool rseq_exit_user_update_inline(struct pt_regs *regs,
+							 struct task_struct *t)
  {

[Severity: High]
This isn't a regression introduced by this patch, but __rseq_grant_slice_extension() appears to have the same KMSAN false positive.

In include/linux/rseq_entry.h:__rseq_grant_slice_extension():

	struct rseq_slice_ctrl usr_ctrl;
	...
		unsafe_get_user(usr_ctrl.all, &rseq->slice_ctrl.all, efault);
		if (likely(!(usr_ctrl.request)))
			return false;

		/* Grant the slice extention */
		usr_ctrl.request = 0;
		usr_ctrl.granted = 1;
		unsafe_put_user(usr_ctrl.all, &rseq->slice_ctrl.all, efault);

Because __rseq_grant_slice_extension() is unconditionally __always_inline, it gets inlined into the noinstr function irqentry_exit(). The unsafe_get_user() call reads into the local stack variable usr_ctrl, but KMSAN's instrumentation is disabled here, leaving the shadow memory uninitialized.

Quoted 7 lines

When unsafe_put_user() is called with usr_ctrl.all, it invokes instrument_put_user() which explicitly calls kmsan_copy_to_user(). This evaluates the shadow memory of usr_ctrl.all, sees it as uninitialized, and produces a false positive.

Should __rseq_grant_slice_extension() also be out-of-lined similar to how this patch handles rseq_exit_user_update() to prevent this?

Agreed, thanks.

I will wait for feedback for the out-of-lining approach, and if it's favorable, I will post another patch for __rseq_grant_slice_extension().