Skip to contentSkip to conversation

sched_ext: Fix scx_flush_disable_work() UAF race

PATCH Superseded Cheng-Yang Chou 2 participants 2 messages Apr 28

Subsystems (2)

v1 of 2 Superseded Latest is v2 →

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 sched_ext: Fix scx_flush_disable_work() UAF race

scx_flush_disable_work() calls irq_work_sync() then kthread_flush_work() to ensure the disable kthread work has fully completed before bpf_scx_unreg() frees the SCX scheduler.

However, a concurrent scx_vexit() (e.g., triggered by watchdog stall) creates a race window between scx_claim_exit() and irq_work_queue():

CPU A (scx_vexit (watchdog)) CPU B (bpf_scx_unreg)
---- ----
scx_claim_exit()

    atomic_try_cmpxchg(NONE->kind)
  stack_trace_save()
  vscnprintf()
                                      scx_disable()
                                        scx_claim_exit() -> FAIL
                                      scx_flush_disable_work()
                                        irq_work_sync()      // no-op: not queued yet
                                        kthread_flush_work() // no-op: not queued yet
                                      kobject_put(&sch->kobj) -> free %sch
  irq_work_queue() -> UAF on %sch
  scx_disable_irq_workfn()
    kthread_queue_work() -> UAF

The root cause: CPU B's scx_flush_disable_work() returns after syncing an irq_work that was never queued, while CPU A is still between scx_claim_exit() and irq_work_queue().

Loop until exit_kind reaches SCX_EXIT_DONE, draining disable_irq_work and disable_work each pass to catch any work queued after the previous check. Return early if exit_kind is SCX_EXIT_NONE -- callers where no disable was triggered (e.g., scx_sub_enable_workfn() abort path) have nothing to wait for.

Fixes 510a27055446 ("sched_ext: sync disable_irq_work in bpf_scx_unreg()")

---
The race can be confirmed by widening the race window with udelay(5000) after scx_claim_exit() in scx_vexit() [1].
[1]: https://gist.github.com/EricccTaiwan/3b6e6c3519747b057138613af9be3465

 kernel/sched/ext.c | 11 +++++++++--
 1 file changed, 9 insertions(+), 2 deletions(-)
kernel/sched/ext.c +9 -2
index f7b1b16e81a5..4f4726ee235a 100644
@@ -6086,8 +6086,15 @@ static void scx_disable(struct scx_sched *sch, enum scx_exit_kind kind)
  */
 static void scx_flush_disable_work(struct scx_sched *sch)
 {
-	irq_work_sync(&sch->disable_irq_work);
-	kthread_flush_work(&sch->disable_work);
+	if (atomic_read(&sch->exit_kind) == SCX_EXIT_NONE)
+		return;
+	while (true) {
+		irq_work_sync(&sch->disable_irq_work);
+		kthread_flush_work(&sch->disable_work);
+		if (atomic_read(&sch->exit_kind) == SCX_EXIT_DONE)
+			break;
+		cpu_relax();
+	}
 }
 
 static void dump_newline(struct seq_buf *s)
Signature · 1 line
2.48.1
reviewer
#1 lore raw

Hello, Cheng-Yang.

How about folding the early-return into the loop?

  do {
          irq_work_sync(&sch->disable_irq_work);
          kthread_flush_work(&sch->disable_work);
          kind = atomic_read(&sch->exit_kind);
  } while (kind != SCX_EXIT_NONE && kind != SCX_EXIT_DONE);

Thanks.
--
tejun