Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

System Switch: When Should a Fast Decision Model Stop and Think?

AI summary

This arXiv paper studies dual-process agents in which a fast learned actor makes every decision and hands control to a reasoning vision-language model only when a gate opens, while the game keeps running. Testing on closed-loop Doom and new open "System One" typed-decision models (0.15B–9B parameters, 900 held-out questions), the author finds accuracy, calibration and sensitivity are distinct: models with similar accuracy differ widely in AUROC. Offline, deferring the least confident 30% of decisions to a reasoner beats random deferral in proportion to the actor's AUROC (rank correlation 0.87), with a gain of +0.13 [0.08, 0.18] on held-out games (+0.08 [0.02, 0.14] with shuffled options), about half of it coming from reasoning — yet in closed loop (33 games, three seeds) no variant reaches the exit.

In-depth insight

It frames "when should the fast model stop and delegate to a reasoner" as a measurable gating problem, though the evidence is limited to a small game environment.

Computer Science > Artificial Intelligence

arXiv:2610.09683 (cs)

[Submitted on 7 Oct 2026]

Title:System Switch: When Should a Fast Decision Model Stop and Think?

Authors:Gian Luca Bailo

View a PDF of the paper titled System Switch: When Should a Fast Decision Model Stop and Think?, by Gian Luca Bailo

#System One#Doom

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.