Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

DoubtLess: Training-free contrastive decoding cuts CoT length 31%

AI summary

A new arXiv paper introduces DoubtLess, a training-free decoding method in which a smaller reasoning model steers a larger one toward brevity during chain-of-thought (CoT) generation. The small model reads the large model's CoT so far twice — once prompted to be brief and once to be verbose — and the scaled difference between its two logit vectors is added to the large model's logits at every step. On seven benchmarks spanning competition mathematics, graduate-level science and competitive programming, the authors report a 31% shorter CoT for Qwen3-32B with unchanged accuracy, outperforming five inference-time baselines; they also report 20% fewer thinking tokens per turn in a self-debugging coding agent with unchanged task performance.

In-depth insight

If this training-free decoding generalizes reliably, teams could cut reasoning inference costs without retraining models.

Computer Science > Computation and Language

arXiv:2610.18862 (cs)

[Submitted on 13 Oct 2026]

Title:DoubtLess: Training-Free Contrastive Decoding for Efficient Reasoning

Authors:Minghao Luo, Liang Chen

View a PDF of the paper titled DoubtLess: Training-Free Contrastive Decoding for Efficient Reasoning, by Minghao Luo and 1 other authors

#DoubtLess#Qwen3-32B

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.