Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Ask-to-Distill optimizes synthetic questions for on-policy distillation

AI summary

A new arXiv preprint (2610.27450, submitted 20 Oct 2026) by Jiashuo Sun and 11 co-authors introduces Ask-to-Distill, a framework that treats synthetic questions as "distribution elicitors" and optimizes the teacher supervision they expose along student-generated trajectories. A student-initialized question synthesizer is trained using a distributional surrogate for question value computed from a frozen student–teacher pair, without reference answers, correctness rewards or per-candidate student updates; the reward combines teacher–student disagreement with teacher probability mass on the student's candidate support, plus length and diversity controls. The authors report that across mathematical reasoning, code generation and agentic tasks, the method improves average performance and teacher-gap recovery over unoptimized student-generated prompts and KL-filtered real questions, and matches or exceeds real-bank on-policy distillation in the evaluated settings, with code, data and models stated as publicly available.

In-depth insight

The paper proposes scoring synthetic training questions without ground-truth answers, framing question generation itself as an objective for on-policy distillation data.

Computer Science > Artificial Intelligence

arXiv:2610.27450 (cs)

[Submitted on 20 Oct 2026]

Title:Ask to Distill: Learning to Synthesize Data for On-Policy Distillation

Authors:Jiashuo Sun, Hao Zhang, Xueqiang Xu, Heng Wang, Yixuan Xie, Pengcheng Jiang, Zhenrui Yue, Jiajun Fan, Peiran Li, Ge Liu, Shaowen Wang, Jiawei Han

View a PDF of the paper titled Ask to Distill: Learning to Synthesize Data for On-Policy Distillation, by Jiashuo Sun and 11 other authors

#Ask-to-Distill#arXiv#on-policy distillation

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.