Ask-to-Distill optimizes synthetic questions for on-policy distillation
A new arXiv preprint (2610.27450, submitted 20 Oct 2026) by Jiashuo Sun and 11 co-authors introduces Ask-to-Distill, a framework that treats synthetic questions as "distribution elicitors" and optimizes the teacher supervision they expose along student-generated trajectories. A student-initialized question synthesizer is trained using a distributional surrogate for question value computed from a frozen student–teacher pair, without reference answers, correctness rewards or per-candidate student updates; the reward combines teacher–student disagreement with teacher probability mass on the student's candidate support, plus length and diversity controls. The authors report that across mathematical reasoning, code generation and agentic tasks, the method improves average performance and teacher-gap recovery over unoptimized student-generated prompts and KL-filtered real questions, and matches or exceeds real-bank on-policy distillation in the evaluated settings, with code, data and models stated as publicly available.
The paper proposes scoring synthetic training questions without ground-truth answers, framing question generation itself as an objective for on-policy distillation data.
Computer Science > Artificial Intelligence
arXiv:2610.27450 (cs)
[Submitted on 20 Oct 2026]
Title:Ask to Distill: Learning to Synthesize Data for On-Policy Distillation
Authors:Jiashuo Sun, Hao Zhang, Xueqiang Xu, Heng Wang, Yixuan Xie, Pengcheng Jiang, Zhenrui Yue, Jiajun Fan, Peiran Li, Ge Liu, Shaowen Wang, Jiawei Han
View a PDF of the paper titled Ask to Distill: Learning to Synthesize Data for On-Policy Distillation, by Jiashuo Sun and 11 other authors