On-policy self-distillation
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 3
- WAM-Policy brings language-conditioned control to quadrupedal robots
The authors of an arXiv paper present WAM-Policy, a two-stage method that adapts a world action model pretrained for robot arms to language-conditioned locomotion and manipulation on arm-free quadrupeds. Their method combines cross-morphology adaptation, on-policy self-distillation, reinforcement learning and multi-teacher distillation; on the authors' QLM-Bench, an OPSD student retained a 76.7% score while sampling 14 times faster, and later training raised it to 85.0%. The authors also report deploying the OPSD student on a real Unitree Go2 Air, although these results currently come solely from their paper and abstract.
Hugging Face · Papers · 🔥 0 - Study finds bias in on-policy self-distillation
A research update argues that on-policy self-distillation (OPSD) can bias a model toward a teacher’s preferred continuations, including stylistic tokens such as hedging words, without ensuring improvement in its ability to solve tasks. Token-level analysis covering 800 rollouts across 200 level 4–5 MATH-500 problems found systematic disagreements over wording rather than mathematical correctness. The authors conclude that OPSD is not a silver bullet for continual learning and question whether further research investment is worthwhile, while acknowledging that it may remain useful in certain contexts.
Baseten Blog · 🔥 0 - AMBIT brings unified generative editing to first-order ambisonics
Kam Man Wu and six coauthors submitted a paper introducing AMBIT, a framework for native First-Order Ambisonics generation and editing. It combines executable ScenePlans, a shared Transfusion backbone, an FOA-aware continuous VAE, and on-policy self-distillation for planning and rendering. The authors report better content, spatial quality, acoustic fidelity, and preservation of unedited sources than compared baselines across speech, music, and sound.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my On-policy self-distillation experienceAsk about On-policy self-distillation
Nobody has shared their experience with On-policy self-distillation yet.