Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

On-policy self-distillation

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 3

  1. WAM-Policy brings language-conditioned control to quadrupedal robots

    The authors of an arXiv paper present WAM-Policy, a two-stage method that adapts a world action model pretrained for robot arms to language-conditioned locomotion and manipulation on arm-free quadrupeds. Their method combines cross-morphology adaptation, on-policy self-distillation, reinforcement learning and multi-teacher distillation; on the authors' QLM-Bench, an OPSD student retained a 76.7% score while sampling 14 times faster, and later training raised it to 85.0%. The authors also report deploying the OPSD student on a real Unitree Go2 Air, although these results currently come solely from their paper and abstract.

    Hugging Face · Papers · 🔥 0
  2. Study finds bias in on-policy self-distillation

    A research update argues that on-policy self-distillation (OPSD) can bias a model toward a teacher’s preferred continuations, including stylistic tokens such as hedging words, without ensuring improvement in its ability to solve tasks. Token-level analysis covering 800 rollouts across 200 level 4–5 MATH-500 problems found systematic disagreements over wording rather than mathematical correctness. The authors conclude that OPSD is not a silver bullet for continual learning and question whether further research investment is worthwhile, while acknowledging that it may remain useful in certain contexts.

    Baseten Blog · 🔥 0
  3. AMBIT brings unified generative editing to first-order ambisonics

    Kam Man Wu and six coauthors submitted a paper introducing AMBIT, a framework for native First-Order Ambisonics generation and editing. It combines executable ScenePlans, a shared Transfusion backbone, an FOA-aware continuous VAE, and on-policy self-distillation for planning and rendering. The authors report better content, spatial quality, acoustic fidelity, and preservation of unedited sources than compared baselines across speech, music, and sound.

    Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my On-policy self-distillation experienceAsk about On-policy self-distillation

Nobody has shared their experience with On-policy self-distillation yet.