NetEase YouDao releases Confucius4-R2T2 streaming ASR model
NetEase YouDao announced Confucius4-R2T2, a stable-prefix streaming automatic speech recognition model for real-time transcription. According to the NetEase YouDao model card, it supports decoding chunks configurable from 80 milliseconds to 2 seconds, permanently commits output without revising earlier words, and adapts Qwen3-ASR-1.7B using Longest Stable Prefix learning on 1,500 hours of Chinese and English audio. Two-stage SFT and GRPO training updates only the language decoder while leaving the pretrained audio encoder and projector frozen.
The model’s configurable chunking and monotonic output are designed for workflows that must act on partial transcripts, including live captions, subtitling, simultaneous speech translation, downstream NLP pipelines and LLM agents.
Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription
Confucius4-R2T2 is a low-latency, high-accuracy stable-prefix streaming automatic speech recognition (ASR) model. It supports configurable decoding chunks from 80 ms to 2 s. The model operates in a monotonic output mode, committing transcript text permanently without revising previous words. This is critical for applications where text must be processed or acted upon instantly. The result is a smoother user experience, with fewer disruptive text revisions and less visual flicker in real-time applications such as real-time live captioning and subtitling, simultaneous speech translation, downstream NLP pipelines and LLM agents.
R2T2, short for Real Real-Time Transcription, adapts Qwen3-ASR-1.7B with Longest Stable Prefix (LSP) learning on 1,500 hours of Chinese and English audio. Two-stage training with SFT and GRPO updates only the language decoder; the pre-trained audio encoder and projector remain frozen, with no architectural changes. LSP targets and an explicit Wait action teach the model what it can commit and when it needs more audio. License
R2T2 uses dual licensing to distinguish the source code from the model weights: submitted by /u/pmttyji
[link] [comments] |