Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

NetEase YouDao releases Confucius4-R2T2 streaming ASR model

AI summary

NetEase YouDao announced Confucius4-R2T2, a stable-prefix streaming automatic speech recognition model for real-time transcription. According to the NetEase YouDao model card, it supports decoding chunks configurable from 80 milliseconds to 2 seconds, permanently commits output without revising earlier words, and adapts Qwen3-ASR-1.7B using Longest Stable Prefix learning on 1,500 hours of Chinese and English audio. Two-stage SFT and GRPO training updates only the language decoder while leaving the pretrained audio encoder and projector frozen.

In-depth insight

The model’s configurable chunking and monotonic output are designed for workflows that must act on partial transcripts, including live captions, subtitling, simultaneous speech translation, downstream NLP pipelines and LLM agents.

Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription Confucius4-R2T2 is a low-latency, high-accuracy stable-prefix streaming automatic speech recognition (ASR) model. It supports configurable decoding chunks from 80 ms to 2 s. The model operates in a monotonic output mode, committing transcript text permanently without revising previous words. This is critical for applications where text must be processed or acted upon instantly. The result is a smoother user experience, with fewer disruptive text revisions and less visual flicker in real-time applications such as real-time live captioning and subtitling, simultaneous speech translation, downstream NLP pipelines and LLM agents. R2T2, short for Real Real-Time Transcription, adapts Qwen3-ASR-1.7B with Longest Stable Prefix (LSP) learning on 1,500 hours of Chinese and English audio. Two-stage training with SFT and GRPO updates only the language decoder; the pre-trained audio encoder and projector remain frozen, with no architectural changes. LSP targets and an explicit Wait action teach the model what it can commit and when it needs more audio. License R2T2 uses dual licensing to distinguish the source code from the model weights: submitted by /u/pmttyji [link] [comments]

#NetEase YouDao#Confucius4-R2T2#Qwen3-ASR-1.7B

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.