创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

网易有道发布流式语音识别模型 Confucius4-R2T2

AI 总结

网易有道发布稳定前缀流式语音识别模型 Confucius4-R2T2,面向实时转录。网易有道模型卡称,该模型支持80毫秒至2秒的可配置解码块,采用不回改既有文字的单调输出模式,并基于 Qwen3-ASR-1.7B,以1,500小时中英文音频进行最长稳定前缀学习。两阶段 SFT 和 GRPO 训练仅更新语言解码器,冻结预训练音频编码器和投影器,且不改变架构。

深度见解

可配置分块和单调输出面向必须立即处理局部转录内容的场景,包括实时字幕、同声传译、下游 NLP 流程和 LLM 智能体。

Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription Confucius4-R2T2 is a low-latency, high-accuracy stable-prefix streaming automatic speech recognition (ASR) model. It supports configurable decoding chunks from 80 ms to 2 s. The model operates in a monotonic output mode, committing transcript text permanently without revising previous words. This is critical for applications where text must be processed or acted upon instantly. The result is a smoother user experience, with fewer disruptive text revisions and less visual flicker in real-time applications such as real-time live captioning and subtitling, simultaneous speech translation, downstream NLP pipelines and LLM agents. R2T2, short for Real Real-Time Transcription, adapts Qwen3-ASR-1.7B with Longest Stable Prefix (LSP) learning on 1,500 hours of Chinese and English audio. Two-stage training with SFT and GRPO updates only the language decoder; the pre-trained audio encoder and projector remain frozen, with no architectural changes. LSP targets and an explicit Wait action teach the model what it can commit and when it needs more audio. License R2T2 uses dual licensing to distinguish the source code from the model weights: submitted by /u/pmttyji [link] [comments]

#NetEase YouDao#Confucius4-R2T2#Qwen3-ASR-1.7B

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。