Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Fish Audio releases open-weight Drama 3 speech model with 35B MoE backbone

AI summary

Fish Audio has published a technical report for Fish Audio Drama 3, an open-source speech generation model that it says turns text into directed performances. The model uses a 35B-parameter mixture-of-experts backbone activating 3B parameters per token, clones voices from multiple references, follows natural-language direction, and adds multi-turn revision, multi-character scene dubbing, editing by infilling and streaming text input. The report pairs a hybrid linear-attention backbone with a new codebook multi-token-prediction audio decoder, and describes training via three-stage pre-training, instruction fine-tuning and large-batch reinforcement learning rewarded by a single learned human-preference model. Weights are said to be available on GitHub and Hugging Face with inference through SGLang-Omni, and the authors report 271 frames per second for single-stream decoding on one H200 versus 177 for Fish Audio S2.

In-depth insight

The authors say one open-weight model now combines multi-turn revision, scene dubbing, infilling edits and streaming input, with weights published for download.

Computer Science > Sound

arXiv:2610.18010 (cs)

[Submitted on 13 Oct 2026]

Title:Fish Audio Drama 3 Technical Report

Authors:Dawei Han, Shidong Li, Shijia Liao, Jiahua Liu, Songting Liu, Qingzheng Wang, Yuxuan Wang, Xin Chen, Yifan Cheng, Tianyu Li, Gangin Park, Xuehao Yang, Chang Zeng, Haoyang Zhang, Ruoyi Zhang, Xiangyu Zhang

View a PDF of the paper titled Fish Audio Drama 3 Technical Report, by Dawei Han and 15 other authors

#Fish Audio#Fish Audio Drama 3#Fish Audio S2#Hugging Face#GitHub#SGLang-Omni

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.