Fish Audio S2

Headlines · 1

1. Oct 12
   Fish Audio releases open-weight Drama 3 speech model with 35B MoE backbone

   Fish Audio has published a technical report for Fish Audio Drama 3, an open-source speech generation model that it says turns text into directed performances. The model uses a 35B-parameter mixture-of-experts backbone activating 3B parameters per token, clones voices from multiple references, follows natural-language direction, and adds multi-turn revision, multi-character scene dubbing, editing by infilling and streaming text input. The report pairs a hybrid linear-attention backbone with a new codebook multi-token-prediction audio decoder, and describes training via three-stage pre-training, instruction fine-tuning and large-batch reinforcement learning rewarded by a single learned human-preference model. Weights are said to be available on GitHub and Hugging Face with inference through SGLang-Omni, and the authors report 271 frames per second for single-stream decoding on one H200 versus 177 for Fish Audio S2.

   Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my Fish Audio S2 experienceAsk about Fish Audio S2