创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Tontaube V1.1支持开放权重声音克隆和低资源部署

AI 总结

Tontaube开发者发布Tontaube V1.1,这是一款面向长篇音频的开放权重、2.9B参数自回归文本转语音模型。它可利用5至60秒参考音频进行零样本声音克隆,并内置46种声音。开发者称,4-bit GPTQ版本加载时约需4 GB显存,可在12核桌面CPU上接近实时运行。英语和德语是主要支持语言;西班牙语、法语、意大利语、荷兰语和葡萄牙语尚未由母语者检查。V1.1还加入五项风格控制、音频清理适配器,以及提供GPU和CPU内核的服务器。

深度见解

此次发布将长篇语音生成和声音克隆与低资源4-bit及CPU部署路径结合起来,使该模型更便于在本地运行。

We just released Tontaube V1.1, a text-to-speech model built for long-form audio (audiobooks, articles, voice agents) with zero-shot voice cloning. Our previous V1 release needed a lot of VRAM because of its vLLM setup, so this version is about making it more accessible: the 4-bit weights run in about 4 GB of VRAM, or at about real time on a desktop CPU. In a blind listening study with 400 pairwise comparisons, listeners preferred our V1 model's prosody over Fish Audio S2 Pro in about 70% of cases (details are in the paper). V1.1 is a post-trained version of this model.

What it is

  • ~2.9B parameters, autoregressive, streams audio as it generates
  • Clones a voice from 5–60 seconds of reference audio; 46 voices are bundled
  • English and German are the main languages (works best in English). Spanish, French, Italian, Dutch and Portuguese work but have not been checked by native speakers
  • Long texts are split at sentence boundaries and joined, so you can feed it whole chapters

Running it locally

  • The default is a 4-bit (GPTQ) version: 1.8 GB download, loads in about 4 GB of VRAM, peaks at about 6.5 GB on long texts
  • GPU speed: about 13x real time on an RTX 5090 for a single request (21–23x batched), ~190 ms to first audio when streaming. About 6–7x on an RTX 3090
  • CPU: no GPU needed. About real time on a 12-core desktop CPU (Ryzen 9 5900X, dual-channel DDR4). It is limited by memory bandwidth and needs AVX2
  • No vLLM or llama.cpp needed: it ships its own server with Triton kernels for the GPU and AVX2 kernels for the CPU. Full-precision weights and a vLLM backend are there too if you have 24 GB+ and want throughputgit clone --branch v1.1.0 --depth 1 https://github.com/craitech/tontaube.git cd tontaube uv run --python 3.12 --frozen tontaube serve

#Tontaube V1.1#Tontaube#Fish Audio S2 Pro

原文约 2 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。