Tontaube V1.1支持开放权重声音克隆和低资源部署
Tontaube开发者发布Tontaube V1.1,这是一款面向长篇音频的开放权重、2.9B参数自回归文本转语音模型。它可利用5至60秒参考音频进行零样本声音克隆,并内置46种声音。开发者称,4-bit GPTQ版本加载时约需4 GB显存,可在12核桌面CPU上接近实时运行。英语和德语是主要支持语言;西班牙语、法语、意大利语、荷兰语和葡萄牙语尚未由母语者检查。V1.1还加入五项风格控制、音频清理适配器,以及提供GPU和CPU内核的服务器。
此次发布将长篇语音生成和声音克隆与低资源4-bit及CPU部署路径结合起来,使该模型更便于在本地运行。
We just released Tontaube V1.1, a text-to-speech model built for long-form audio (audiobooks, articles, voice agents) with zero-shot voice cloning. Our previous V1 release needed a lot of VRAM because of its vLLM setup, so this version is about making it more accessible: the 4-bit weights run in about 4 GB of VRAM, or at about real time on a desktop CPU. In a blind listening study with 400 pairwise comparisons, listeners preferred our V1 model's prosody over Fish Audio S2 Pro in about 70% of cases (details are in the paper). V1.1 is a post-trained version of this model.
What it is
- ~2.9B parameters, autoregressive, streams audio as it generates
- Clones a voice from 5–60 seconds of reference audio; 46 voices are bundled
- English and German are the main languages (works best in English). Spanish, French, Italian, Dutch and Portuguese work but have not been checked by native speakers
- Long texts are split at sentence boundaries and joined, so you can feed it whole chapters
Running it locally
- The default is a 4-bit (GPTQ) version: 1.8 GB download, loads in about 4 GB of VRAM, peaks at about 6.5 GB on long texts
- GPU speed: about 13x real time on an RTX 5090 for a single request (21–23x batched), ~190 ms to first audio when streaming. About 6–7x on an RTX 3090
- CPU: no GPU needed. About real time on a 12-core desktop CPU (Ryzen 9 5900X, dual-channel DDR4). It is limited by memory bandwidth and needs AVX2
- No vLLM or llama.cpp needed: it ships its own server with Triton kernels for the GPU and AVX2 kernels for the CPU. Full-precision weights and a vLLM backend are there too if you have 24 GB+ and want throughputgit clone --branch v1.1.0 --depth 1 https://github.com/craitech/tontaube.git cd tontaube uv run --python 3.12 --frozen tontaube serve