KittenML 开源 1.58 比特语音模型 Kitten-TTS 2
AI 总结
KittenML 发布了 Kitten-TTS 2 的代码与权重,一篇 Reddit 帖文称这是全球首个 1.58 比特文本转语音模型。帖文称该模型有 17 亿参数,线性权重为 -1、0、+1 三值、缩放组大小为 128,可在 CPU 上实时运行,并支持不到 5 秒参考音频的零样本语音克隆、20 多种语言以及强调控制。帖文称代码与权重均已开源,但上述性能与“首个”说法尚未获得独立验证。
深度见解
帖文将 Kitten-TTS 2 定位为面向 GPU 资源有限用户的开源 ElevenLabs 替代方案,称三值权重使其能够低成本本地运行或自托管。
| KittenML has just released code and weights of Kitten-TTS 2, which is a super-efficient frontier TTS model, and the world's first 1.58-bit TTS model. It runs in real time on just a CPU, with zero-shot voice cloning, multilingual support, and expressive / emphasis control. Code and weights are open-source. Ternary(1.58-bit) Weights means it can run locally or be self-hosted for super-cheap. Github: https://github.com/KittenML/KittenTTS Hugging Face: https://huggingface.co/KittenML/kitten-tts-2 KittenML's Discord: https://discord.com/invite/VJ86W4SURW Key features and Advantages 7. What changed from V0.8 to 2: higher quality. Completely new architecture, natural sounding speech, ternary weights, zero-shot voice cloning, multilingual, and emphasis/emotion control. submitted by /u/ElectricalBar7464 [link] [comments] |