tts-bench第三轮对比91款开源TTS模型与28个托管API
AI 总结
tts-bench作者发布第三轮改版文本转语音基准,开放模型榜覆盖91个本地运行的模型,托管API榜则包含28项服务。测试提供音频样本以及首段音频时间、实时因子、UTMOS、WER、声音克隆相似度和API价格等指标,但作者也指出这些客观指标不能完全代表人类偏好或完整延迟。
深度见解
该基准为开发者集中比较本地部署与托管TTS方案提供了参考,但结果由基准作者自行发布,其共用Python测试框架也仅被称为“相同ish”。
This is the third round of tts-bench. Thanks to everyone who gave feedback on the first two posts:
tts-bench runs every model through the sameish Python harness on the same prompts, so you can compare them fairly and actually listen to the output. This round adds a separate board for hosted APIs.
What's in it
- 91 open models run locally on an RTX 5090 32GB, an RTX 3090 24GB, and an Apple M4 16GB (sometimes)
- 28 hosted APIs on their own board, tested with the same 6 prompts (medians over several days of warm calls from the Eastern US)
- Prompts in English, Spanish and French
- Audio samples for every model, plus time to first audio, realtime factor, UTMOS, WER, voice-cloning similarity, and price for the APIs
Some results from the open board
#tts-bench#Vaniq-Edge#Maya1#Underdog Woof#Phonon 31m#Chatterbox#LongCat-AudioDiT 3.5B#FireRedTTS3#AssemblyAI#Gradium#Palabra#VUI Labs Luna