ChatRep将聊天与语音工作流切换至Terra 6.1
ChatRep创始人u/chatrep称，公司已用采用低推理和均衡输出配置的Terra 6.1替代聊天场景中的Sol 6.1与Sonnet 5.5，并表示其内部测试取得了更好的结果和更低成本。在语音场景中，关闭推理并采用精简输出后，Terra 6.1的表现显著优于Luna 6，但Luna 6仍然更便宜。作者明确表示这不是严谨的科学测试，结论仅限于输出要求较低的简单RAG式数据库交互。TTS和STT模型另有测试，未纳入此次比较。
这为Terra 6.1在客服聊天与语音工作流中的实际部署提供了信号。不过，这些发现仅来自单一运营者的特定用例，且作者明确称测试并不严谨。
Processing img 2raj791o24yh1...
tldr; Terra 6.1 launched and is fantastic. Our old baseline of using Sol 6.1/Sonnet 5.5 for chat is now replaced with Terra 6.1/low reasoning/balanced output with better results and lower cost. Our voice baseline of Luna 6, is significantly better with Terra 6.1/no reasoning/concise. Well worth the added cost.
First of all, this is by no means a highly scientific test. It's a real world use case of what I'm testing for my specific company as a real world user looking at models. Normally, our baseline doesn't change but I thought I'd share since this time it did.
Quick context. I am founder of ChatRep and we are basically an AI native BPO. So blend AI and human. Our focus is on quality as opposed to trying to eliminate human interaction. I say this because as we evaluate models, for us, we don't care too much about the model cost. (Chat isn't too heavy on token usage and we charge $2000+/mo and not $25/mo for context).
Also, with benchmarks, they often ignore things like reasoning level or settings like concise/balanced in response. Those are very important for CX type applications.