Cohere 补上 llama.cpp 视觉编码器支持
AI 总结
Cohere 员工 Nick（u/nick_frosst）在 r/LocalLLaMA 发帖称，团队近期已将 North Micro Vision Instruct 视觉编码器的 llama.cpp 支持合并入库，并表示这意味着 Cohere 最新的模型架构现在都与 llama.cpp 兼容，其中语言模型部分与此前已获支持的 North Mini Code、Command A+ 采用同一架构。帖文还称 North Micro Vision 是 Cohere 多个新发布的基座模型，并邀请社区试用反馈。同一帖中，Cohere 表示其语音转文字模型 Cohere Transcribe 现已在 Unsloth 与 Unsloth Studio 中开放微调。上述兼容性与模型能力表述均来自 Cohere 一方，未提供独立验证或基准数据。
深度见解
对本地推理社区而言，llama.cpp 支持意味着 Cohere 最新架构可在社区常用的本地运行栈上加载，而不必依赖厂商自有工具链。
| Hey guys, Nick here from Cohere. It's been a minute. We had a great time launching Command A+ and beta-testing North Mini Code with you guys earlier this year, your feedback has really helped make our models and delivery much better. one of the biggest things we heard was that you really wanted llama.cpp support, which makes total sense given the nature of this sub. i didn't want to post in here again until we'd been able to fulfill that promise, and I'm really happy to say that we've made progress. Our team recently merged llama.cpp support for the vision encoder of North Micro Vision Instruct, which means that now all of our latest model architectures are compatible with llama.cpp (the LLM is the same arch as for North Mini Code and Command A+ - already supported thanks to the work of people like you guys). North Micro Vision is being used as the base for several of our new releases, and i'm really psyched to say we've got the support you guys have been wanting. Please feel free to try it out and let us know what you think. It's just one step, but there's only more where that came from. On a slightly similar note, Cohere Transcribe is now available in Unsloth and Unsloth Studio for fine-tuning. it's a crazy good STT model, one of the best out there, so if you're a fan of the guys over at r/unsloth (i know we are), give it a whirl. Thanks again for all your feedback, and let us know what else you want to see from Cohere. submitted by /u/nick_frosst [link] [comments] |
#Cohere#llama.cpp#North Micro Vision Instruct#Cohere Transcribe#Unsloth#Unsloth Studio#North Mini Code#Command A+