Clover 2 公开七专家逐 token 路由模型
Clover 2 团队称已公开 27.8B 基座模型、七个专用 LoRA 适配器、训练后的路由器及 vLLM 插件。其路由器会为每个 token 选择一个或多个专家,并在无需专用能力时回退到原始基座,而非将适配器合并。开发者还报告 GSM8K、MATH-500、GSM-Hard 和 LongBench-v2 成绩提升,但这些基准结果尚未获得独立验证。
Clover 2 公开了一套在推理时保持 LoRA 专家分离并逐 token 动态路由的实现。
Disclosure: I’m with the team that built this.
Wanted to share something a little different from the usual finetune drop. Clover 2 keeps a base model and 7 trained LoRA adapters (roleplay, general assistant, security, math, long-document, efficiency, knowledge) separate at inference time. A trained router picks the right expert(s) per token live, with a null slot that falls back to plain base when nothing specialized applies. So it’s not a merged blend, the model actually makes a decision at every token.
Real benchmark gains over the untouched base: meaningful jumps on GSM8K/MATH-500/GSM-Hard, a solid bump on LongBench-v2, and a measurable drop in generic AI-writing tics on creative writing specifically.
Everything’s public: base model, all 7 adapters in standard PEFT format, the trained router, and the vLLM plugin to run it with the real per-token behavior: https://huggingface.co/kitaniai/clover-2
Heads up if you’re planning to self-host: no GGUF yet, the hybrid attention architecture’s llama.cpp support is still bleeding-edge. vLLM is the supported path right now. If anyone wants to try it, it's free for the next week at https://kitani.ai/, with no card required. We also support ZDR and have a clear privacy policy.
submitted by /u/bakatristan [link] [comments]