Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Clover 2 opens 27.8B model with seven token-routed LoRA experts

AI summary

The Clover 2 team says it has released the 27.8B base model, seven specialized LoRA adapters, a trained router, and a vLLM plugin. Rather than merging the adapters, the router selects one or more experts for each token and can fall back to the unmodified base model. The developer also reports stronger GSM8K, MATH-500, GSM-Hard, and LongBench-v2 results, but those benchmark gains have not been independently validated.

In-depth insight

Clover 2 offers a public, token-level expert-routing setup that keeps specialist LoRA adapters separate at inference time.

Disclosure: I’m with the team that built this.

Wanted to share something a little different from the usual finetune drop. Clover 2 keeps a base model and 7 trained LoRA adapters (roleplay, general assistant, security, math, long-document, efficiency, knowledge) separate at inference time. A trained router picks the right expert(s) per token live, with a null slot that falls back to plain base when nothing specialized applies. So it’s not a merged blend, the model actually makes a decision at every token.

Real benchmark gains over the untouched base: meaningful jumps on GSM8K/MATH-500/GSM-Hard, a solid bump on LongBench-v2, and a measurable drop in generic AI-writing tics on creative writing specifically.

Everything’s public: base model, all 7 adapters in standard PEFT format, the trained router, and the vLLM plugin to run it with the real per-token behavior: https://huggingface.co/kitaniai/clover-2

Heads up if you’re planning to self-host: no GGUF yet, the hybrid attention architecture’s llama.cpp support is still bleeding-edge. vLLM is the supported path right now. If anyone wants to try it, it's free for the next week at https://kitani.ai/, with no card required. We also support ZDR and have a clear privacy policy.

submitted by /u/bakatristan [link] [comments]

#Clover 2#Kitani AI#vLLM#PEFT#Hugging Face#llama.cpp

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.