Flint MoE model support merged into llama.cpp, Reddit post says
A post on r/LocalLLaMA says a pull request adding Flint (FlintForCausalLM) support to llama.cpp, PR #30928 in the ggml-org repository, was merged after about six hours. The post describes Flint as a decoder-only mixture-of-experts Transformer from developer Recursive with 39.8B total parameters and roughly 2.5B active parameters per token including the output head, spread over 49 layers — 2 dense followed by 47 MoE layers. It lists 256 routed experts with 6 selected per token plus an always-active shared expert, 35 sliding-window and 14 full-attention layers, a documented context configuration of 262,144 tokens, and a stated knowledge cutoff of June 2026; these details come from the post alone and have not been independently confirmed.
According to the post, the merge makes Flint usable in llama.cpp, adding a 39.8B MoE model with about 2.5B active parameters to the local inference ecosystem.
| now you can use Flint in llama.cpp (merged after 6h) Model specifications submitted by /u/jacek2023 [link] [comments] |