Ricursive Intelligence预览65B稠密模型Ripple
AI 总结
Ricursive Intelligence发布了Ripple-65B-Preview预览版。这是一款65B稠密开放权重模型,采用80层、5,120维的“瘦而深”设计,并以4:1比例使用滑动窗口注意力和全局注意力。Reddit报告称GGUF权重已经提供,厂商基准将其与Muse Spark Open和Reflection的Beam比较,但没有独立测量数据;其检查点还同时被描述为经过智能体编程方向轻度后训练和仅完成预训练。
深度见解
Ripple-65B-Preview提供了可本地运行的65B稠密模型、架构细节和厂商基准,但训练过程与实际性能仍有待独立验证。
So Ricursive Intelligence (not to be confused with Recursive, the makers of Flint) just dropped the preview of their new dense 65B model, which appears to have really impressive performance, putting it on the frontier of American open-weights models of any size. Their benchmarks compare it with Muse Spark Open (816B) and Reflection's Beam (501B), and it trades blows with them. They "use a standard post-training recipe consisting of midtraining, long context, SFT, long context SFT, and mixed domain RL. Our Preview release has gone through relatively light posttraining, with a focus on agentic coding."
A lot of folks here have been clamoring for a new ~70B dense model for a long time now, and if it's not benchmaxxed as hell, this could be a really cool new tool in our arsenal. If this is only lightly post-trained for agentic coding, not the full potential of the model, this could be a really powerful release in the long run. Some interesting design decisions as well.
AtomicChat GGUFs (imatrix coming soon) -- Q8_0: 68.8 GB, Q4_K_M: 38.8 GB.
Handful of benchmarks (see model card for more) it shares with Qwen models:
To build the Ricursive llama.cpp fork: git clone https://github.com/ggml-org/llama.cpp cd llama.cpp git checkout 9e2a04a439edc49f08c5acdafefae19dfa25a658 curl -LO https://huggingface.co/AtomicChat/Ripple-65B-Preview-GGUF/resolve/main/ricursive-port.patch git apply ricursive-port.patch cmake -B build -DGGML_CUDA=ON # Mac: drop -DGGML_CUDA=ON cmake --build build -j --config Release --target llama-server llama-cli
If you try it our, report back with results! I'm downloading it now. Some questions about how it will perform given it's an early checkpoint, and they weren't exactly consistently clear about the actual training (seems like they said some contradictory things). Thoughts? submitted by /u/returnity
[link] [comments] |
#Ricursive Intelligence#Ripple-65B-Preview#Muse Spark Open#Reflection Beam#DFlash2#Qwen3.8-27B#Qwen3.8-Flash-Next#AtomicChat