Saber
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Developer releases Saber Rust inference engine for AMD R9700
A developer released Saber, an LLM inference engine written in Rust and targeting AMD R9700 GPUs. It supports tensor parallelism settings of 1, 2 or 4, as well as Qwen3.8 27B. The developer reported 6,645 tokens per second for prefill and a 316 tokens per second decode peak on Qwen3.8 27B, using two R9700 GPUs, an AMD Ryzen 9900X and a Taichi X870E. The developer also claims Saber beats existing available engines on Qwen3.8 27B and Flash Next.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Saber experienceAsk about Saber
Nobody has shared their experience with Saber yet.