Olala mini 7A1B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- OVHcloud unveils Olala mini 7A1B AI model
OVHcloud announced its first Olala model family and introduced Olala mini 7A1B, a BF16 model with 7 billion total parameters and 1 billion active parameters. It uses hybrid attention combining Differential-TPA and Mamba-3, supports a 32K-token context window, and is planned for publication on Hugging Face under the Apache 2.0 license. OVHcloud claims it can run on an 8GB GPU, reach 160 tokens per second on an RTX A4500, and achieve 50 tokens per second on a CPU.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Olala mini 7A1B experienceAsk about Olala mini 7A1B
Nobody has shared their experience with Olala mini 7A1B yet.