EAGLE-4

Headlines · 2

1. Oct 28
   Reddit user proposes architectural priorities for Gemma 5

   A Reddit user shared suggestions for future Gemma models, including a looped transformer, DeepSeek’s Engram, continued 4-bit quantization and more efficient attention mechanisms. The post also proposes a roughly 120B mixture-of-experts model, improved drafter models, linear projections for vision and audio, and abandoning 2-bit quantization for small models. These are community proposals, not a Google announcement; the post contains no Gemma 5 implementation or benchmark results.

   r/LocalLLaMA · 🔥 0
2. Oct 20
   fal and Fireworks AI start early launch of EAGLE-4 inference accelerator

   fal said it worked with Fireworks AI on the early launch of EAGLE-4, describing it as its fastest inference version yet after the EAGLE-1 to EAGLE-3 line. The company reported 961.6 tokens/s on Alibaba Qwen's Qwen3.8-27B using TokenSpeed in BF16 on four NVIDIA B300 GPUs with TP4, a single request and temperature 0. fal pointed readers to a technical blog on how EAGLE-4 works for creative workflows and to a GitHub repository; the performance figures are fal's own and have not been independently verified.

   fal (X) · 🔥 0

Experience and discussion from the community

Share my EAGLE-4 experienceAsk about EAGLE-4