PrismML

Headlines · 1

1. 21h
   PrismML releases Ternary Bonsai 2 on-device models

   PrismML on Oct. 15 announced the Ternary Bonsai 2 series of on-device models in 2B, 4B and 9B sizes, built with ternary weights that encode parameters as only -1, 0 or +1 and take up roughly 0.43GB, 0.95GB and 2GB of storage respectively, joining the previously released 27B version to cover lightweight to complex local workloads. The company says the models target local agents on phones, PCs and wearables, handling instruction following, everyday tasks, tool calling and image understanding; across 19 benchmarks spanning six capability areas, the 9B model used about 40% fewer tokens on standard instruction execution and everyday math tasks. PrismML claims up to 5x throughput and 3x energy efficiency versus equivalent full-precision models on hardware such as the RTX 4090 and M5 Pro, with the 9B reaching up to 34 tokens per second and the 2B up to 120 tokens per second on an iPhone 18 Pro Max; the models are built on Alibaba's Qwen 3.5 base, released under Apache 2.0, and runnable via llama.cpp on NVIDIA GPUs or MLX on Mac, iPhone and iPad.

   IT之家 AI · 🔥 17

Experience and discussion from the community

Share my PrismML experienceAsk about PrismML