PrismML releases Ternary Bonsai 2 on-device models
PrismML on Oct. 15 announced the Ternary Bonsai 2 series of on-device models in 2B, 4B and 9B sizes, built with ternary weights that encode parameters as only -1, 0 or +1 and take up roughly 0.43GB, 0.95GB and 2GB of storage respectively, joining the previously released 27B version to cover lightweight to complex local workloads. The company says the models target local agents on phones, PCs and wearables, handling instruction following, everyday tasks, tool calling and image understanding; across 19 benchmarks spanning six capability areas, the 9B model used about 40% fewer tokens on standard instruction execution and everyday math tasks. PrismML claims up to 5x throughput and 3x energy efficiency versus equivalent full-precision models on hardware such as the RTX 4090 and M5 Pro, with the 9B reaching up to 34 tokens per second and the 2B up to 120 tokens per second on an iPhone 18 Pro Max; the models are built on Alibaba's Qwen 3.5 base, released under Apache 2.0, and runnable via llama.cpp on NVIDIA GPUs or MLX on Mac, iPhone and iPad.
Ternary-weight on-device models could lower the hardware bar for running local AI agents on phones and wearables, if the claimed throughput and efficiency gains hold up.