LiquidAI

Headlines · 2

1. 4d
   LiquidAI releases LFM3-Omni-2B-GGUF with llama.cpp support

   LiquidAI released the LFM3-Omni-2B-GGUF model, according to a r/LocalLLaMA post. The community report says tdakhran coordinated a same-day llama.cpp release, while a user highlighted support for Polish text-to-speech and speech-to-text and described the 2B model as suitable for on-device deployment.

   r/LocalLLaMA · 🔥 0
2. Oct 19
   Developer launches Tinkerbox to run decision models on Apple's Neural Engine via Shortcuts

   A developer posting on r/LocalLLaMA as /u/WeGoToMars7 released Tinkerbox, an app that runs decision models on Apple's Neural Engine (ANE) and exposes Shortcuts actions for automating system events such as incoming email and iMessages, folder and file changes, time of day and alarms. The author says LiquidAI d1-3B runs on the ANE with roughly 40 ms latency for warm short-context decisions under 256 tokens, measured on an M5 Pro, and says the model sits on the Pareto frontier of Decision Index 0.3.2; both are self-reported or cited by the developer, who notes he has no other Macs to test on. The d1-3B implementation uses a tree structure to evaluate multiple decisions in a single pass, source code and AOT-compiled models are published on GitHub and Hugging Face, and the author says he is working on integrating vLLM d3 models based on Qwen3.5 with 0.8B, 2B and 4B variants planned.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my LiquidAI experienceAsk about LiquidAI