llama-server
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Ollama v0.40.13 expands LFM3 support and patches Metal crash
Ollama v0.40.13 brings Liquid AI's LFM3 models, including lfm3-audio and lfm3-omni, to Linux and Windows in addition to Apple silicon. The release also includes LFM3 GGUF fixes, llama-server speech changes, and a llama.cpp bump to b11963. A v0.40.13-rc1 tag added a temporary workaround for a Metal unary-library crash regression on older macOS versions.
Ollama Releases · 🔥 0 - OpenJet Adds Concurrent Coding-Agent Inference on One GPU
OpenJet released an update that serves multiple coding agents concurrently on a single GPU using a custom CUDA megakernel for Qwen3.8-27B Q4_K_M. Its developer reported 64–72 tokens per second per agent with four agents on an RTX 3090 for short prompts, and 52–55 tokens per second with 23K contexts, though no independent measurements were provided.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my llama-server experienceAsk about llama-server
Nobody has shared their experience with llama-server yet.