Apple silicon
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 10
- Apple Silicon could undercut cloud token costs for enterprise AI
A 9to5Mac analysis argues that Macs priced as one-time hardware purchases may become more economical than variable cloud-token bills as agentic tools increase usage. Citing Asymco figures, it says a 16-inch MacBook Pro with an M5 Max and 128GB of unified memory could pay back its cost in 7 to 14 months under a high-usage scenario, while emphasizing that the case depends on local open-weight models being capable enough for routine work.
9to5Mac · 🔥 6 - FrameCut open-sources a lightweight Mac video editor for Apple silicon
开源中国 reports that a developer open-sourced FrameCut, a free, watermark-free Mac vlog editor that is 2.3 MB and supports only Apple silicon Macs. According to the developer, it uses the Media Engine for encoding, Metal for color grading and transitions, and the Neural Engine for speech-to-text subtitles. On an M2, the developer measured export times of about 26 seconds for a three-minute 1080p vlog and 95 seconds at 4K; no independent measurements were supplied.
开源中国 · 🔥 0 - Ollama v0.40.11 Adds Local Speech Generation on macOS
Ollama v0.40.11 adds speech generation on macOS, using Gradium’s Phonon text-to-speech model family, the platform’s first supported speech-model family. The Ollama command can speak text or chat-model replies as audio is generated, while applications can stream audio through the OpenAI-compatible /v1/audio/speech endpoint. 9to5Mac reports that the feature is available for Apple Silicon Macs running Ollama 0.40.11 or later, with Windows and Linux support described as coming soon.
Ollama Releases · 🔥 0 - Kapitsa adds Flint support, claims SOTA Apple Silicon decode
A contributor to Kapitsa, an open-source inference engine written with custom Metal kernels and targeted at Apple Silicon from M1 through M6, posted that the project (version 0.2.7) has added support for Recursive's newly released Flint model, which Recursive says is optimized for coding on Macs with 32GB or more and beats Qwen's 35B sparse MoEs while nearing Qwen's 27B dense model. On a single MacBook Pro M4 Pro with 48GB, the contributor's own benchmarks put Kapitsa at 127.9 tok/s short-context decode versus 126.6 for Recursive's rec 0.1.0 and 79.6 for llama.cpp b11804, with Kapitsa's lead over rec growing from 1.06x at 8K context to 1.30x at 128K. The author notes only one Mac was tested, that Flint has not been run on an M5, that prefill on M5+ is not yet optimized, and that a KFlash tree drafter trained on eight H200s for Flint Q4, claimed to give an internal 1.4x decode speedup without accuracy loss, is due Monday; running it requires a Mac with at least 32GB and a 22.6GB download.
r/LocalLLaMA · 🔥 0 - Kapitsa: open-source Apple Silicon inference engine tuned for Qwen and Nemotron
Developer Ye at Nace.ai posted Kapitsa on r/LocalLLaMA, an Apache 2.0 open-source inference engine for Apple Silicon aimed at running coding agents on local models on Macs. Kapitsa supports only two model families — Qwen (3.5 4B, 3.8 27B, 3.6 35B-A3B and 3.8 Flash-Next) and NVIDIA Nemotron (3.5 Lightning, Bolt, Super-VL plus Dory 4B) — so the team can customize Metal kernels per architecture. The author published decode-speed tables on M1 Pro 16GB, M4 Pro 48GB and M5 Max 128GB machines, claiming it beats mlx-serve, oMLX, Ollama, MLX and llama.cpp in most cases, while trailing mlx-serve and oMLX by roughly 2-3% on Qwen3.8 Flash-Next. He also warns readers not to trust benchmarks, points them to a built-in kapitsa bench command to test themselves, notes that 4-bit quantization costs some quality, and says the new codebase should be expected to have bugs.
r/LocalLLaMA · 🔥 0 - SGLang v0.5.22 ships new model support and up to 2.3x throughput gains
SGLang has released v0.5.22, with its release notes stating the version covers 950 pull requests from 245 contributors. The release adds support for models including Clef / Clef Flash, PPLX-Decider v1 / v1.1, EmbeddingGemma 2, LLaDA2.2, HunyuanImage-3.0-Instruct and Kandinsky 6. The notes say DeepSeek-V4.1 gains up to 2.3x more throughput per GPU on H200 and now runs on AMD MI350X / MI355X with up to 1.9x throughput from DSpark, while GLM-5.3 can combine decode context parallelism with MTP for up to 2.1x faster decoding. The release also requires Python 3.11 or newer and deprecates options such as --enable-dp-attention, making it a breaking-change upgrade.
SGLang Releases · 🔥 0 - Rust framework DenseCore claims bit-exact PyTorch match on nanoGPT
A computer science student posted on r/MachineLearning about DenseCore, a small Rust deep learning framework with a PyTorch-like Python API that is roughly 2 MB versus about 580 MB for PyTorch. The author says that running Karpathy's nanoGPT unchanged against it produces identical initial weights from manual_seed, loss, gradients and updated weights bit for bit across all 50 tested steps, including with dropout enabled. Getting there required matching undocumented PyTorch behaviour such as the CPU flash attention kernel and its dropout path, rounding differences in Adam's tail loop, and clip_grad_norm_ using a reciprocal multiply; the match currently holds only on Apple Silicon Macs.
r/MachineLearning · 🔥 0 - Apple MLX runs 816B Muse Spark Open locally on Mac Studio cluster
Apple Machine Learning Research published a post on October 15, 2026, detailing how the latest MLX release runs the nearly trillion-parameter Muse Spark Open (816B total, 42B active) locally on Mac Studio. It says a single Mac Studio offers up to 512GB of unified memory and can scale across multiple Macs using an RDMA over Thunderbolt driver; on a cluster of four M5 Ultra Mac Studios, the model generated over 36 tokens per second at an 8,192-token context. Apple also compared M5 Ultra with M3 Ultra and benchmarked Mistral Medium 3.5, Qwen 3.8, and pipeline and tensor parallelization schemes, claiming up to 4.6x the start-up time-to-first-token speed of the previous Mac Studio generation.
Apple Machine Learning Research · 🔥 0 - Apple's Minions turns idle Macs into an internal virtual GPU cloud
Apple researchers published a paper describing Minions, an internal "virtual GPU cloud" that aggregates idle Apple Silicon Macs across the network to run machine learning inference. A Minion Server splits submitted jobs into subtasks stored in PostgreSQL, a Minion Executor on each Mac pulls subtasks over REST APIs and runs them on the local GPU with inputs and outputs in Amazon S3, and a Minion Watchdog requeues unfinished work when a machine sleeps, goes offline, powers off or its user stops the executor, using five-minute heartbeats. The paper says Minions only handles inference — embeddings with Hugging Face transformer models and text generation through Ollama installed on each Mac — and Apple reports that some jobs that once faced 10-plus-hour centralized GPU queues could start within minutes, figures that come from Apple's own testing and leave cross-team data confidentiality as an open concern.
Apple Machine Learning Research · 🔥 0 - vLLM climbs GitHub Trending among Python projects
vLLM is a high-throughput, memory-efficient inference and serving engine for large language models, originally developed in the Sky Computing Lab at UC Berkeley and now maintained by a community of more than 2,000 contributors. It manages attention key-value memory with PagedAttention and supports continuous batching, chunked prefill, prefix caching, speculative decoding and quantization formats including FP8, INT8/INT4, GPTQ/AWQ and GGUF, alongside an OpenAI-compatible API server. The engine runs on NVIDIA, AMD and Intel GPUs plus x86/ARM/PowerPC CPUs, and supports 200+ model architectures on Hugging Face.
GitHub Trending · Python · 🔥 0
Experience and discussion from the community
Share my Apple silicon experienceAsk about Apple silicon
Nobody has shared their experience with Apple silicon yet.