Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Ollama

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 99

  1. Ollama v0.40.17 Adds Local Support for Inkling 2 Mini

    Ollama v0.40.17 adds local support for Thinking Machines’ Inkling 2 Mini, a multimodal model that handles text and images and supports tool calls and thinking. Users can launch it with the command “ollama run inkling-2-mini.” The release supports Apple silicon only, while Ollama says PC support will follow in an upcoming release. Ollama also says the model can fit on a Mac with about 20GB of memory.

    Ollama Releases · 🔥 6
  2. AutoClip Test: 19 Clips From a 1-Hour-48-Minute Livestream

    In a first-hand test published by Juejin AI, the MIT-licensed AutoClip open-source tool transcribed a 1-hour-48-minute livestream and generated 19 vertical clips in 308 seconds. It matched four of the author’s six hand-picked highlights but selected none from the livestream’s 24th-to-43rd-minute chapter; the test used Alibaba Cloud Bailian for transcription, while AutoClip also supports local models such as Ollama and LM Studio.

    掘金 · 人工智能 · 🔥 2
  3. AutoClip open-source tool repackages long videos for multiple platforms

    AutoClip is an open-source desktop, CLI, and MCP tool that turns podcasts, interviews, courses, and other long videos into short clips with subtitles, covers, and publishing materials. Project documentation says editing, framing, and rendering run on the user’s computer. Users can select analysis models and use author-provided subtitles, local Whisper or SenseVoice transcription, or configured cloud transcription. Outputs can be tailored for Douyin, Xiaohongshu, TikTok, Reels, YouTube Shorts, Bilibili, and YouTube. The latest formal release updated the desktop, CLI, and MCP versions, but the report does not provide a specific version number.

    GitHub Trending · Python · 🔥 3
  4. Thinking Machines Lab releases Inkling 2 Mini open-weight model

    Thinking Machines Lab released Inkling 2 Mini, a 26.4B-parameter open-weight multimodal MoE model designed for local agentic workloads. Its 24 decoder layers include 12 middle layers that run three times per token, while the checkpoint has 3.4B active parameters and a reported 1M-token context window. Artificial Analysis independently placed it at 20 on its Intelligence Index, while Thinking Machines Lab reported leading results among open-weight models below 100B total parameters.

    TestingCatalog · 🔥 55
  5. Rebuilding a self-hosted voice assistant with microWakeWord

    A developer rebuilt a self-hosted Platypush voice assistant pipeline using the new assistant.microwakeword plugin, assistant.openai for Whisper transcription, the openai plugin for responses and context, and tts.openai for speech. The shared audio preprocessor now supports Silero, WebRTC, and energy-based VAD with hysteresis, sliding-window smoothing, and an adaptive noise floor; on the author’s synthetic benchmark, conversation end detection improved from 6–10 seconds to 1.0–1.6 seconds after the final word.

    Hacker News 首页(100+ 分) · 🔥 0
  6. ThinRead 0.2.2 retrospective details a local-first AI reading workflow

    In a first-party retrospective, the author describes ThinRead 0.2.2, an MIT-licensed macOS reading-and-writing application built with Electron, React and TypeScript. The tool stores books and notes locally, verifies generated quotations against source text, validates streamed AI output before writing, and uses local BGE-small-zh embeddings for cross-book connections, while supporting multiple cloud and local model providers. The author also reports an import pipeline covering eight file formats, webpages, OPDS, WeChat Reading, Readwise and Kindle highlights, plus macOS OCR for scanned PDFs.

    掘金 · 人工智能 · 🔥 0
  7. 128GB Unified-Memory Mini PCs Bring Large-Model Inference to the Desktop

    掘金·人工智能 argues that 128GB unified-memory mini PCs are becoming a practical desktop platform for running 70B–100B-class models locally, with most of the shared CPU-GPU memory pool available for model weights and KV cache. It reports that Ollama defaults to a 4K context below 24GB and supports 256K at 48GB or more, while Qwen3.6 35B MoE reached 20 tokens per second on a 64GB laptop with integrated graphics, though community reports say the model can lose track of multi-step tasks. The article also compares Nvidia DGX Spark with an AMD mini PC and closes by promoting Codigger’s software-led approach to local inference, cloud workstations, and agent orchestration.

    掘金 · 人工智能 · 🔥 0
  8. Dodaios launches open-source local AI assistant and agent platform

    Dodaios is an open-source Python program that runs locally as a desktop app or a headless server with a browser interface on Windows, macOS, and Linux. Its lead assistant supports voice, chat, and phone use, and can work with Claude, OpenAI, Gemini, and local Ollama models. The platform can also launch and coordinate coding agents, including Claude Code and Codex, in a built-in Agentic IDE. The project says phone calls remain an early preview and require the user’s own Twilio number, while only Windows 11 has a recorded live sign-off.

    GitHub Trending · Python · 🔥 0
  9. Laptop NPUs: Power-Saving Promise, Limited Everyday Utility

    科技新报, synthesizing analysis from Engadget and other publications, argues that laptop NPUs mainly trade some generality for low power consumption rather than improving AI performance across the board. It notes that TOPS figures are generally theoretical INT8 peaks, while practical NPU use is concentrated in background features such as meeting blur, captions, translation, and local search; in a cited OpenVINO test, Mistral 7B reached 98% NPU utilization. The source identifies limited use cases and software support as constraints, recommending Copilot+ PCs mainly for battery life and frequent video calls, and sufficient memory and bandwidth for local AI models.

    科技新报 · 🔥 0
  10. A Local AI User’s Journey Through Text, Image, and Audio Tools

    In a r/LocalLLaMA post, /u/revennest recounts moving from Ollama, LM Studio, and Msty to Oobabooga Text Generation-WebUI, later trying KoboldCPP, Llamafile, llama.cpp, Open WebUI, and SearXNG. The author says Oobabooga’s usability and deep customization made them stay with local AI, and reports running Llama 3.1 8B at roughly 1 token per second on an i5-6400T mini PC. The post also covers later experimentation with Forge, ComfyUI, Unsloth Studio, and audio.cpp, but these remain one user’s personal experience rather than a comparative test.

    r/LocalLLaMA · 🔥 0
  11. SupraLabs releases 65M-parameter Supra2.5 Base and Instruct models

    SupraLabs announced the Supra2.5-65M Base and Instruct model family, with the models available on Hugging Face. The company says it trained the model for four days on two RTX A6000 GPUs using 100 billion tokens of high-quality data, with F16, Q8_0, and Q4_K_M GGUF files available for llama.cpp, Ollama, and Unsloth. SupraLabs claims the 65M-parameter model outperforms its earlier 50M- and 100M-parameter models, but the supplied report includes no independent benchmark verification.

    r/LocalLLaMA · 🔥 0
  12. Ollama v0.40.17 improves CLI recovery and MLX concurrency

    Ollama v0.40.17 adds improved ChatGPT CLI restore and graceful restart, along with support for using thinking metadata in OpenCode settings. The release also introduces memory mapping for Vulkan integrated GPUs, concurrent generation in MLX, and version bumps for llama.cpp, MLX, and MLX-C. Ollama's release notes identify these changes under v0.40.17, while the listed changelog endpoint ends at v0.40.17-rc0.

    Ollama Releases · 🔥 0
  13. Ollama troubleshooting: model download versus local run failures

    An article on Ollama distinguishes two problems: a model that cannot be downloaded and a downloaded model that cannot run. It recommends checking Ollama’s processor output and verbose run statistics. For download issues, it suggests testing with a smaller model or importing a GGUF file from ModelScope. For runtime issues, it suggests using a smaller model, shortening the context, or accepting CPU inference.

    掘金 · 人工智能 · 🔥 0
  14. Run DeepSeek Harness Web with a LAN-hosted Ollama model

    A hands-on guide explains how to install DeepSeek Harness Web, start it with dsh web, and connect it to Ollama 0.40.16 running on another LAN host. The author documents isolated web and desktop profiles, provider configuration, port and model-tag troubleshooting, and a custom proxy that disables reasoning output. The author also reports that both Ollama’s native port and the proxy port were reachable from the test machine, contrary to a commonly repeated claim.

    掘金 · 人工智能 · 🔥 0
  15. How Prefix Caching Keeps Long-Horizon Coding Agents Efficient

    Together AI and Ollama explain how coding agents resend the full conversation each turn, creating long inputs and short tool-call outputs. They recommend stable prompt prefixes, cache-aware GPU routing, concise tool results, and sufficient cache memory; Together AI also says it separates prefill and decode across clusters and transfers cached state over RDMA.

    Together AI Blog · 🔥 0
  16. Microsoft’s PyRIT toolkit brings open-source AI red teaming to models and apps

    Microsoft AI Red Team and open-source contributors built PyRIT, an open-source toolkit for identifying security and safety weaknesses in generative AI systems. It combines automated scans, adaptive multi-turn attacks and human-led testing through a command-line scanner, graphical interface and extensible Python framework, with connections to major model providers and support for testing HTTP, WebSocket and browser-based endpoints.

    GitHub Trending · Python · 🔥 0
  17. SupoClip: open-source AI video clipping tool

    SupoClip’s GitHub README describes it as an open-source alternative to OpusClip for turning podcasts, talks and stream VODs into vertical 9:16 clips. The project says it can select and score promising segments, center speakers through face detection, add word-synced subtitles, hook titles and optional B-roll, and support hosted and self-hosted use, an MCP server, and a REST API. These capabilities and quality claims come from the project README and have not been independently verified.

    GitHub Trending · Python · 🔥 0
  18. OpenWorker puts its desktop app in open beta and publishes a Harness SDK

    The OpenWorker repository README says its desktop app, for AI-assisted research, writing, code review and task execution across connected tools, is in open beta with automatic updates, and describes a Harness SDK for building agentic desktop and web apps. The project says the SDK handles agent loops, tool calls, approvals, streaming and durable sessions; developers can bring cloud or local models, use a TypeScript SDK from npm or embed the Rust engine, and add sub-agents, teams, OpenShell sandboxing and observability. The README notes macOS builds are signed and notarized while Windows 10/11 builds are not yet code-signed, so SmartScreen will warn. Capability and safety claims are the project's own description and were not independently verified in the supplied report.

    GitHub Trending · Python · 🔥 0
  19. Jin places architecture approval before AI coding

    A technical breakdown describes Jin as an architecture-first desktop coding agent that requires a human to approve or reject an architecture-change proposal before implementation begins. According to the report, Jin maintains a persistent architecture Ledger, limits implementation to files approved in the proposal, uses LSP to select symbol-level context, and runs project checks, failure self-repair, consistency validation, version checkpoints, and rollback. The report also says Jin uses the Eko agent runtime and positions it as an alternative to reviewing large code diffs directly.

    掘金 · 人工智能 · 🔥 0
  20. datasette-llm 0.1a11 adds OpenAI-compatible endpoints

    Simon Willison’s Weblog reports that datasette-llm 0.1a11 adds support for OpenAI-compatible endpoints. The Datasette plugin configures LLMs for use by other Datasette plugins, including locally hosted models served through tools such as LM Studio, Ollama, or llama.cpp.

    Simon Willison's Weblog · 🔥 0
  21. Mastra adds private model gateways for self-hosted models

    Mastra introduced custom model gateways that route agent requests to self-hosted open-weight models, with a custom gateway ID serving as the model prefix in agent configuration. The vendor demonstrated a research agent using gpt-oss:20b through Ollama, and Studio can hide external providers so users select only models exposed by their own gateways. Mastra says self-hosting can keep sensitive data within a user’s network and simplify HIPAA or GDPR compliance, but these benefits were not independently verified.

    Mastra Blog · 🔥 0
  22. MovieAgent Unveils Six-Layer Architecture and Vector Store Results

    The MovieAgent project author published the second installment of a ten-part series, detailing a six-layer dependency model, a request path from HTTP input to streamed results, and three configuration switches for vector storage, embeddings, and LLM providers. The implementation uses a five-node LangGraph flow while reserving LLMs for intent parsing and response generation, with planning, execution, and fallback handling kept deterministic. On a self-reported sample of 1,134 films, Chroma, embedded Qdrant, and Milvus Lite showed sub-100-millisecond query latency, though the results have not been independently verified.

    掘金 · 人工智能 · 🔥 0
  23. Report describes Magpie gateway for AI coding assistants

    A Chinese-language report describes open-source Magpie as a local, cross-platform gateway for AI coding agents such as Claude Code and Codex CLI. According to the report, it translates Anthropic Messages requests into an OpenAI-compatible format and can connect clients to models including DeepSeek-V3/R1, Kimi, Qwen, and Ollama-hosted models. The report also says Magpie supports account failover when a primary provider encounters errors such as rate limits or unpaid balances. It offers a macOS menu utility, terminal TUI, web interface, and a Go-based build that can run on Linux or in Docker. These capabilities were not independently verified in the supplied material.

    掘金 · 人工智能 · 🔥 0
  24. Apple reportedly tests Harbor for local AI inference on Macs

    9to5Mac, citing leaker Aaron Perris, reported that Apple is developing a Mac app called Harbor to run open-weight models locally and potentially serve private AI inference. Product materials described in the reports say Harbor can manage models and cluster multiple Thunderbolt 5 Macs by pooling unified memory, although these capabilities have not been independently tested. IT之家 and other outlets reported that Claris is testing the app in an early-access program and that its App Store listing was briefly removed, leaving public availability unsettled.

    9to5Mac · 🔥 0
  25. WinStatusBar launches unified AI bar for Windows

    Developer smendesjunior announced WinStatusBar, a native Windows bar designed to provide access to Claude Code, Codex, Gemini, Microsoft Copilot, Lenovo Qira, local Ollama models, and custom API keys from one interface. The developer says it can attach the active window as context, switch models without losing the conversation thread, and perform computer tasks in Edit mode. It also displays quota information and hardware monitoring panels, runs locally, and offers installation through winget or GitHub Releases.

    r/OpenAI · 🔥 0
  26. What PC Hardware Is Needed for Local AI Models?

    Engadget AI reports that a PC with 16GB of RAM can run relatively small local models around seven to eight billion parameters, while Ollama and LM Studio let users start a chatbot within minutes. Model size determines memory requirements, and memory bandwidth strongly affects generation speed, so a 32GB system or a graphics card with 16GB of VRAM is more practical for larger models. Local use can work offline without a subscription fee or sending data off the PC, according to the report.

    Engadget AI · 🔥 0
  27. Reddit user pairs Claude with Ollama for local batch processing

    A Reddit user asked Claude to generate a local Python workflow for ingesting tabletop-game PDF record sheets, with progress reporting, interruption recovery, tests, and optional local AI. The user said the Ollama-backed script processed about 4,200 sheets in roughly an hour, while another 10–11 agent runs were still expected for classification, checking, and integration. These are anecdotal results rather than independently measured benchmarks.

    r/ClaudeAI · 🔥 0
  28. Troubleshoot Dify’s LAN connection to Ollama on Windows

    A Juejin author reports troubleshooting Dify 1.17.1 and Ollama 0.40.15 across two Windows machines, finding that Docker’s default docker0 subnet collided with the LAN address range and prevented containers from reaching Ollama. The author also found that the Dify Ollama plugin did not send a reasoning-control parameter, leaving Qwen3.5 4B in its default thinking mode and producing slow, short responses. The guide provides Docker network configuration changes, verification commands, and a forwarding proxy that injects think:false or reasoning_effort:none.

    掘金 · 人工智能 · 🔥 0
  29. Intel Arc Pro B70 32GB delivers Qwen inference at lower cost

    A Reddit user reports that a $1,299 Intel Arc Pro B70 32GB achieved about 960 prompt-processing tokens per second and 52 generation tokens per second with Qwen3.8-27B Q6 after tuning Mesa, the llama.cpp SYCL backend, and KV-cache settings. The author says the result was roughly half the RTX 5090's speed at about one-fifth the reported $6,500-plus street price, but says the RTX 5090 figures came from other users' posts rather than direct testing. Setup changes reportedly improved performance substantially, while long-context first-token latency remained a weakness.

    r/LocalLLaMA · 🔥 0
  30. Building a Minimal Tool-Calling Agent with Local Qwen

    A Juejin author documents building an MCP server on macOS and connecting it to a local Qwen2.5 3B model through Ollama. The implementation exposes read_file, search_in_file, and get_weather tools, then uses a client-side ReAct loop to let the model request tools and incorporate their results. The author also records setup and debugging issues involving Python 3.12, MCP SDK 1.30.0, stdio transport, and MCP Inspector.

    掘金 · 人工智能 · 🔥 0

Next →

Experience and discussion from the community

Share my Ollama experienceAsk about Ollama

Dodaios: A voice-driven assistant that directs your models, coding agents and computer.

What problem it solves Dodaios provides a locally installed, open-source way to make a personal AI assistant the control center for work on your computer. Its lead assistant coordinates models, coding agents, and computer use, while chats, memory, documents, and settings remain files on the computer that runs Dodaios. Key features Voice, chat, and phone interaction — The lead assistant supports wa…

github.comhttps://github.com/Dodaios/Dodaios

go-stock: A desktop stock analysis tool that combines market data with large language models.

What problem it solves Stock analysis often requires users to gather market quotes, news, technical indicators, financial information, and AI-assisted interpretation across multiple sources. The project addresses this by bringing supported-market data, analysis tools, AI agents, alerts, and review workflows into a locally focused desktop application. Key features Multi-market market data — The app…

github.comhttps://github.com/ArvinLovegood/go-stock

worldmonitor: A real-time global intelligence dashboard for news aggregation, geopolitical monitoring, and infrastructure tracking.

What problem it solves Monitoring global news, geopolitical activity, markets, conflicts, infrastructure, and other live signals requires bringing information from many domains into one view. The project addresses this with a unified situational awareness interface that combines curated feeds, maps, correlation, analytics, and programmatic access. Key features Curated global intelligence — Curated…

github.comhttps://github.com/koala73/worldmonitor

jarvis: A private, local-first AI assistant with voice and text chat.

What problem it solves People often want an assistant that can participate in ongoing conversations, remember personal context, and use tools without requiring a cloud AI service. Jarvis addresses this with local-first voice and text interaction, personal memory, optional connected tools, and a setup process for locally controlled models. Key features Conversation-aware voice assistance — Jarvis m…

github.comhttps://github.com/isair/jarvis

cherry-studio: An AI workstation for Windows, macOS, and Linux.

What problem it solves Users need a unified place to work with different AI models, agents, documents, knowledge, and productivity tools. Without such a workspace, these activities require coordinating separate applications and provider-specific workflows. Key features Agents and automation — Create agents with instructions, workspaces, models, and tool permissions. Agents can handle files, comman…

github.comhttps://github.com/CherryHQ/cherry-studio

openworker: A desktop app and harness SDK for building and running AI coworkers that work across everyday tools.

What problem it solves People need a way to delegate research, writing, code review, recurring tasks and work across connected tools to AI agents without giving up control over actions and data. They also need a foundation for embedding agent loops, tool calls, approvals, streaming and durable sessions into their own applications. Key features Everyday AI coworker — The desktop app supports resear…

github.comhttps://github.com/andrewyng/openworker

opencodex: A lightweight local gateway for using chosen models with AI coding tools.

What problem it solves AI coding tools often expect particular provider protocols, making it difficult to use the models and providers a user prefers. A local gateway can translate between supported client APIs and provider APIs while preserving capabilities such as streaming, tool calls, reasoning, and images. Key features Provider protocol translation — The gateway translates Responses, Chat Com…

github.comhttps://github.com/lidge-jun/opencodex

G0DM0D3: A fully open-source, privacy-transparent, multi-model chat interface for red teaming, cognition research, and liberated AI interaction.

What problem it solves Researchers, red-teamers, and system tinkerers need a chat interface that can work with multiple hosted and local models while exposing evaluation, perturbation, and sampling controls. They also need clear visibility into data flows, storage, telemetry, and deployment boundaries so they can make informed choices about privacy and self-hosting. Key features Multi-model races …

github.comhttps://github.com/elder-plinius/G0DM0D3

zeroclaw: An agent runtime delivered as a single Rust binary you configure and run.

What problem it solves Personal AI agents need to connect language model providers, communication channels, and tools while remaining under the user's control. They also need configurable autonomy, security boundaries, and operational features such as background services, approvals, and persistent workflows. Key features Multiple channels and providers — The agent can receive messages through conf…

github.comhttps://github.com/zeroclaw-labs/zeroclaw

kagent: A Kubernetes native framework for building AI agents.

What problem it solves Building, deploying, and managing AI agents requires integrating agent behavior, runtime configuration, tools, models, sessions, and observability. The project addresses this with a declarative Kubernetes-based framework that supports multiple runtimes, model providers, and MCP tools. Key features Declarative Agent Management — Agents are Kubernetes custom resources that com…

github.comhttps://github.com/kagent-dev/kagent

TradingAgents: A multi-agent trading framework that mirrors the dynamics of real-world trading firms.

What problem it solves Complex trading decisions require evaluation across financial fundamentals, market sentiment, news, technical indicators, portfolio holdings, and risk. TradingAgents addresses this by decomposing trading tasks into specialized LLM-powered roles that discuss findings and assess proposed transactions. Key features Parallel analyst research — Fundamental, sentiment, news, and t…

github.comhttps://github.com/TauricResearch/TradingAgents

ollama: Start building with open models.

What problem it solves Developers need a straightforward way to run and manage open models while preserving control over where model interactions occur. The project provides local and cloud access, command-line workflows, a REST API, and client libraries for integrating models into existing applications. Key features Run models from the command line — Start the model experience directly from the C…

github.comhttps://github.com/ollama/ollama

project-nomad: An offline-first knowledge and education server for self-hosted learning and local AI.

What problem it solves People need access to information, learning resources, and optional AI tools without depending on an internet connection. NOMAD provides a self-contained server that manages offline content, education resources, maps, notes, data tools, and local AI on hardware the user owns. Key features Local AI with knowledge search — The AI Assistant supports local chat through Ollama or…

github.comhttps://github.com/Crosstalk-Solutions/project-nomad

T3MP3ST: A multi-agent offensive-security framework, built to turn the AI coding agent you already run into a zero-day hunter.

What problem it solves Coordinated bug hunting is often gated by years of security practice, expensive tooling, and access to specialized workflows. The framework aims to make authorized reconnaissance, exploitation, and reporting more accessible while retaining explicit scope controls and reproducible evidence. Key features Agent-led security workflow — Operators follow a reconnaissance-to-exploi…

github.comhttps://github.com/elder-plinius/T3MP3ST

dbx: 100+ databases in 25 MB, available as a desktop app, Docker deployment, CLI, AI-assisted editor, and MCP Server.

What problem it solves Managing databases across many engines can require separate tools, while many database clients also depend on additional runtimes or bundled browser components. Teams and developers also need a consistent way to work with database connections across desktop, browser, self-hosted, CLI, and AI-agent environments. Key features Broad database coverage — Use one tool for more tha…

github.comhttps://github.com/t8y2/dbx