Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Ollama

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 99

  1. Ollama v0.40.16 adds Ripple Preview to its MLX runner

    Ollama v0.40.16 added Ripple Preview support to its MLX runner, allowing users to launch Ricursive Intelligence's 65B dense model for agentic coding with `ollama run ripple-preview`. The release also reports that Qwen3.8 Flash Next uses about 27 GiB less memory on Apple silicon, though no independent measurement was supplied. Other changes fix Claude Code routing, clarify retired cloud-model errors, forward truncation options for the OpenAI Responses API, and return an empty array from `/v1/models` when no models are installed.

    Ollama Releases · 🔥 0
  2. BOS Token Altered 6 of 15 Bielik-Minitron Responses

    A community experiment using Bielik-Minitron 7B v3.0 Instruct found that adding one beginning-of-sequence token changed 6 of 15 responses under Ollama 0.40.14. Across 135 trials, the model passed 11 of 15 tasks without BOS and 12 of 15 with BOS, but the author said the narrow test does not show that BOS generally improves quality. The author also said it remains unclear whether Ollama’s omission of the token from this model’s chat template should be considered a bug.

    r/LocalLLaMA · 🔥 0
  3. OpenAutark launches open-source local multi-agent desktop platform

    OpenAutark is an open-source desktop platform designed to run locally, with a manager agent assigning work to specialized subagents. The report says it can coordinate Anthropic, OpenAI, and local open-source models, including models driven by llama.cpp, Ollama, or vLLM. It is based on the Apache 2.0 license and supports Windows, macOS, Linux, and Android. Its pluggable extensions can connect local models to external APIs, file systems, databases, and desktop automation. Developer Stanislaus Hees said the project remains at an early stage, with the number of agents that can run concurrently limited by the device’s available memory.

    cnBeta · 🔥 0
  4. Terrarium launches beta VMs for permission-controlled AI agents

    Terrarium is a beta tool that runs AI agents in persistent Linux virtual machines on a user's machine. Its YAML recipes define which host folders and network destinations each VM may access, while the creator says all other access is blocked for the agent and any processes it launches. The project includes an example connecting a project directory to a local Ollama service and supports Linux, macOS, and Windows.

    r/LocalLLaMA · 🔥 0
  5. changedetection.io project describes AI-powered change summaries and plain-language alert rules

    The open-source project changedetection.io describes itself as a tool for website change detection and monitoring, with notifications via Discord, email, Slack, Telegram and webhooks, and conditional triggers such as firing only when a price crosses a set threshold or a keyword appears. Its description adds AI-powered features: plain-language rules that evaluate each detected diff against a written intent (for example, "notify me only when the price drops below $50"), and AI change summaries that replace a raw diff with a sentence such as "Price dropped from $89.99 to $67.00". Users can bring their own key for models from OpenAI, Gemini, Anthropic and others via LiteLLM, or run models locally with Ollama, vLLM, LM Studio or any OpenAI-compatible endpoint. MCP support is also offered so page changes can be exposed as a resource for questions. The project is self-hostable via Docker or pip, and a paid SaaS subscription is listed at $8.99 per month. The report does not identify a specific release or date for these AI features, and the claims about fewer false positives and per-check cost come from the project itself.

    GitHub Trending · Python · 🔥 0
  6. GUI-Automated WeChat Group-Chat AI: Five Operational Failures

    A developer describes building a WeChat group-chat AI through GUI automation because the official bot channels they examined were not suitable for ordinary WeChat groups. The system controls a logged-in desktop account through screen interaction, uses Ollama for local visual processing and faster-whisper for speech transcription, and sends replies through the clipboard. The author reports five operational failures: duplicate sending caused by two instances, replies to stale messages, queued replies, queued replies being discarded, and the agent treating an unsent reply as already said. The first four received fixes involving a single-instance lock, a stale-message gate, queue prioritization, and replacing the oldest queued reply; the author says the fifth issue was located but not yet solved. The report also describes seven design choices, including delayed responses and deliberate silence. The author reports 229 group chats, nine private chats, 51 deliberate silences, and 445 passing tests on their own machine; these figures and the incidents were not independently verified.

    掘金 · 人工智能 · 🔥 0
  7. Nace AI details Drex training and updates Drex Max v1.1

    Nace AI published a technical report covering the architecture, training, evaluation, calibration and local inference of four open-weight Drex decision models. The models use full-parameter supervised fine-tuning on 1.15 million verified decision records, followed by consistency training and reinforcement learning from adjusted feedback; Nace AI also released Drex Max v1.1. Nace AI claimed that Max v1.1 reached the state of the art and Pareto frontier for decision models, while Artificial Analysis reportedly ranked it first, but these performance claims remain vendor-attributed and the v1.1 weights were described as still forthcoming.

    r/LocalLLaMA · 🔥 0
  8. Deploying Qwen3.5 4B on a Legacy RX 580 Server

    A report from 掘金 · 人工智能 documents running Qwen3.5 4B with Ollama 0.40.14 on Windows 10 using an Intel Xeon E5-2670 v2, 32 GB of memory, and an 8 GB AMD RX 580. The author exposes the model to WorkBuddy and Dify through an OpenAI-compatible API, with the Xeon serving as fallback compute at a reported prefill speed of about 54–74 tokens per second. Because the Vulkan flash-attention path produced zero-filled output on longer prompts, the deployment disables flash attention and accepts slower generation for more predictable results.

    掘金 · 人工智能 · 🔥 0
  9. What Private AI Chat Modes Can—and Cannot—Hide

    A Reddit discussion compares ChatGPT Temporary Chat and Claude incognito chats, which the post says exclude conversations from history, memory and training but may still be retained by the providers for safety. It presents local models through Ollama or LM Studio as the most private option, while noting hardware requirements and the absence of public ChatGPT or Claude models. The post also promotes Dreamfort AI’s approach of encrypting prompts on-device and separating user identity from prompts before model processing.

    r/OpenAI · 🔥 0
  10. NVIDIA Releases Free Open AI Models and Enterprise Tools

    TechNews reported that NVIDIA announced a set of free open AI models and tools on November 5 for scientific research, engineering analysis and enterprise applications. Nemotron 3.5 Super VL is designed to analyze screenshots, PDFs and charts, and the report says it offers faster performance than its predecessor. It is available for free through OpenCode, OpenRouter, Hugging Face, Ollama and LM Studio. NVIDIA also expanded its open-source Agent Toolkit with Knowledge Foundation, which allows enterprise AI agents to use internal data for reasoning without moving company data and while retaining control over access and actions. The Kumo model family covers tabular, relational, time-series and predictive workloads.

    科技新报 · 🔥 0
  11. Ollama v0.40.15 adds Kimi Code CLI support to cmd/launch

    Ollama tagged commit 02480ca as v0.40.15. GitHub states that the commit was created on GitHub.com and signed with GitHub's verified signature. The tag page shows a single listed change: “cmd/launch: add Kimi Code CLI support” in pull request #19506. It also lists two assets.

    Ollama Releases · 🔥 0
  12. Claude Built Memesis, an AI-Agent Language With Meme Keywords

    A developer says they built the experimental, open-source Memesis language with Claude Code, including its lexer, parser, interpreter, CLI and a trust mechanism for untrusted data. Memesis assigns meme-based keywords to agent, model, human-escalation and irreversible-action concepts, and supports Claude and local models through Ollama.

    r/ClaudeAI · 🔥 0
  13. Community author tests small local LLMs on Polish, JSON and Python

    A Reddit author created “Zacharski tests,” an open-source 15-task suite for evaluating small local models through Ollama on a laptop with 8 GB of VRAM. It covers eight Polish tasks, four JSON tasks and three Python syntax checks, with one answer per task, temperature 0, a 2k context and thinking disabled. The initial gemma2:9b Q4_0 result was 7/7 on JSON and code tasks but 3/8 on Polish tasks.

    r/LocalLLaMA · 🔥 0
  14. Apple’s First Touchscreen MacBook Pro Pairs PROLED With Local AI

    爱范儿 reports that Apple introduced a touchscreen MacBook Pro with a PROLED XDR display, starting at 22,999 yuan. The new 14-inch and 16-inch models are lighter, feature an illuminated Apple logo, and retain keyboard and trackpad as the primary controls. In a hands-on test of a high-end 16-inch M5 Max configuration, 爱范儿 reported that Qwen 3.5 35B-A3B generated at 119–121 tokens per second under Ollama and MLX.

    爱范儿 · 🔥 0
  15. A Practical Guide to Managing Data Before Using AI

    少数派 AI argues that users should understand where their data goes and how they can export or retain it before focusing on advanced prompt techniques. Drawing on a Notion sync-loss incident and platform privacy policies, it recommends disabling training where possible, using temporary chats for sensitive material, maintaining local copies, and avoiding plaintext credentials in AI contexts.

    少数派 AI · 🔥 0
  16. A Beginner’s Guide to Spring AI Application Development

    A Juejin article presents a beginner-oriented introduction to AI application development for backend developers familiar with Spring Boot. It explains architecture, RAG, Tool Calling, MCP, Spring AI Advisors, memory, vector retrieval and Agent/ReAct concepts, alongside runnable code and five implementation pitfalls. The article also compares Alibaba Cloud Bailian and DashScope and discusses how models can be accessed through cloud services, self-hosted deployments, platforms, clients and code.

    掘金 · 人工智能 · 🔥 0
  17. Vercel Labs open-sources fx, a Zig coding agent built for scripting and embedding

    Vercel Labs has open-sourced fx, an experimental coding agent and CLI written in Zig that is designed to run as a scripted or embedded tool rather than as a full-screen terminal app, writing conversations into ordinary scrollback history. The same engine is exposed through a CLI and a library, with structured output for automation, Agent Client Protocol connectivity via fx acp, and libfx exposing the engine to JavaScript including a WebAssembly build. Vercel says fx ships as a 6.3 MiB native binary with single-digit MB memory and 10-microsecond cold start, but those figures are vendor-supplied rather than independently benchmarked, and early Hacker News feedback disputed its model-independent claim, with some first-time users reporting inference appeared to run through Vercel AI Gateway.

    InfoQ 中文 AI&大模型 · 🔥 0
  18. Local LLM inference tools multiply as users weigh speed against quality

    A Reddit user says the local LLM inference ecosystem has expanded rapidly since March 2025, from established tools such as llama.cpp, Ollama, vLLM and TabbyAPI to numerous newer projects. The author reports that llama.cpp continues to improve quickly, while newer engines may prioritize speed or lower resource use at the expense of output quality; their specific model and hardware claims are not independently verified here.

    r/LocalLLaMA · 🔥 0
  19. Open Typora 0.22.0 adds AI-assisted Markdown workflows

    Open Typora developer anichikage announced version 0.22.0 with AI-assisted selection rewriting, reviewable cross-document changes, local retrieval and directory question-answering. The independent open-source Markdown editor also preserves recovery points, protects selected content by default, and supports configurable OpenAI-compatible, OpenRouter, LM Studio, and Ollama model services. The announcement notes that AI features require the desktop app and that compatibility is still being refined.

    V2EX · OpenAI 节点 · 🔥 0
  20. Olla v0.1.0 adds TEI support and reliability improvements

    The Olla project released v0.1.0, its 25th release. The update adds Hugging Face Text Embeddings Inference support for embeddings, reranking and classification; configurable retry and failover behavior; a reworked dashboard; improved model-capability detection; and fixes for concurrency, request statistics, rate limiting, routing, backend discovery and configuration validation. Olla is a Go-based open-source proxy and load balancer that sits between applications and local inference servers. It supports multiple runtimes, including Ollama, vLLM, SGLang, llama.cpp and LM Studio, and provides OpenAI- and Anthropic-compatible interfaces with translation where required.

    r/LocalLLaMA · 🔥 0
  21. Ollama v0.40.14 updates Claude Code limits and API behavior

    According to Ollama's release notes, v0.40.14 makes Claude Code launches apply each model's output-token limit and adds a ChatGPT routing check to Codex configuration. The release also fixes decoding for cloud web-search responses on /api/chat, preserves readable input on the Responses endpoint, retains packaged sampler defaults on OpenAI-compatible endpoints, and allows the Ollama app to retry ChatGPT disconnects. Ollama also reports faster top-k sampling on MLX for large vocabularies.

    Ollama Releases · 🔥 0
  22. Build a Local AI Assistant with Ollama and Open WebUI

    A Juejin tutorial demonstrates running a local AI assistant with Ollama, Open WebUI, and Qwen2.5-7B on Ubuntu 22.04. It covers command-line interaction, Python API calls, browser-based chat, document-upload retrieval, quantization, GPU selection, and concurrency settings. The article presents local deployment as a way to keep conversations and files on the local machine, but its privacy, cost, and performance claims are not independently verified here.

    掘金 · 人工智能 · 🔥 0
  23. DeepTutor connects tutoring, research, quizzes, and shared memory

    A Juejin AI article describes DeepTutor as an open-source, agent-native tutoring workspace that links Chat, Quiz, Research, and Visualize through one runtime. It reports that the system shares session context and memory across workflows, supports several RAG engines, and uses a file-backed three-layer memory system for inspectable traces, summaries, and synthesis. The article also identifies Next.js and FastAPI as its frontend and backend technologies and says Codex and Claude Code can operate as subagents.

    掘金 · 人工智能 · 🔥 0
  24. GitHub Repository AI Engineering Hub Offers Learning and Build Resources

    The patchy631/ai-engineering-hub GitHub repository is presented as a learning and build-oriented resource for AI engineering. Its listing describes tutorials on LLMs, RAGs, and AI agent applications, with projects organized by beginner, intermediate, and advanced difficulty. The listing also claims 93+ production-ready projects, but the report does not independently verify that count or the production-readiness claim.

    GitHub Trending(每日) · 🔥 0
  25. AiSOC: an open-source, self-hostable AI security operations center

    The AiSOC project README describes an MIT-licensed, self-hostable security operations platform that normalizes telemetry, runs the 2538 executable rules of its 7023-rule library, groups hits into incidents, investigates them with AI agents whose prompts and tool calls are recorded, and proposes actions for human approval. Its smallest "core" deployment runs with no API keys and ships a local Ollama-served llama3.2:3b model plus the CISA KEV threat feed, while an MCP server supports Claude, Cursor and Continue. The README states AiSOC is not a drop-in SIEM replacement, cannot see telemetry that has not been connected, and is not autonomous by default; it also notes that demo incidents are synthetic and published benchmark numbers are substrate self-consistency measures rather than live agent accuracy. Deployment requires Docker Compose v2 with about 8 GB of memory and 20 GB of free disk in the Docker VM. The project says development is funded and supported by Cyble, which releases it under the MIT licence with no gated modules or telemetry.

    GitHub Trending(每日) · 🔥 0
  26. A hands-on tour of popular AI open-source tools

    This Juejin tutorial organizes AI open-source tools around three common needs: local model chat, agent orchestration, and multimodal understanding. It demonstrates Ollama with Qwen3 4B, including installation, model download, local chat, and API access, before showing a vLLM server for Qwen2-VL-2B-Instruct. The article also recommends consulting each project’s official GitHub repository and README, and suggests lightweight models when VRAM is limited.

    掘金 · 人工智能 · 🔥 0
  27. Nace.AI Open-Sources Drex-Max v1 Multimodal Decision Model

    Nace.AI released the open-weight Drex-Max v1, a dense 27B multimodal model that scores fixed candidate answers instead of generating text or JSON. The model accepts text, JSON and high-resolution images, supports local deployment on NVIDIA GPUs and Apple Silicon M4 or M5 systems, and can use context lengths up to 262,144 tokens. Nace.AI reported roughly 400-millisecond latency, but the supplied reports contain no independent reproduction of its benchmark results.

    r/LocalLLaMA · 🔥 0
  28. Reddit poster questions llama.cpp amid a wave of bespoke inference engines

    A Reddit poster on r/LocalLLaMA argues that llama.cpp has fallen behind newer local-inference projects such as Strata, while acknowledging that the criticism may be overstated and that they still use it for 27B model runs. The poster also describes a crowded ecosystem of forked engines and says they plan to test Avalon after their current GPU benchmarks finish.

    r/LocalLLaMA · 🔥 0
  29. Two macOS pitfalls in local AI deployment

    A Juejin AI article describes two local deployment failures encountered by the author: Hugging Face’s HF_HOME pointed to an incomplete 163 MB external-drive cache instead of a complete 2.9 GB cache, causing faster-whisper-large-v3 to report an inability to open model.bin. It also reports a macOS per-process file-descriptor soft limit of 256, which caused “Too many open files” errors in an Ollama, Open WebUI, and ChromaDB stack, and recommends raising the limit through launchd configuration and ulimit.

    掘金 · 人工智能 · 🔥 0
  30. TextFold adds PDF and Word support with layered AI reading

    TextFold developer updated the local reading tool to handle PDF and Word documents while keeping source passages accessible. The Apache 2.0 app offers five prepared reading levels: Full and Brief use original text, while Key, Takeaway and Topic use AI-written text that can be expanded back to the original. Users can choose OpenAI models with their own API key, another hosted provider, or a local Ollama model.

    r/OpenAI · 🔥 0

← PreviousNext →

Experience and discussion from the community

Share my Ollama experienceAsk about Ollama

Dodaios: A voice-driven assistant that directs your models, coding agents and computer.

What problem it solves Dodaios provides a locally installed, open-source way to make a personal AI assistant the control center for work on your computer. Its lead assistant coordinates models, coding agents, and computer use, while chats, memory, documents, and settings remain files on the computer that runs Dodaios. Key features Voice, chat, and phone interaction — The lead assistant supports wa…

github.comhttps://github.com/Dodaios/Dodaios

go-stock: A desktop stock analysis tool that combines market data with large language models.

What problem it solves Stock analysis often requires users to gather market quotes, news, technical indicators, financial information, and AI-assisted interpretation across multiple sources. The project addresses this by bringing supported-market data, analysis tools, AI agents, alerts, and review workflows into a locally focused desktop application. Key features Multi-market market data — The app…

github.comhttps://github.com/ArvinLovegood/go-stock

worldmonitor: A real-time global intelligence dashboard for news aggregation, geopolitical monitoring, and infrastructure tracking.

What problem it solves Monitoring global news, geopolitical activity, markets, conflicts, infrastructure, and other live signals requires bringing information from many domains into one view. The project addresses this with a unified situational awareness interface that combines curated feeds, maps, correlation, analytics, and programmatic access. Key features Curated global intelligence — Curated…

github.comhttps://github.com/koala73/worldmonitor

jarvis: A private, local-first AI assistant with voice and text chat.

What problem it solves People often want an assistant that can participate in ongoing conversations, remember personal context, and use tools without requiring a cloud AI service. Jarvis addresses this with local-first voice and text interaction, personal memory, optional connected tools, and a setup process for locally controlled models. Key features Conversation-aware voice assistance — Jarvis m…

github.comhttps://github.com/isair/jarvis

cherry-studio: An AI workstation for Windows, macOS, and Linux.

What problem it solves Users need a unified place to work with different AI models, agents, documents, knowledge, and productivity tools. Without such a workspace, these activities require coordinating separate applications and provider-specific workflows. Key features Agents and automation — Create agents with instructions, workspaces, models, and tool permissions. Agents can handle files, comman…

github.comhttps://github.com/CherryHQ/cherry-studio

openworker: A desktop app and harness SDK for building and running AI coworkers that work across everyday tools.

What problem it solves People need a way to delegate research, writing, code review, recurring tasks and work across connected tools to AI agents without giving up control over actions and data. They also need a foundation for embedding agent loops, tool calls, approvals, streaming and durable sessions into their own applications. Key features Everyday AI coworker — The desktop app supports resear…

github.comhttps://github.com/andrewyng/openworker

opencodex: A lightweight local gateway for using chosen models with AI coding tools.

What problem it solves AI coding tools often expect particular provider protocols, making it difficult to use the models and providers a user prefers. A local gateway can translate between supported client APIs and provider APIs while preserving capabilities such as streaming, tool calls, reasoning, and images. Key features Provider protocol translation — The gateway translates Responses, Chat Com…

github.comhttps://github.com/lidge-jun/opencodex

G0DM0D3: A fully open-source, privacy-transparent, multi-model chat interface for red teaming, cognition research, and liberated AI interaction.

What problem it solves Researchers, red-teamers, and system tinkerers need a chat interface that can work with multiple hosted and local models while exposing evaluation, perturbation, and sampling controls. They also need clear visibility into data flows, storage, telemetry, and deployment boundaries so they can make informed choices about privacy and self-hosting. Key features Multi-model races …

github.comhttps://github.com/elder-plinius/G0DM0D3

zeroclaw: An agent runtime delivered as a single Rust binary you configure and run.

What problem it solves Personal AI agents need to connect language model providers, communication channels, and tools while remaining under the user's control. They also need configurable autonomy, security boundaries, and operational features such as background services, approvals, and persistent workflows. Key features Multiple channels and providers — The agent can receive messages through conf…

github.comhttps://github.com/zeroclaw-labs/zeroclaw

kagent: A Kubernetes native framework for building AI agents.

What problem it solves Building, deploying, and managing AI agents requires integrating agent behavior, runtime configuration, tools, models, sessions, and observability. The project addresses this with a declarative Kubernetes-based framework that supports multiple runtimes, model providers, and MCP tools. Key features Declarative Agent Management — Agents are Kubernetes custom resources that com…

github.comhttps://github.com/kagent-dev/kagent

TradingAgents: A multi-agent trading framework that mirrors the dynamics of real-world trading firms.

What problem it solves Complex trading decisions require evaluation across financial fundamentals, market sentiment, news, technical indicators, portfolio holdings, and risk. TradingAgents addresses this by decomposing trading tasks into specialized LLM-powered roles that discuss findings and assess proposed transactions. Key features Parallel analyst research — Fundamental, sentiment, news, and t…

github.comhttps://github.com/TauricResearch/TradingAgents

ollama: Start building with open models.

What problem it solves Developers need a straightforward way to run and manage open models while preserving control over where model interactions occur. The project provides local and cloud access, command-line workflows, a REST API, and client libraries for integrating models into existing applications. Key features Run models from the command line — Start the model experience directly from the C…

github.comhttps://github.com/ollama/ollama

project-nomad: An offline-first knowledge and education server for self-hosted learning and local AI.

What problem it solves People need access to information, learning resources, and optional AI tools without depending on an internet connection. NOMAD provides a self-contained server that manages offline content, education resources, maps, notes, data tools, and local AI on hardware the user owns. Key features Local AI with knowledge search — The AI Assistant supports local chat through Ollama or…

github.comhttps://github.com/Crosstalk-Solutions/project-nomad

T3MP3ST: A multi-agent offensive-security framework, built to turn the AI coding agent you already run into a zero-day hunter.

What problem it solves Coordinated bug hunting is often gated by years of security practice, expensive tooling, and access to specialized workflows. The framework aims to make authorized reconnaissance, exploitation, and reporting more accessible while retaining explicit scope controls and reproducible evidence. Key features Agent-led security workflow — Operators follow a reconnaissance-to-exploi…

github.comhttps://github.com/elder-plinius/T3MP3ST

dbx: 100+ databases in 25 MB, available as a desktop app, Docker deployment, CLI, AI-assisted editor, and MCP Server.

What problem it solves Managing databases across many engines can require separate tools, while many database clients also depend on additional runtimes or bundled browser components. Teams and developers also need a consistent way to work with database connections across desktop, browser, self-hosted, CLI, and AI-agent environments. Key features Broad database coverage — Use one tool for more tha…

github.comhttps://github.com/t8y2/dbx