Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

LLM

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 8

  1. llm 0.37.2 fixes accidental OpenAI API key disclosure

    Simon Willison released llm 0.37.2, a command-line tool for accessing large language models. The update fixes issues tracked as GHSA-v9h7-jj4g-f862 and GHSA-r639-rr7r-x72w, which could cause a configured OpenAI API key to be sent to another provider when the named key was not stored or when a responses-enabled model was run with the chat-completions option. It also manages extra-openai-models.yaml through the new `llm openai endpoint add` command introduced in 0.37.

    Simon Willison's Weblog · 🔥 0
  2. Simon Willison releases llm 0.37

    Simon Willison announced llm 0.37, a new version of his command-line tool and Python library for accessing large language models. The release adds gpt-6.1-sol and gpt-6.1-terra, introduces an `llm openai endpoint add` command for configuring additional models that use OpenAI-compatible endpoints, changes the default model to gpt-6-luna, and expands embedding support to handle binary content with different content types. Willison said the release represents around two months of accumulated features and fixes.

    Simon Willison's Weblog · 🔥 0
  3. LLM Workflows Struggle to Preserve Human Intent

    TechRadar examines semantic erosion, in which repeated processing, summarization, and handoffs among language models gradually strip cultural and situational meaning from otherwise coherent outputs. It discusses architectural controls, drift detection, entropy penalties, human-in-the-loop labeling, feedback such as RLHF, and other ways developers can limit the problem.

    TechRadar · 🔥 0
  4. Free series surveys scoring methods for Intelligent Document Processing

    A free, two-part Medium series surveys current practices for evaluating Intelligent Document Processing (IDP), with a focus on Key Information Extraction from structured documents, especially forms. According to the author, it covers raw extraction outcomes, confusion-matrix scoring for text fields and checkboxes, treatment of blanks and unreadable values, F1, recall, accuracy, IoU, precision, specificity, calibration, OCR metrics, and the distinction between confidence and correctness. The first part is titled “Confidence Is Not Correctness,” while the second covers approaches to evaluating form extraction.

    r/MachineLearning · 🔥 0
  5. Survey: over half of managers find AI makes evaluating employee work harder

    A Nielsen survey of 1,700 directors and senior managers across seven countries, commissioned by Monday.com and reported by TechCrunch, found that more than half of senior leaders find it harder to evaluate employees' work after adopting AI, because polished output arriving in their inboxes makes it unclear how much came from the employee versus the tool. Nearly half of managers said they spend more time reviewing and guiding their teams' output than before, and 78% said they have changed how they assess staff, weighting prompt-writing, task delegation to AI and experimentation more heavily. The survey also reports that 94% of managers said they were excited to improve work using AI, while 46% use AI to help inform their decisions, 39% use it to draft performance reviews, and 58% expect to oversee more AI agents than human employees within the next year.

    TechCrunch AI · 🔥 0
  6. Google Docs Adds Native Markdown Editing and Collaboration

    Google Docs and Google Drive now support native previewing, editing, and collaboration on Markdown files without converting them to another format. Google Docs offers real-time co-editing, comments, suggested changes, and version history, while Drive provides rendered previews with formatted tables and clickable links. Google says the feature is available to personal Google and Workspace accounts, with availability potentially taking up to 15 days from October 5.

    TechRepublic · 🔥 0
  7. llm-openai-decisions 0.1a0 plugin wraps OpenAI's Jev-style Decisions API

    Simon Willison released llm-openai-decisions 0.1a0, an LLM plugin for OpenAI's new Decisions API announced at last week's DevDay; he had GPT-6 Astra read the new API docs and modeled the plugin on his existing llm-typesafe plugin for Jev. The new decision model, gpt-6-luna, accepts image input as well as text. According to the post, both models charge for input only and not output — OpenAI at 10 cents per million input tokens versus Jev's 4.2 cents — and both support yes/no, choice and score question types.

    Simon Willison's Weblog · 🔥 0
  8. llm-mistral 0.16 adds support for reasoning models

    Simon Willison released llm-mistral 0.16, which adds support for reasoning models to the LLM command-line tool. The post cites the newly released Mistral Large 4 as an example. No further details about the update or the model are given in the source.

    Simon Willison's Weblog · 🔥 0

Experience and discussion from the community

Share my LLM experienceAsk about LLM

qmd: An on-device search engine for everything you need to remember.

What problem it solves Local notes, documentation, knowledge bases, and meeting transcripts need to remain searchable without sending their contents to a remote service. QMD addresses this by combining keyword retrieval, semantic search, and local LLM reranking for documents indexed on the user's device. Key features Hybrid local search — Queries can use BM25 full-text search, vector semantic sear…

github.comhttps://github.com/tobi/qmd

agentscope: A production-ready, easy-to-use agent framework for building and running agents you can see, understand, and trust.

What problem it solves Developers need abstractions that can accommodate increasingly agentic LLMs without limiting their reasoning and tool-use abilities through rigid prompts or opinionated orchestration. They also need a way to turn agent components into multi-tenant, multi-session applications with supporting infrastructure. Key features Composable agent building blocks — Compose agents from a…

github.comhttps://github.com/agentscope-ai/agentscope

posthog: A product context layer for analytics, observability, experimentation, and agent-driven workflows.

What problem it solves Product teams need to connect analytics, errors, replays, logs, and business data so they can diagnose problems, identify opportunities, and act on what they learn. This context must also be available to developers and agents across interfaces such as Slack, web, desktop, and MCP. Key features Unified product context — Collect and query analytics, errors, replays, logs, trac…

github.comhttps://github.com/PostHog/posthog

torchtitan: A PyTorch-native platform for pretraining and post-training generative AI models at scale.

What problem it solves Training generative AI models at scale requires coordinating multiple parallelism strategies while supporting pretraining, fine-tuning, and reinforcement learning in one codebase. Large-scale training also needs reproducible configurations, checkpointing, debugging tools, and observability that can be adapted for research and model development. Key features Composable model …

github.comhttps://github.com/pytorch/torchtitan

rig: A Rust library for building modular and scalable applications on large language models.

What problem it solves Building LLM applications often requires connecting model providers, vector stores, tools, streaming, and agent capabilities. Rig provides a shared Rust interface for these components and includes a terminal coding agent that can be extended with plugins. Key features Unified model and vector-store interfaces — Use a shared interface for model providers and vector stores, wi…

github.comhttps://github.com/0xPlaygrounds/rig

markitdown: A lightweight Python utility for converting various files to Markdown for use with LLMs and related text analysis pipelines.

What problem it solves Documents and office files often need to be transformed into a structured, text-friendly format before they can be processed by language models or text analysis tools. MarkItDown addresses this by preserving important document structures such as headings, lists, tables, and links during conversion to Markdown. Key features Broad format conversion — MarkItDown converts PDF, P…

github.comhttps://github.com/microsoft/markitdown

ai-agent-book: An open-source Chinese book that explains AI Agents from design principles to engineering practice through the formula Agent = LLM + context + tools.

What problem it solves Readers need a structured way to understand AI Agent design principles and apply them through engineering practice. The book addresses this by organizing the material into 10 chapters and pairing the text with 109 companion experiments covering topics such as context engineering, memory, tools, evaluation, post-training, continuous evolution, and multi-agent collaboration. K…

github.comhttps://github.com/bojieli/ai-agent-book

vllm-ascend: A community-maintained hardware plugin for running vLLM on Huawei Ascend NPUs.

What problem it solves vLLM users need a way to run the framework on Huawei Ascend NPU hardware through a supported integration path. The plugin decouples Ascend NPU integration from vLLM and enables supported model types to run on the platform. Key features Hardware-pluggable vLLM integration — The plugin provides an interface for integrating Ascend NPUs with vLLM and follows the community's hard…

github.comhttps://github.com/vllm-project/vllm-ascend

heretic: Training-free language model modification.

What problem it solves Heretic addresses the difficulty of modifying language-model behavior to remove refusals, suppress slop, reduce sycophancy, or apply other behavioral changes. It provides a training-free approach that steers models through mathematical techniques rather than expensive retraining. Key features Configurable behavior changes — The default configuration suppresses refusals, whil…

github.comhttps://github.com/p-e-w/heretic

openvino: An open-source software toolkit for optimizing and deploying deep learning models.

What problem it solves Teams deploying AI inference need to optimize models, reduce resource demands, and run them across different frameworks and hardware platforms. The toolkit addresses model conversion, compilation, and inference workflows for applications ranging from computer vision and speech recognition to generative AI and language models. Key features Inference optimization — Optimize de…

github.comhttps://github.com/openvinotoolkit/openvino

go-stock: A desktop stock analysis tool that combines market data with large language models.

What problem it solves Stock analysis often requires users to gather market quotes, news, technical indicators, financial information, and AI-assisted interpretation across multiple sources. The project addresses this by bringing supported-market data, analysis tools, AI agents, alerts, and review workflows into a locally focused desktop application. Key features Multi-market market data — The app…

github.comhttps://github.com/ArvinLovegood/go-stock

dograh: An open-source, self-hostable platform for building production voice agents with a visual workflow builder.

What problem it solves Building production voice agents often requires control over infrastructure, model providers, workflows, and deployment. Dograh addresses these needs with an open-source platform that supports self-hosting, bring-your-own-key integrations, and visual and agent-assisted development. Key features Visual voice agent workflow builder — Create workflows with start nodes, agent no…

github.comhttps://github.com/dograh-hq/dograh

Switchyard: An open-source library that helps an AI agent choose which model handles each request.

What problem it solves AI agents need to choose among models while balancing task success, cost, and latency for their workloads. Applications also need flexibility in where routing runs and who controls model clients, credentials, retries, and service operation. Key features Multiple routing algorithms — Routing can be configured with Auto, Task, Execution, or Composite strategies, including mode…

github.comhttps://github.com/NVIDIA-NeMo/Switchyard

minimind: An open-source project for training a small language model from scratch and understanding its complete training pipeline.

What problem it solves Large language models can be difficult for individuals to train, deploy, or understand because of their scale and the abstractions used by many frameworks. The project addresses this by providing native PyTorch implementations, compact model structures, open datasets, and staged workflows for pretraining, fine-tuning, preference optimization, tool use, and agentic training. …

github.comhttps://github.com/jingyaogong/minimind

ai-infra-book: An open-source book that derives LLM inference and training system design through quantitative analysis of hardware constraints and model architectures.

What problem it solves Developers often need to understand why model applications are slow or costly, but system decisions require reasoning across model architecture, hardware limits, memory, computation, communication, and scheduling. Easy-to-miss factors such as KV cache, bandwidth limits, and inter-device communication can shift estimates by orders of magnitude, so system design should begin f…

github.comhttps://github.com/bojieli/ai-infra-book

vllm: A fast and easy-to-use library for LLM inference and serving.

What problem it solves Serving large language models requires efficient memory management, flexible model execution, and practical integration with existing models and APIs. vLLM addresses these needs with inference and serving capabilities spanning batching, caching, quantization, distributed execution, and multiple hardware platforms. Key features Efficient memory and serving — vLLM manages atte…

github.comhttps://github.com/vllm-project/vllm

supoclip: An open-source, AI-powered video clipping tool.

What problem it solves Long-form videos need to be turned into short, platform-ready clips, but metered usage, platform branding, and server-side control can constrain the workflow. SupoClip addresses these concerns with a self-hostable, open-source pipeline that offers no-watermark output and a hosted option. Key features AI clip selection and scoring — A supported language model selects clip-wor…

github.comhttps://github.com/FujiwaraChoki/supoclip

semantic-router: An open, programmable decision layer for models and compute.

What problem it solves Agent harnesses need to coordinate models, tools, task state, and changing compute requirements without manually managing every backend. They also need a way to apply location constraints and priorities for quality, latency, and cost to each call. Key features Policy-driven model routing — Select or combine models for each call according to a configured policy while leaving …

github.comhttps://github.com/vllm-project/semantic-router

openworker: A desktop app and harness SDK for building and running AI coworkers that work across everyday tools.

What problem it solves People need a way to delegate research, writing, code review, recurring tasks and work across connected tools to AI agents without giving up control over actions and data. They also need a foundation for embedding agent loops, tool calls, approvals, streaming and durable sessions into their own applications. Key features Everyday AI coworker — The desktop app supports resear…

github.comhttps://github.com/andrewyng/openworker

goose: A general-purpose AI agent that runs on your machine.

What problem it solves Users need an AI agent that can carry out tasks beyond producing code suggestions, including research, writing, automation, and data analysis. They also need access through desktop, terminal, and embeddable interfaces while retaining a broad choice of model providers and extensions. Key features Multiple ways to run — Use the native desktop application, a full terminal-orien…

github.comhttps://github.com/aaif-goose/goose