Simon Willison released llm 0.37.2, a command-line tool for accessing large language models. The update fixes issues tracked as GHSA-v9h7-jj4g-f862 and GHSA-r639-rr7r-x72w, which could cause a configured OpenAI API key to be sent to another provider when the named key was not stored or when a responses-enabled model was run with the chat-completions option. It also manages extra-openai-models.yaml through the new `llm openai endpoint add` command introduced in 0.37.
Simon Willison announced llm 0.37, a new version of his command-line tool and Python library for accessing large language models. The release adds gpt-6.1-sol and gpt-6.1-terra, introduces an `llm openai endpoint add` command for configuring additional models that use OpenAI-compatible endpoints, changes the default model to gpt-6-luna, and expands embedding support to handle binary content with different content types. Willison said the release represents around two months of accumulated features and fixes.
TechRadar examines semantic erosion, in which repeated processing, summarization, and handoffs among language models gradually strip cultural and situational meaning from otherwise coherent outputs. It discusses architectural controls, drift detection, entropy penalties, human-in-the-loop labeling, feedback such as RLHF, and other ways developers can limit the problem.
A free, two-part Medium series surveys current practices for evaluating Intelligent Document Processing (IDP), with a focus on Key Information Extraction from structured documents, especially forms. According to the author, it covers raw extraction outcomes, confusion-matrix scoring for text fields and checkboxes, treatment of blanks and unreadable values, F1, recall, accuracy, IoU, precision, specificity, calibration, OCR metrics, and the distinction between confidence and correctness. The first part is titled “Confidence Is Not Correctness,” while the second covers approaches to evaluating form extraction.
A Nielsen survey of 1,700 directors and senior managers across seven countries, commissioned by Monday.com and reported by TechCrunch, found that more than half of senior leaders find it harder to evaluate employees' work after adopting AI, because polished output arriving in their inboxes makes it unclear how much came from the employee versus the tool. Nearly half of managers said they spend more time reviewing and guiding their teams' output than before, and 78% said they have changed how they assess staff, weighting prompt-writing, task delegation to AI and experimentation more heavily. The survey also reports that 94% of managers said they were excited to improve work using AI, while 46% use AI to help inform their decisions, 39% use it to draft performance reviews, and 58% expect to oversee more AI agents than human employees within the next year.
Google Docs and Google Drive now support native previewing, editing, and collaboration on Markdown files without converting them to another format. Google Docs offers real-time co-editing, comments, suggested changes, and version history, while Drive provides rendered previews with formatted tables and clickable links. Google says the feature is available to personal Google and Workspace accounts, with availability potentially taking up to 15 days from October 5.
Simon Willison released llm-openai-decisions 0.1a0, an LLM plugin for OpenAI's new Decisions API announced at last week's DevDay; he had GPT-6 Astra read the new API docs and modeled the plugin on his existing llm-typesafe plugin for Jev. The new decision model, gpt-6-luna, accepts image input as well as text. According to the post, both models charge for input only and not output — OpenAI at 10 cents per million input tokens versus Jev's 4.2 cents — and both support yes/no, choice and score question types.
Simon Willison released llm-mistral 0.16, which adds support for reasoning models to the LLM command-line tool. The post cites the newly released Mistral Large 4 as an example. No further details about the update or the model are given in the source.
What problem it solves
Local notes, documentation, knowledge bases, and meeting transcripts need to remain searchable without sending their contents to a remote service. QMD addresses this by combining keyword retrieval, semantic search, and local LLM reranking for documents indexed on the user's device.
Key features
Hybrid local search — Queries can use BM25 full-text search, vector semantic sear…
What problem it solves
Developers need abstractions that can accommodate increasingly agentic LLMs without limiting their reasoning and tool-use abilities through rigid prompts or opinionated orchestration. They also need a way to turn agent components into multi-tenant, multi-session applications with supporting infrastructure.
Key features
Composable agent building blocks — Compose agents from a…
What problem it solves
Product teams need to connect analytics, errors, replays, logs, and business data so they can diagnose problems, identify opportunities, and act on what they learn. This context must also be available to developers and agents across interfaces such as Slack, web, desktop, and MCP.
Key features
Unified product context — Collect and query analytics, errors, replays, logs, trac…
What problem it solves
Training generative AI models at scale requires coordinating multiple parallelism strategies while supporting pretraining, fine-tuning, and reinforcement learning in one codebase. Large-scale training also needs reproducible configurations, checkpointing, debugging tools, and observability that can be adapted for research and model development.
Key features
Composable model …
What problem it solves
Building LLM applications often requires connecting model providers, vector stores, tools, streaming, and agent capabilities. Rig provides a shared Rust interface for these components and includes a terminal coding agent that can be extended with plugins.
Key features
Unified model and vector-store interfaces — Use a shared interface for model providers and vector stores, wi…
What problem it solves
Documents and office files often need to be transformed into a structured, text-friendly format before they can be processed by language models or text analysis tools. MarkItDown addresses this by preserving important document structures such as headings, lists, tables, and links during conversion to Markdown.
Key features
Broad format conversion — MarkItDown converts PDF, P…
What problem it solves
Readers need a structured way to understand AI Agent design principles and apply them through engineering practice. The book addresses this by organizing the material into 10 chapters and pairing the text with 109 companion experiments covering topics such as context engineering, memory, tools, evaluation, post-training, continuous evolution, and multi-agent collaboration.
K…
What problem it solves
vLLM users need a way to run the framework on Huawei Ascend NPU hardware through a supported integration path. The plugin decouples Ascend NPU integration from vLLM and enables supported model types to run on the platform.
Key features
Hardware-pluggable vLLM integration — The plugin provides an interface for integrating Ascend NPUs with vLLM and follows the community's hard…
What problem it solves
Heretic addresses the difficulty of modifying language-model behavior to remove refusals, suppress slop, reduce sycophancy, or apply other behavioral changes. It provides a training-free approach that steers models through mathematical techniques rather than expensive retraining.
Key features
Configurable behavior changes — The default configuration suppresses refusals, whil…
What problem it solves
Teams deploying AI inference need to optimize models, reduce resource demands, and run them across different frameworks and hardware platforms. The toolkit addresses model conversion, compilation, and inference workflows for applications ranging from computer vision and speech recognition to generative AI and language models.
Key features
Inference optimization — Optimize de…
What problem it solves
Stock analysis often requires users to gather market quotes, news, technical indicators, financial information, and AI-assisted interpretation across multiple sources. The project addresses this by bringing supported-market data, analysis tools, AI agents, alerts, and review workflows into a locally focused desktop application.
Key features
Multi-market market data — The app…
What problem it solves
Building production voice agents often requires control over infrastructure, model providers, workflows, and deployment. Dograh addresses these needs with an open-source platform that supports self-hosting, bring-your-own-key integrations, and visual and agent-assisted development.
Key features
Visual voice agent workflow builder — Create workflows with start nodes, agent no…
What problem it solves
AI agents need to choose among models while balancing task success, cost, and latency for their workloads. Applications also need flexibility in where routing runs and who controls model clients, credentials, retries, and service operation.
Key features
Multiple routing algorithms — Routing can be configured with Auto, Task, Execution, or Composite strategies, including mode…
What problem it solves
Large language models can be difficult for individuals to train, deploy, or understand because of their scale and the abstractions used by many frameworks. The project addresses this by providing native PyTorch implementations, compact model structures, open datasets, and staged workflows for pretraining, fine-tuning, preference optimization, tool use, and agentic training.
…
What problem it solves
Developers often need to understand why model applications are slow or costly, but system decisions require reasoning across model architecture, hardware limits, memory, computation, communication, and scheduling. Easy-to-miss factors such as KV cache, bandwidth limits, and inter-device communication can shift estimates by orders of magnitude, so system design should begin f…
What problem it solves
Serving large language models requires efficient memory management, flexible model execution, and practical integration with existing models and APIs. vLLM addresses these needs with inference and serving capabilities spanning batching, caching, quantization, distributed execution, and multiple hardware platforms.
Key features
Efficient memory and serving — vLLM manages atte…
What problem it solves
Long-form videos need to be turned into short, platform-ready clips, but metered usage, platform branding, and server-side control can constrain the workflow. SupoClip addresses these concerns with a self-hostable, open-source pipeline that offers no-watermark output and a hosted option.
Key features
AI clip selection and scoring — A supported language model selects clip-wor…
What problem it solves
Agent harnesses need to coordinate models, tools, task state, and changing compute requirements without manually managing every backend. They also need a way to apply location constraints and priorities for quality, latency, and cost to each call.
Key features
Policy-driven model routing — Select or combine models for each call according to a configured policy while leaving …
What problem it solves
People need a way to delegate research, writing, code review, recurring tasks and work across connected tools to AI agents without giving up control over actions and data. They also need a foundation for embedding agent loops, tool calls, approvals, streaming and durable sessions into their own applications.
Key features
Everyday AI coworker — The desktop app supports resear…
What problem it solves
Users need an AI agent that can carry out tasks beyond producing code suggestions, including research, writing, automation, and data analysis. They also need access through desktop, terminal, and embeddable interfaces while retaining a broad choice of model providers and extensions.
Key features
Multiple ways to run — Use the native desktop application, a full terminal-orien…