Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Ollama v0.40.14 updates Claude Code limits and API behavior

AI summary

According to Ollama's release notes, v0.40.14 makes Claude Code launches apply each model's output-token limit and adds a ChatGPT routing check to Codex configuration. The release also fixes decoding for cloud web-search responses on /api/chat, preserves readable input on the Responses endpoint, retains packaged sampler defaults on OpenAI-compatible endpoints, and allows the Ollama app to retry ChatGPT disconnects. Ollama also reports faster top-k sampling on MLX for large vocabularies.

In-depth insight

The documented changes affect how AI coding tools and compatible API clients handle output limits, routing, input content, sampling defaults, web-search responses, and connection failures.

What's Changed

  • ollama launch claude now applies the model's output token limit for Claude Code, so cloud models no longer run into the 128k default cap
  • Cloud web search responses on /api/chat are now decoded correctly, including compressed responses
  • OpenAI-compatible endpoints no longer override a model's packaged sampler defaults — clients that send no temperature/top_p get the model's own values instead of 1.0, matching /api/chat
  • /v1/responses now preserves readable input content, including prior assistant refusals, instead of flattening it
  • Ollama's app can now retry ChatGPT disconnect failures instead of leaving the connection in a broken state
  • ollama launch codex verifies ChatGPT routing before configuring, and reports a clear error when routing is unavailable
  • Faster top-k sampling on MLX for large vocabularies

Full Changelog: v0.40.13...v0.40.14

#Ollama#Claude Code#ChatGPT#Codex#MLX

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.