Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Ollama v0.40.17-rc3 Adds Inkling 2 Mini Support

AI summary

The Ollama Releases report lists the v0.40.17-rc3 tag as created on 20 Nov at 18:37. The listed change is “mlxrunner: add Inkling 2 Mini,” adding support for the Inkling 2 Mini model in the MLX runner.

In-depth insight

This is a concrete but narrowly scoped update to Ollama’s model compatibility, extending its MLX runner to support one additional model.

Inkling 2 Mini

Inkling 2 Mini from Thinking Machines is a 26B parameter model with 5.4B active.

Its looped layers give it more computation per token than its size suggests, and it still fits on a Mac at about 20GB. It handles text and images, tool calls, and thinking, and scores 79.2% on SWE-Bench Verified).

  ollama run inkling-2-mini

Note: inkling-2-mini is supported on Apple silicon only in this release. PC support will follow in an upcoming release.

What's Changed

  • ollama launch claude supports Claude Code's deferred tool loading, so MCP tools are loaded when needed instead of all at once
  • Ollama on Apple silicon now serves multiple requests at once.
  • ollama launch opencode sets thinking options from the model's metadata
  • ollama launch pi refreshes Pi's model list after sign-in and passes along prompt arguments
  • ollama launch chatgpt --restore asks before switching an active profile and preserves existing settings and chat history; quitting ChatGPT yourself now lets it exit through its own quit prompt
  • Running ollama with no arguments in a non-interactive shell prints help instead of erroring
  • Ctrl+C or Ctrl+G while in a multiline """ block leaves multiline mode instead of swallowing the next line
  • Changing the context shift setting no longer reloads the model
  • Vulkan now uses mmap for integrated GPUs, fixing Failed to allocate pinned memory load failures on shared-memory GPUs
  • On Windows iGPUs, partially offloaded models no longer fail to allocate the KV cache
  • Tool definitions passed through the API keep JSON schema keywords Ollama doesn't model instead of dropping them
  • Disabling thinking now maps to the model's lowest supported reasoning level rather than being ignored
  • Source builds can use prebuilt MLX-C and XGrammar binaries Full Changelog: v0.40.16...v0.40.17-rc3

#Ollama#Inkling 2 Mini#MLX runner

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.