创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Ollama v0.40.17-rc3 新增 Inkling 2 Mini 支持

AI 总结

Ollama Releases 报告列出了 v0.40.17-rc3 标签,创建时间为 11 月 20 日 18:37。版本记录列出的变更是“mlxrunner: add Inkling 2 Mini”,为 MLX runner 增加 Inkling 2 Mini 模型支持。

深度见解

这是对 Ollama 模型兼容性的具体但范围有限的更新,使 MLX runner 新增支持一个模型。

Inkling 2 Mini

Inkling 2 Mini from Thinking Machines is a 26B parameter model with 5.4B active.

Its looped layers give it more computation per token than its size suggests, and it still fits on a Mac at about 20GB. It handles text and images, tool calls, and thinking, and scores 79.2% on SWE-Bench Verified).

  ollama run inkling-2-mini

Note: inkling-2-mini is supported on Apple silicon only in this release. PC support will follow in an upcoming release.

What's Changed

  • ollama launch claude supports Claude Code's deferred tool loading, so MCP tools are loaded when needed instead of all at once
  • Ollama on Apple silicon now serves multiple requests at once.
  • ollama launch opencode sets thinking options from the model's metadata
  • ollama launch pi refreshes Pi's model list after sign-in and passes along prompt arguments
  • ollama launch chatgpt --restore asks before switching an active profile and preserves existing settings and chat history; quitting ChatGPT yourself now lets it exit through its own quit prompt
  • Running ollama with no arguments in a non-interactive shell prints help instead of erroring
  • Ctrl+C or Ctrl+G while in a multiline """ block leaves multiline mode instead of swallowing the next line
  • Changing the context shift setting no longer reloads the model
  • Vulkan now uses mmap for integrated GPUs, fixing Failed to allocate pinned memory load failures on shared-memory GPUs
  • On Windows iGPUs, partially offloaded models no longer fail to allocate the KV cache
  • Tool definitions passed through the API keep JSON schema keywords Ollama doesn't model instead of dropping them
  • Disabling thinking now maps to the model's lowest supported reasoning level rather than being ignored
  • Source builds can use prebuilt MLX-C and XGrammar binaries Full Changelog: v0.40.16...v0.40.17-rc3

#Ollama#Inkling 2 Mini#MLX runner

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。