Ollama v0.40.17 新增并发生成与 Vulkan mmap
AI 总结
据发布说明,Ollama v0.40.17 为 MLX 后端加入并发生成支持,并让 Vulkan 集成显卡使用 mmap。此次更新还改进了 ChatGPT CLI 的恢复与优雅重启功能,使用思考元数据配置 OpenCode,并升级 llama.cpp 至 b12257,同时更新 MLX 和 MLX-C。
深度见解
此次版本涵盖并发生成、GPU 内存映射、CLI 恢复和编辑器设置等多个本地模型工具改进。
What's Changed
- Improve ChatGPT CLI restore and graceful restart by @hoyyeva in #19583
- cmd/launch: use thinking metadata for OpenCode settings by @hoyyeva in #19409
- llm: use mmap for Vulkan integrated GPUs by @dhiltgen in #19640
- rpreslar4765/Ollama by @rpreslar4765 in #17163
- mlx: support concurrent generation by @dhiltgen in #19197
- llama.cpp: version bump b12257 by @dhiltgen in #19646
- MLX, MLX-C: version bump by @dhiltgen in #19647
New Contributors
- @rpreslar4765 made their first contribution in #17163
Full Changelog: v0.40.16...v0.40.17-rc0