Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

AMD Says XDNA 2 NPU Supports Unsloth Desktop Locally

AI summary

AMD said the XDNA 2 NPU in Ryzen AI processors is the first neural processor to support Unsloth Desktop’s local interface. Compatible applications can send model requests to the Unsloth Desktop API, while Lemonade and FastFlowLM handle model serving and inference on the NPU and return responses to the applications. AMD also said more than 100 agents, including OpenClaw and Hermes, can run locally on Ryzen AI systems.

In-depth insight

AMD says the integration allows agents to run locally on the NPU, offloading related AI workloads from CPUs and GPUs and leaving more computing capacity for other tasks. The company also says this could help extend battery life on battery-powered devices.

IT之家 11 月 20 日消息,AMD 当地时间 19 日宣布,其锐龙 AI 处理器上的 "XDNA 2" NPU 成为首款获得 Unsloth Desktop 本地界面支持的神经网络处理器。

具体来看,兼容的应用程序向 Unsloth Desktop API 发送模型请求,而 Lemonade 和 FastFlowLM 则在 AMD XDNA 2 NPU 上处理模型服务和推理。模型的响应返回给应用程序,供其工作流程使用。

这意味着 OpenClaw、Hermes 等超百款智能体可通过 Unsloth Desktop 在锐龙 AI 处理器的 NPU 上本地运行,从 CPU 和 GPU 上卸载相关 AI 工作负载,留出更多算力以供其它任务使用,也有助于延长带电池设备的续航。

#AMD#XDNA 2 NPU#Ryzen AI processors#Unsloth Desktop#Lemonade#FastFlowLM#OpenClaw#Hermes

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.