Phison showcases AI SSD with embedded NPU and 64GB memory
At SC26 in Chicago, storage-controller vendor Phison demonstrated an SSD design for AI servers that integrates a neural processing unit (NPU) and 64GB of memory. The design is intended to run AI frameworks and models such as PyTorch, llama.cpp, vLLM and OpenVINO inside the drive, allowing some processing to occur before data leaves the storage device. Phison says that, for suitable workloads, the design could reduce data transfers 10 to 100 times and lower CPU load; its 64GB memory provides about 130GB/s of bandwidth. Available performance information is limited: Phison cited 36,800 DMIPS, a CPU integer benchmark that analysts believe may describe the SSD’s CPU cores rather than NPU performance, and did not disclose a TOPS metric. The company has not announced a formal product name, launch date or sampling plan, and many demonstrated features remain in development. Why it matters: The design shows an effort to move some AI processing into storage, potentially reducing host data movement and CPU work for suitable workloads. Its practical value remains uncertain because the performance claims come from Phison, AI performance cannot yet be evaluated from the disclosed figures, and the technology is closer to an architecture under development than a deployable product. What do you think?
Open the headline: source, AI briefing and more →Comments
…