D-Matrix推出采用3D DRAM堆叠的Raptor AI推理芯片
D-Matrix披露了第二代AI推理芯片Raptor,该芯片将3D DRAM堆叠在计算逻辑下方。其设计基于Pavehawk测试芯片,后者正在验证相关堆叠内存技术。D-Matrix表示,该架构旨在应对AI推理中的内存带宽和能效约束,并将互连效率和软件协同列为重点。Srivastava称,3D DRAM可实现相较HBM十倍的能效和带宽,但报道未提供独立基准测试结果。
Raptor旨在解决D-Matrix所称的AI推理内存带宽和能效约束。其相较HBM的性能数据仍属于厂商主张,尚未经过独立基准验证。
As artificial intelligence workloads shift to inference, memory bandwidth decides whether hardware generates tokens quickly or sits idle. D-Matrix Corp. is answering with Raptor, a second-generation chip stacking 3D DRAM beneath its compute logic.
AI infrastructure has become a systems game, and winners combine memory, interconnect and software into cohesive designs, according to Satyam Srivastava (pictured), fellow at d-Matrix.
“It’s no longer a chip problem. Chip plays a part of it. Memory bandwidth is a fundamental advantage that has to be solved,” Srivastava said. “The next is energy efficiency. The next is interconnect efficiency. The next is software cohesiveness.”
Srivastava spoke with theCUBE Research’s John Furrier at SC26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed d-Matrix’s Raptor chip and its stacked 3D DRAM, inference memory bandwidth and the shift toward heterogeneous computing. (* Disclosure below.)
Raptor brings a stacked-memory tier to inference
D-Matrix proves each risky technology on a test chip first. Jayhawk proved die-to-die connectivity, and Jayhawk II validated digital in-memory computing. The Corsair accelerator combined both and entered full production earlier this year, Srivastava explained.
#D-Matrix#Raptor#Pavehawk#Corsair#Nvidia#NVLink Fusion#Hopper