D-Matrix unveils Raptor AI inference chip with stacked 3D DRAM
D-Matrix introduced Raptor, a second-generation AI inference chip that stacks 3D DRAM beneath its compute logic. The design builds on the Pavehawk test chip, which is proving out the stacked-memory technology. D-Matrix says the architecture addresses inference memory-bandwidth and energy-efficiency constraints, while also identifying interconnect efficiency and software cohesion as priorities. Srivastava claimed that 3D DRAM can deliver 10 times higher energy efficiency and bandwidth than HBM, but the report provides no independent benchmark results.
Raptor is intended to address memory bandwidth and energy efficiency, which D-Matrix identifies as key constraints for AI inference. Its comparative performance claims remain vendor-attributed and have not been independently benchmarked.
As artificial intelligence workloads shift to inference, memory bandwidth decides whether hardware generates tokens quickly or sits idle. D-Matrix Corp. is answering with Raptor, a second-generation chip stacking 3D DRAM beneath its compute logic.
AI infrastructure has become a systems game, and winners combine memory, interconnect and software into cohesive designs, according to Satyam Srivastava (pictured), fellow at d-Matrix.
“It’s no longer a chip problem. Chip plays a part of it. Memory bandwidth is a fundamental advantage that has to be solved,” Srivastava said. “The next is energy efficiency. The next is interconnect efficiency. The next is software cohesiveness.”
Srivastava spoke with theCUBE Research’s John Furrier at SC26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed d-Matrix’s Raptor chip and its stacked 3D DRAM, inference memory bandwidth and the shift toward heterogeneous computing. (* Disclosure below.)
Raptor brings a stacked-memory tier to inference
D-Matrix proves each risky technology on a test chip first. Jayhawk proved die-to-die connectivity, and Jayhawk II validated digital in-memory computing. The Corsair accelerator combined both and entered full production earlier this year, Srivastava explained.
#D-Matrix#Raptor#Pavehawk#Corsair#Nvidia#NVLink Fusion#Hopper