torch-spyre brings IBM Spyre in as a native PyTorch device
IBM's torch-spyre team published a PyTorch blog post describing how it made Spyre, IBM's dataflow AI accelerator for inference, a native PyTorch device. The integration uses PrivateUse1 registration to give Spyre a device identity named "spyre", then maps PyTorch's allocator, stream, event and Inductor compiler abstractions onto Spyre runtime constraints such as ordered queues of typed operations, separate compute and data-movement pipelines, and ahead-of-time compiled programs with fixed layouts. IBM says this gives one path for eager and compiled execution, keeps tensors resident on device="spyre", and cuts launch overhead; no performance or benchmark figures are given, and the source text is truncated near the end.
It illustrates one approach to plugging a novel dataflow accelerator into PyTorch's standard abstractions, useful to teams weighing non-GPU inference hardware.