Trainium2

Headlines · 2

1. 14h
   Amazon launches TorchNeuron, an open-source PyTorch backend for Trainium

   Amazon announced TorchNeuron on October 19, describing it as an open-source native PyTorch backend that lets existing PyTorch code run on its Trainium AI chips by changing a single device setting instead of rewriting code. The tool is set to enter public beta on October 20 at the PyTorch Conference in San Jose under the Apache 2.0 license, supporting Trainium2 and Trainium3. Amazon says a demo showed the same training script learning at the same rate on a standard chip and on Trainium, but according to The Next Web the first release lacks some PyTorch features such as dynamic input shapes and skips about 22,000 PyTorch tests; early users include Cartesia and Deepgram.

   PyTorch Blog · 🔥 50
2. 6d
   Reactor adds NVIDIA, Sapphire funding for real-time inference platform

   36Kr reports that startup Reactor is building a real-time inference platform for video and world models, saying developers can use a unified SDK and API to build interactive applications with more than 60 FPS and under 40 milliseconds of latency. Reactor had raised a $59 million seed-plus-Series-A round and recently added follow-on Series A funding from NVIDIA and Sapphire Ventures, bringing its total raised to $74 million. The report also says Reactor worked with an AWS team to run real-time video generation on a single Trainium2 chip, though the performance and deployment claims were not independently measured.

   36氪 人工智能 · 🔥 0

Experience and discussion from the community

Share my Trainium2 experienceAsk about Trainium2