Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Google open-sources TorchTPU, giving PyTorch a native TPU backend

AI summary

Google announced Tuesday that TorchTPU, its version of PyTorch for TPUs, is now available as an open-source project, adding a native torch.device("tpu") backend so existing PyTorch training scripts need only minimal device-initialization changes. Google and Meta co-developed TPU-native execution passes inside TorchTitan, and a TorchTitan TPU fork is published on GitHub; Google says it worked with Hugging Face, Inferact (vLLM) and RadixArk (SGLang) on tool compatibility. Google reports vendor benchmarks including about 57% MFU for Llama 3 405B from 128 to 1,024 TPU v7x chips and 32.42% MFU for Qwen3 235B on a single 1,024-chip slice, while Amazon released its own PyTorch variant, TorchNeuron, for Trainium and AWS a day earlier.

In-depth insight

The release gives PyTorch developers a native path to Google's TPUs, and together with Amazon's TorchNeuron it is part of efforts to loosen Nvidia's default position for AI applications, though Google's performance figures are self-reported.

Integrating TorchTPU into TorchTitan and Optimizing Models for TPU - Google Developers Blog

Integrating TorchTPU into TorchTitan and Optimizing Models for TPU

OCT. 20, 2026

Aleksey Vlasenko Software Engineer

Rob Torres Senior Product Manager

Will Constable Meta

#Google#Meta#TorchTPU#TorchTitan#PyTorch#Amazon#Trainium#Hugging Face#vLLM#SGLang#Tensor Processing Units

Original · 21 min readRead the original
Group chat

No comments yet. Start the conversation.