torchtitan-neuron

Headlines · 1

1. Oct 21
   AWS walkthrough: training Qwen3 on Trainium with torchtitan

   An AWS Machine Learning Blog post walks through training Qwen3 on a single trn2.48xlarge Trainium instance using torchtitan, saying TorchNeuron registers Trainium as a native PyTorch device so torchtitan can use it through standard PyTorch interfaces. The post describes three configurations that share the same torchrun launch pattern and config structure: Hugging Face Transformers v5 as a modeling backend running Hub models through AutoModelForCausalLM with published safetensors, torchtitan's native Qwen3 selected by changing config.model_spec, and an NKI mixture-of-experts path using kernels from the torchtitan-neuron recipes attached via torchtitan's override registry. AWS says the setups support both pre-training from random initialization and fine-tuning published weights, and pins versions including torch 2.14.0, torch_neuronx 2.14.3, transformers 5.16.0 and torchtitan-neuron release-2.33.

   AWS Machine Learning Blog · 🔥 0

Experience and discussion from the community

Share my torchtitan-neuron experienceAsk about torchtitan-neuron