torchtitan: A PyTorch-native platform for pretraining and post-training generative AI models at scale.
What problem it solves Training generative AI models at scale requires coordinating multiple parallelism strategies while supporting pretraining, fine-tuning, and reinforcement learning in one codebase. Large-scale training also needs reproducible configurations, checkpointing, debugging tools, and observability that can be adapted for research and model development. Key features Composable model …
github.comhttps://github.com/pytorch/torchtitan