Transformers v5.20.1 adds Reflection AI's Beam coding model
The Transformers v5.20.1 release notes say the update adds Beam, a new model from Reflection AI described as a token-efficient, frontier-scale model focused on coding and agentic use cases. The notes say Beam is built for teams that want to run a powerful model on their own hardware, infrastructure or cloud and customize it. The same patch release fixes a regression that broke model loading on older PyTorch versions and includes fixes for HunYuan-VL image assignment in batched generation and DeepGEMM Mega MoE under expert parallelism.
The release notes position Beam as a self-hostable, frontier-scale coding and agentic model, but supply no benchmarks or licensing details to support that claim.
Release v5.20.1
Special surprise including the new model Beam from Reflection AI 🥳

Beam is a token-efficient, frontier-scale model focused on coding and agentic use cases. It is built for teams that want to run a powerful model on their own hardware, infrastructure, or cloud, and customize it to their specific needs.
Links: Documentation
- Fix small bug in auto mappings (#49664) by @yonigozlan in #49664
Some real patch fixes
We broke loading models on older torch versions 😢 should be fixed now. But here is the full list of fixes
- Fix HunYuan-VL image assignment during batched generation (#49557) by @Arnav66692
- Fix DeepGEMM Mega MoE under expert parallelism(#49428) by @IlyasMoutawwakil
- Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpointing (#49652) by @naveecode
- Make DtensorShardOperation work on torch 2.6 and 2.7 (#49657) by @hazelxue
Full Changelog: v5.20.0...v5.20.1