Transformers v5.24.0
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Transformers v5.24.0 Adds Inkling 2 Mini and Variable-Loop Checkpoint
Transformers v5.24.0 added support for Inkling 2 Mini, a multimodal model from Thinking Machines Lab that accepts text and image inputs and generates text. According to the release notes, its 24-layer decoder repeats layers 6 through 17 three times, uses a learned message-passing mechanism, and routes each token to 8 of 128 experts with a hidden size of 2304. The release also added the TML-d24-varloop-research checkpoint, which supports a variable number of loop passes, trading speed for quality.
Transformers Releases · 🔥 10
Experience and discussion from the community
Share my Transformers v5.24.0 experienceAsk about Transformers v5.24.0
Nobody has shared their experience with Transformers v5.24.0 yet.