Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Transformers v5.24.0 Adds Inkling 2 Mini and Variable-Loop Checkpoint

AI summary

Transformers v5.24.0 added support for Inkling 2 Mini, a multimodal model from Thinking Machines Lab that accepts text and image inputs and generates text. According to the release notes, its 24-layer decoder repeats layers 6 through 17 three times, uses a learned message-passing mechanism, and routes each token to 8 of 128 experts with a hidden size of 2304. The release also added the TML-d24-varloop-research checkpoint, which supports a variable number of loop passes, trading speed for quality.

In-depth insight

The release gives Transformers users direct support for Inkling 2 Mini and its variable-loop research configuration, broadening the library's coverage of looped multimodal MoE models.

Release v5.24.0

New Model additions

Inkling 2 Mini

image

Inkling 2 Mini is a multimodal model from Thinking Machines Lab that accepts text and image inputs and generates text outputs. It is a smaller sibling of Inkling 2 Small, added in v5.23.0. It has 24 decoder layers instead of 48, and compensates with a looping mechanism in which layers 6 to 17 run three times. A learned message-passing mechanism mixes the residuals of the previous pass into the attention and mixture-of-experts inputs of each loop layer. The decoder has a hidden size of 2304 and routes each token to 8 of 128 experts. The image encoder, tokenizer and processor are the same as Inkling 2 Small's.

A research checkpoint (TML-d24-varloop-research) has the same architecture but supports a variable number of loop passes. Fewer passes are faster, and more passes improve quality. Both checkpoints contain NVFP4 and MXFP8 quantized layers, which are dequantized at load time.

#Transformers v5.24.0#Thinking Machines Lab#Inkling 2 Mini#TML-d24-varloop-research#Inkling 2 Small#Hugging Face Transformers

Original · 16 min readRead the original
Group chat

No comments yet. Start the conversation.