TML-d24-varloop-research
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Transformers v5.24.0 Adds Inkling 2 Mini and Variable-Loop Checkpoint
Transformers v5.24.0 added support for Inkling 2 Mini, a multimodal model from Thinking Machines Lab that accepts text and image inputs and generates text. According to the release notes, its 24-layer decoder repeats layers 6 through 17 three times, uses a learned message-passing mechanism, and routes each token to 8 of 128 experts with a hidden size of 2304. The release also added the TML-d24-varloop-research checkpoint, which supports a variable number of loop passes, trading speed for quality.
Transformers Releases · 🔥 10 - Inkling 2 Mini launches with day-zero vLLM support
Thinking Machines announced Inkling 2 Mini, a multimodal mixture-of-experts model with 26B total parameters, 3.5B active parameters and support for contexts up to 1M tokens. Its middle 12 layers run three times per token with shared weights, separate KV caches and gated messages between passes. vLLM Blog says vLLM provides day-zero support across NVIDIA Blackwell, Hopper and DGX Spark, plus serving support for the TML-d24-varloop-research checkpoint.
vLLM Blog · 🔥 3
Experience and discussion from the community
Share my TML-d24-varloop-research experienceAsk about TML-d24-varloop-research
Nobody has shared their experience with TML-d24-varloop-research yet.