Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Qwen 3.8 27B Reproduces Model-Weight Interpretation Demo

AI summary

Simon Willison reproduced a “Sparks of Weight-Space Programming” example with Qwen 3.8 27B running on his laptop, identifying the game represented by raw neural-network weights. The paper’s authors report that GPT-6 Astra interpreted and edited weights, including a claimed MATH-500 increase from 7.9% to 48.1% after changing 0.016% of Qwen3.5-0.8B’s weights. Separately, a QwenBend project claims that a Qwen model type-checks and executes a Bend program inside its own forward pass using 53 million hand-set weights, without an external interpreter, compiler or tool call.

In-depth insight

The laptop reproduction supports the paper’s central claim that a local LLM can reason about raw model weights, while QwenBend extends the demonstration to in-model program execution; however, the scope and tool-free nature of the reported results remain disputed.

Qwen 3.8 27B on my laptop can interpret model weights, too

Simon Willison’s Weblog

Newsletter

Sponsored by: doubleAI — doubleAI’s Maxwell makes software faster as it runs, no code changes needed. Now in early access

Qwen 3.8 27B on my laptop can interpret model weights, too

3rd November 2026

#Qwen 3.8 27B#QwenBend#GPT-6 Astra#Qwen3.5-0.8B#Bend2

Original · 6 min readRead the original
Group chat

No comments yet. Start the conversation.