LLMs Test Reading Weight Edits Without Running the Model
Reddit author suayptalha reports using Qwen and Muse models between 9B and 30B parameters to predict how weight edits will affect behavior without running the edited model. Qwen 27B achieved a reported 73.0% balanced accuracy on subtle edits with weight access, compared with 57.8% from text descriptions, while the author says no conclusive advantage was established for models reading their own weights. The author also released an evaluation harness, experimental code, and an open-source toolkit for LLM-based weight-space reading and programming.
The released evaluation code and toolkit give researchers material for evaluating whether inspecting raw parameters can substitute for running a target model after edits.
| I’ve been experimenting with weight-space reading using Qwen and Muse models (9B–30B). The goal: can an LLM inspect raw model weights and predict the behavioral effects of weight edits without running the target model? A few findings: 🔹Qwen 27B reached 73.0% balanced accuracy on subtle edits with weight access, vs. 57.8% from text descriptions. 🔹We couldn’t establish a conclusive advantage for models reading their own weights. 🔹On Muse-30B, 34 standard edits and 6 no-op controls produced no detectable behavioral changes, but weight-reading agents frequently predicted changes. I’ve released the paper’s evaluation harness and experimental code, plus an open-source toolkit for LLM-based weight-space programming and reading. Code: https://github.com/suayptalha/wsr Paper: https://www.alphaxiv.org/abs/2611.weight-space-reading-language-models I’d be interested in feedback on the evaluation design, especially from people experimenting with open-weight models. submitted by /u/suayptalha [link] [comments] |