LLM尝试不运行模型读取权重编辑影响
AI 总结
Reddit作者suayptalha称,他使用9B至30B参数的Qwen和Muse模型,在不运行被编辑模型的情况下预测权重编辑对行为的影响。据其报告,Qwen 27B在可访问权重时对细微编辑达到73.0%的平衡准确率,高于使用文本描述时的57.8%,但实验未能确立模型读取自身权重的明确优势。作者同时发布了评估框架、实验代码,以及用于LLM权重空间读取与编程的开源工具包。
深度见解
公开的评估代码与工具包为研究者验证参数读取能否替代运行被编辑模型提供了可复现材料。
| I’ve been experimenting with weight-space reading using Qwen and Muse models (9B–30B). The goal: can an LLM inspect raw model weights and predict the behavioral effects of weight edits without running the target model? A few findings: 🔹Qwen 27B reached 73.0% balanced accuracy on subtle edits with weight access, vs. 57.8% from text descriptions. 🔹We couldn’t establish a conclusive advantage for models reading their own weights. 🔹On Muse-30B, 34 standard edits and 6 no-op controls produced no detectable behavioral changes, but weight-reading agents frequently predicted changes. I’ve released the paper’s evaluation harness and experimental code, plus an open-source toolkit for LLM-based weight-space programming and reading. Code: https://github.com/suayptalha/wsr Paper: https://www.alphaxiv.org/abs/2611.weight-space-reading-language-models I’d be interested in feedback on the evaluation design, especially from people experimenting with open-weight models. submitted by /u/suayptalha [link] [comments] |