权重空间编程取得局部增益但可靠性不均
AI 总结
一篇在 r/LocalLLaMA 分享的论文提出权重空间编程(WSP),让推理智能体检查并直接修改神经网络参数,作为基于梯度适配的另一条路径。作者在16条编辑轨迹、7个基准以及 Qwen3.5-0.8B 和 Qwen3.5-9B 两种模型规模上开展研究,报告称 MATH-500、GPQA Diamond、IFEval 和 SciBench 的留出准确率最高分别提升29.45、4.42、36.72和17.11个百分点。作者还称,仅修改1,023个参数便使 MATH-500 提升29.45个百分点。不过,不同轨迹的结果差异明显;当候选改进无法得到可靠验证时,16条轨迹中有6条保留了原始权重。
深度见解
该论文报告称,推理智能体可以通过高度局部的权重编辑适配模型,同时也记录了有效干预难以可靠发现以及收益跨任务迁移不均等挑战。
| Weight-Space Programming (WSP) enables reasoning agents to directly inspect and modify neural network parameters, offering an alternative to gradient-based model adaptation. However, its capabilities, cross-task generalization, and practical limitations remain insufficiently understood. We systematically investigate WSP through 16 editing trajectories across seven benchmarks and two model scales (Qwen3.5-0.8B and Qwen3.5-9B). Our findings reveal three key insights. First, WSP can achieve substantial performance gains through highly localized interventions. On full held-out evaluations, accuracy improves by up to 29.45, 4.42, 36.72, and 17.11 percentage points on MATH-500, GPQA Diamond, IFEval, and SciBench, respectively. Notably, modifying only 1,023 parameters yields a 29.45-point improvement. Second, WSP exhibits promising but uneven cross-task generalization. A Math-edited checkpoint improves GPQA Diamond, IFEval, and SciBench by 3.03, 12.18, and 20.10 points, respectively, without further editing, while leaving SciCode performance unchanged. Third, effective editing remains challenging and inconsistent. Outcomes vary substantially across trajectories, and six of the 16 trajectories retain the original weights when candidate improvements cannot be reliably validated. Together, these results highlight WSP's potential for highly localized model adaptation while revealing important challenges in intervention discovery, reliability, and cross-task transfer. Related Thread : [Paper] Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights submitted by /u/pmttyji [link] [comments] |