Proof Before Reuse
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Proof Before Reuse limits agent memory poisoning in small study
A small case study posted on r/MachineLearning proposes "Proof Before Reuse": a coding agent writes a skill into reusable procedural memory only after two later sessions reproduce the same change and pass its test, and the agent is shown only the lines those sessions also wrote. The study compares no memory, replay of recorded edits, naive memory (every passing session kept, with the skill chosen by Mem0's search) and the proof-before-reuse arm, running five scored sessions per arm with Claude Haiku 5.5 and Sonnet 5.5 plus a hidden verifier with 187 behavioural checks. The author reports that replay put the poison back in 30/30 repos with every test passing, naive memory exposed the poison in 3/30 sessions, and proof before reuse exposed it in 0/30, while noting the work covers one task, uses n=5 per cell, is not significant at p≈0.24 and measures exposure rather than harm.
r/MachineLearning · 🔥 0
Experience and discussion from the community
Share my Proof Before Reuse experienceAsk about Proof Before Reuse
Nobody has shared their experience with Proof Before Reuse yet.