Agent MechSuits Adds Internal Safety Controls to CLI Agents
Researchers from Georgia Tech, Rutgers, the University of Southern California and other institutions proposed Agent MechSuits, a NeurIPS 2026-accepted method that reads hidden-state safety signals before each command-line agent action and intervenes on 10 dimensions without updating the main model. Across LLaMA-3.1-8B, Qwen-2.5-7B and Gemma-2-9B, the reported MAS current-step detection accuracy averaged 97.32%, while Qwen-2.5-7B's malicious-step ASR fell from 91.30% to 4.35%. The method also had limitations: generation-collapse rate rose from 2.24% to 18.54%, the evaluation used language-model judging, and the probe did not reliably detect prompt injection arriving through environment feedback.
The work offers a white-box, step-level safety control for multi-step CLI agents, but its reported results do not establish full-task safety or practical deployment reliability.
新智元 2026-11-08 17:47 北京
新智元报道
AI agent开始接管终端之后,安全问题也进入了执行现场。当智能体能够读取文件、编写脚本、运行命令,并根据系统反馈持续调整下一步操作,一次错误决策就可能影响真实的文件与系统状态。
如何让智能体在完成任务的过程中及时识别可能会发生的风险,成为智能体安全研究的重要问题。涉及多轮执行的长程任务尤其考验防护机制。
一次目录检查、一次脚本创建、一次配置修改,都需要结合任务目标、此前的操作和最新环境反馈判断风险。针对单轮执行的初始命令审查,很难覆盖长程任务的整段执行过程。
#Agent MechSuits#Mechanistic AgentSafety#Georgia Tech#Rutgers University#University of Southern California#LLaMA-3.1-8B#Qwen-2.5-7B#Gemma-2-9B#NeurIPS