WorldMemArena benchmark tests multimodal agent memory through action–world loops
Researchers from UC Santa Barbara, Stanford, ETH Zurich, Johns Hopkins, Carnegie Mellon and J.P. Morgan Chase have jointly proposed WorldMemArena, a multimodal agent memory benchmark, according to a 机器之心 report. The paper, whose co-first authors Chengzhi Liu and Yuzhe Yang are both at UCSB, was accepted at NeurIPS 2026. WorldMemArena evaluates memory inside an observe–act–environment-feedback loop and splits long-term memory into writing, maintenance, retrieval and use stages, with more than 400 multi-session tasks, 24,258 QA pairs and 15,595 images or screenshots. In the paper's results, M2A reached 86.83% memory recall but only 50.14% final QA accuracy, while MemGPT scored 85.20% and 57.81%, and systems tended to append new memories rather than revise outdated ones and did not reliably use visual information in cross-modal reasoning.
The reported results indicate that storing more memory does not by itself translate into correct answers, shifting evaluation focus from reciting the past to maintaining a changing world state.
机器之心 2026-10-20 17:35 北京
多模态 Agent 记忆评测基准 WorldMemArena
来自加州大学圣塔芭芭拉分校、斯坦福大学、苏黎世联邦理工学院、约翰斯·霍普金斯大学、卡内基梅隆大学和 J.P. Morgan Chase 的研究者,联合提出多模态 Agent 记忆评测基准 WorldMemArena。论文已被 NeurIPS 2026 接收;共同第一作者 Chengzhi Liu 与 Yuzhe Yang 均来自 UCSB。
团队盯住的是一个很实际的问题:Agent 明明保存了项目计划,预算更新后却仍按旧版本行动;看过环境截图,下一步又忽略了画面里已改变的状态。它究竟是没记下来、没及时更新,还是找到了证据却没用上?
#WorldMemArena#UC Santa Barbara#Stanford University#ETH Zurich#Johns Hopkins University#Carnegie Mellon University#J.P. Morgan Chase#NeurIPS 2026#M2A#MemGPT