Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

WorldMemArena benchmark tests multimodal agent memory through action–world loops

AI summary

Researchers from UC Santa Barbara, Stanford, ETH Zurich, Johns Hopkins, Carnegie Mellon and J.P. Morgan Chase have jointly proposed WorldMemArena, a multimodal agent memory benchmark, according to a 机器之心 report. The paper, whose co-first authors Chengzhi Liu and Yuzhe Yang are both at UCSB, was accepted at NeurIPS 2026. WorldMemArena evaluates memory inside an observe–act–environment-feedback loop and splits long-term memory into writing, maintenance, retrieval and use stages, with more than 400 multi-session tasks, 24,258 QA pairs and 15,595 images or screenshots. In the paper's results, M2A reached 86.83% memory recall but only 50.14% final QA accuracy, while MemGPT scored 85.20% and 57.81%, and systems tended to append new memories rather than revise outdated ones and did not reliably use visual information in cross-modal reasoning.

In-depth insight

The reported results indicate that storing more memory does not by itself translate into correct answers, shifting evaluation focus from reciting the past to maintaining a changing world state.

机器之心 2026-10-20 17:35 北京

多模态 Agent 记忆评测基准 WorldMemArena

来自加州大学圣塔芭芭拉分校、斯坦福大学、苏黎世联邦理工学院、约翰斯·霍普金斯大学、卡内基梅隆大学和 J.P. Morgan Chase 的研究者,联合提出多模态 Agent 记忆评测基准 WorldMemArena。论文已被 NeurIPS 2026 接收;共同第一作者 Chengzhi Liu 与 Yuzhe Yang 均来自 UCSB。

团队盯住的是一个很实际的问题:Agent 明明保存了项目计划,预算更新后却仍按旧版本行动;看过环境截图,下一步又忽略了画面里已改变的状态。它究竟是没记下来、没及时更新,还是找到了证据却没用上?

#WorldMemArena#UC Santa Barbara#Stanford University#ETH Zurich#Johns Hopkins University#Carnegie Mellon University#J.P. Morgan Chase#NeurIPS 2026#M2A#MemGPT

Original · 5 min readRead the original
Group chat

No comments yet. Start the conversation.