Emory University

Headlines · 1

1. Oct 31
   CLASHarness Benchmarks Multimodal Agents in Multi-Agent Conflicts

   A research consortium involving Google and six universities released CLASHarness, an open benchmark for testing 15 models when teammate reports conflict with system evidence. According to New Zhiyuan, its 600 executable tasks use high-resolution visual evidence and cover 20 domains; the report says no model exceeded a 30% end-to-end pass rate, with active verification and task handoff remaining major weaknesses. The generation pipeline, evaluation tasks, and an interactive trajectory viewer are available as open-source materials.

   新智元 · 🔥 0

Experience and discussion from the community

Share my Emory University experienceAsk about Emory University