RISEBench++

Headlines · 1

1. Oct 7
   New RISEBench++ benchmark: reasoning-informed visual editing still stumps top models

   An arXiv paper introduces RISEBench++, a benchmark for reasoning-informed visual editing that spans six reasoning dimensions — temporal, causal, spatial, logical, counterfactual and hybrid — decomposed into 12 subcategories and 65 fine-grained task types, with 1,000 human-annotated test cases released in English and Chinese. The authors also present RISE-Agent, a training-free agentic framework, and evaluate 58 visual editing approaches (34 open-source models, 19 closed-source models and 5 agentic methods); even the strongest, GPT-Image-2.5 Sunburst, reaches only 56.6% accuracy.

   Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my RISEBench++ experienceAsk about RISEBench++