Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

DominoBench

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. DominoBench Tests AI’s Physical Reasoning from Still Images

    Emilio Ferrara’s paper introduces DominoBench, a benchmark for testing whether vision-language models can predict outcomes in 2D rigid-body scenes from still images. It contains 854 items in 427 minimal pairs, with outcomes computed by a physics simulator and a four-level hint ladder ending in the decisive calculation. Tests of 30 models from 10 families found that unaided models did not predict outcomes reliably. Frontier models reached at most 72% accuracy for the person whose fate changes and 34% when both members of a pair had to be correct.

    Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my DominoBench experienceAsk about DominoBench

Nobody has shared their experience with DominoBench yet.