Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

SpaceCast-Bench: Evaluating predictive spatial reasoning in VLMs

AI summary

The paper introduces SpaceCast-Bench, which the authors describe as the first benchmark to directly and diagnostically evaluate predictive spatial reasoning, where a model must construct a scene from observations, anticipate how an intervention changes it, and reason about the unseen outcome. Built around an observe-transform-infer framework, it contains 3,862 questions from 182 real-world scenes across 16 task types at three levels: static perception, local prediction, and global prediction. Evaluating 21 models shows the strongest reaching only 58.0% versus 87.2% human performance, while spatially specialized models remain near random chance; fine-tuning on programmatically generated data lifts Qwen3-VL-4B from 34.0% to 65.7% with macro-average gains on six out-of-domain benchmarks.

In-depth insight

The results indicate a substantial gap between current vision-language models and humans on anticipating unobserved spatial outcomes, offering a diagnostic tool for future spatial-intelligence research.

Computer Science > Computer Vision and Pattern Recognition

arXiv:2610.12402 (cs)

[Submitted on 8 Oct 2026]

Title:SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models

Authors:Hongxing Li, Jinyue Su, Dingming Li, Wenqi Zhang, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen

View a PDF of the paper titled SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models, by Hongxing Li and 7 other authors

#SpaceCast-Bench#Qwen3-VL-4B

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.