English

Cube Bench: A Benchmark for Spatial Visual Reasoning in MLLMs

Computation and Language 2025-12-24 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

We introduce Cube Bench, a Rubik's-cube benchmark for evaluating spatial and sequential reasoning in multimodal large language models (MLLMs). The benchmark decomposes performance into five skills: (i) reconstructing cube faces from images and text, (ii) choosing the optimal next move, (iii) predicting the outcome of a candidate move without applying it, (iv) executing multi-step plans while recovering from mistakes, and (v) detecting and revising one's own errors. Using a shared set of scrambled cube states, identical prompts and parsers, and a single distance-to-solved metric, we compare recent MLLMs side by side as a function of scramble depth. Across seven MLLMs, accuracy drops sharply with depth; once a trajectory stalls or diverges, models rarely recover, and high face-reconstruction accuracy does not guarantee competent action selection or multi-step execution. A pronounced closed- vs open-source gap emerges: the strongest closed model leads on both single-step perception tasks and multi-step control tasks, while open-weight models cluster near chance on the hardest settings; yet even the best MLLM degrades at higher cube complexity. A simple self-correction via reflective thinking yields modest gains but can also introduce overthinking. Cube Bench offers a compact, reproducible probe of sequential spatial reasoning in MLLMs.

Keywords

Cite

@article{arxiv.2512.20595,
  title  = {Cube Bench: A Benchmark for Spatial Visual Reasoning in MLLMs},
  author = {Dhruv Anand and Ehsan Shareghi},
  journal= {arXiv preprint arXiv:2512.20595},
  year   = {2025}
}

Comments

27 pages, 5 figures, 9 tables. Cube available at https://github.com/dana-23/cube-bench

R2 v1 2026-07-01T08:38:57.775Z