English

Pursuing Minimal Sufficiency in Spatial Reasoning

Computer Vision and Pattern Recognition 2026-03-06 v2 Artificial Intelligence

Abstract

Spatial reasoning, the ability to ground language in 3D understanding, remains a persistent challenge for Vision-Language Models (VLMs). We identify two fundamental bottlenecks: inadequate 3D understanding capabilities stemming from 2D-centric pre-training, and reasoning failures induced by redundant 3D information. To address these, we first construct a Minimal Sufficient Set (MSS) of information before answering a given question: a compact selection of 3D perception results from \textit{expert models}. We introduce MSSR (Minimal Sufficient Spatial Reasoner), a dual-agent framework that implements this principle. A Perception Agent programmatically queries 3D scenes using a versatile perception toolbox to extract sufficient information, including a novel SOG (Situated Orientation Grounding) module that robustly extracts language-grounded directions. A Reasoning Agent then iteratively refines this information to pursue minimality, pruning redundant details and requesting missing ones in a closed loop until the MSS is curated. Extensive experiments demonstrate that our method, by explicitly pursuing both sufficiency and minimality, significantly improves accuracy and achieves state-of-the-art performance across two challenging benchmarks. Furthermore, our framework produces interpretable reasoning paths, offering a promising source of high-quality training data for future models. Source code is available at https://github.com/gyj155/mssr.

Keywords

Cite

@article{arxiv.2510.16688,
  title  = {Pursuing Minimal Sufficiency in Spatial Reasoning},
  author = {Yejie Guo and Yunzhong Hou and Wufei Ma and Meng Tang and Ming-Hsuan Yang},
  journal= {arXiv preprint arXiv:2510.16688},
  year   = {2026}
}
R2 v1 2026-07-01T06:45:26.656Z