English
Related papers

Related papers: A Multi-Resolution Benchmark Framework for Spatial…

200 papers

The study of neurocognitive tasks requiring accurate localisation of activity often rely on functional Magnetic Resonance Imaging, a widely adopted technique that makes use of a pipeline of data processing modules, each involving a variety…

Computer Vision and Pattern Recognition · Computer Science 2016-10-14 Albert Vilamala , Kristoffer Hougaard Madsen , Lars Kai Hansen

Human-level agentic intelligence extends beyond low-level geometric perception, evolving from recognizing where things are to understanding what they are for. While existing benchmarks effectively evaluate the geometric perception…

3D spatial reasoning is the ability to analyze and interpret the positions, orientations, and spatial relationships of objects within the 3D space. This allows models to develop a comprehensive understanding of the 3D scene, enabling their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Wufei Ma , Haoyu Chen , Guofeng Zhang , Yu-Cheng Chou , Jieneng Chen , Celso M de Melo , Alan Yuille

For human cognitive process, spatial reasoning and perception are closely entangled, yet the nature of this interplay remains underexplored in the evaluation of multimodal large language models (MLLMs). While recent MLLM advancements show…

Computation and Language · Computer Science 2025-08-28 Chengzu Li , Wenshan Wu , Huanyu Zhang , Qingtao Li , Zeyu Gao , Yan Xia , José Hernández-Orallo , Ivan Vulić , Furu Wei

Spatial reasoning is an important component of human intelligence. We can imagine the shapes of 3D objects and reason about their spatial relations by merely looking at their three-view line drawings in 2D, with different levels of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Wenyu Han , Siyuan Xiang , Chenhui Liu , Ruoyu Wang , Chen Feng

Spatial reasoning is a fundamental capability of multimodal large language models (MLLMs), yet their performance in open aerial environments remains underexplored. In this work, we present Open3D-VQA, a novel benchmark for evaluating MLLMs'…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Weichen Zhang , Zile Zhou , Xin Zeng , Xuchen Liu , Jianjie Fang , Chen Gao , Yong Li , Jinqiang Cui , Xinlei Chen , Xiao-Ping Zhang

Despite significant advances in vision-language understanding, implementing image segmentation within multimodal architectures remains a fundamental challenge in modern artificial intelligence systems. Existing vision-language models, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Joongwon Chae , Zhenyu Wang , Peiwu Qin

The ability to understand and reason about spatial relationships between objects in images is an important component of visual reasoning. This skill rests on the ability to recognize and localize objects of interest and determine their…

Computation and Language · Computer Science 2024-10-14 Navid Rajabi , Jana Kosecka

Bridging continuous perceptual signals and discrete symbolic reasoning is a fundamental challenge in AI systems that must operate under uncertainty. We present a neuro-symbolic framework that explicitly models and propagates uncertainty…

Artificial Intelligence · Computer Science 2025-11-19 Jiahao Wu , Shengwen Yu

Spatial reasoning remains a fundamental challenge for Vision-Language Models (VLMs), with current approaches struggling to achieve robust performance despite recent advances. We identify that this limitation stems from a critical gap:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Hongxing Li , Dingming Li , Zixuan Wang , Yuchen Yan , Hang Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu , Jun Xiao , Yueting Zhuang

We introduce STSBench, a scenario-based framework to benchmark the holistic understanding of vision-language models (VLMs) for autonomous driving. The framework automatically mines pre-defined traffic scenarios from any dataset using…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Christian Fruhwirth-Reisinger , Dušan Malić , Wei Lin , David Schinagl , Samuel Schulter , Horst Possegger

Recent advances in Multi-Modal Large Language Models (MLLMs) have enabled unified processing of language, vision, and structured inputs, opening the door to complex tasks such as logical deduction, spatial reasoning, and scientific…

Artificial Intelligence · Computer Science 2025-07-03 Guiyao Tie , Xueyang Zhou , Tianhe Gu , Ruihang Zhang , Chaoran Hu , Sizhe Zhang , Mengqu Sun , Yan Zhang , Pan Zhou , Lichao Sun

Recent advancements in Vision-Language Models (VLMs) have demonstrated strong potential for autonomous driving tasks. However, their spatial understanding and reasoning-key capabilities for autonomous driving-still exhibit significant…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Kexin Tian , Jingrui Mao , Yunlong Zhang , Jiwan Jiang , Yang Zhou , Zhengzhong Tu

Neural models and symbolic algorithms have recently been combined for tasks requiring both perception and reasoning. Neural models ground perceptual input into a conceptual vocabulary, on which a classical reasoning algorithm is applied to…

Artificial Intelligence · Computer Science 2021-06-08 Ananye Agarwal , Pradeep Shenoy , Mausam

While Multimodal Large Language Models (MLLMs) have achieved impressive performance on semantic tasks, their spatial intelligence--crucial for robust and grounded AI systems--remains underdeveloped. Existing benchmarks fall short of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Mingrui Wu , Zhaozhi Wang , Fangjinhua Wang , Jiaolong Yang , Marc Pollefeys , Tong Zhang

Large language models (LLMs) and vision language models (VLMs), such as DeepSeek R1,OpenAI o3, and Gemini 2.5 Pro, have demonstrated remarkable reasoning capabilities across logical inference, problem solving, and decision making. However,…

Artificial Intelligence · Computer Science 2025-11-19 Xiaoxing Lian , Aidong Yang , Jun Zhu , Peng Wang , Yue Zhang

Spatial reasoning and visual grounding are core capabilities for vision-language models (VLMs), yet most medical VLMs produce predictions without transparent reasoning or spatial evidence. Existing benchmarks also evaluate VLMs on isolated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Lama Moukheiber , Caleb M. Yeung , Haotian Xue , Alec Helbling , Zelin Zhao , Yongxin Chen

Obtaining large-scale, high-quality reasoning data is crucial for improving the geometric reasoning capabilities of multi-modal large language models (MLLMs). However, existing data generation methods, whether based on predefined tem plates…

Computation and Language · Computer Science 2025-10-06 Weiming Wu , Jin Ye , Zi-kang Wang , Zhi Zhou , Yu-Feng Li , Lan-Zhe Guo

We consider the abstract relational reasoning task, which is commonly used as an intelligence test. Since some patterns have spatial rationales, while others are only semantic, we propose a multi-scale architecture that processes each query…

Artificial Intelligence · Computer Science 2021-07-28 Yaniv Benny , Niv Pekar , Lior Wolf

Spatial reasoning has emerged as a critical capability for Multimodal Large Language Models (MLLMs), drawing increasing attention and rapid advancement. However, existing benchmarks primarily focus on single-step perception-to-judgment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Rui Zhu , Xin Shen , Shuchen Wu , Chenxi Miao , Xin Yu , Yang Li , Weikang Li , Deguo Xia , Jizhou Huang