English
Related papers

Related papers: MapEval: A Map-Based Evaluation of Geo-Spatial Rea…

200 papers

A growing body of research runs human subject evaluations to study whether providing users with explanations of machine learning models can help them with practical real-world use cases. However, running user studies is challenging and…

Human-Computer Interaction · Computer Science 2022-08-23 Valerie Chen , Nari Johnson , Nicholay Topin , Gregory Plumb , Ameet Talwalkar

Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Prasham Titiya , Jainil Trivedi , Chitta Baral , Vivek Gupta

Spatiotemporal intelligence in autonomous driving (AD) requires an agent to integrate multi-view observations into a coherent scene representation, maintain object continuity across viewpoints and time, and reason about spatial relations,…

Recent progress in self-supervision has shown that pre-training large neural networks on vast amounts of unsupervised data can lead to substantial increases in generalization to downstream tasks. Such models, recently coined foundation…

Precise spatial understanding in Earth Observation is essential for translating raw aerial imagery into actionable insights for critical applications like urban planning, environmental monitoring and disaster management. However, Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Roger Ferrod , Maël Lecene , Krishna Sapkota , George Leifman , Vered Silverman , Genady Beryozkin , Sylvain Lobry

Spatial reasoning is central to navigation and robotics, yet measuring model capabilities on these tasks remains difficult. Existing benchmarks evaluate models in a one-shot setting, requiring full solution generation in a single response,…

Artificial Intelligence · Computer Science 2026-04-13 Lars Benedikt Kaesberg , Tianyu Yang , Niklas Bauer , Terry Ruas , Jan Philip Wahle , Bela Gipp

Foundation models have shown remarkable performance across diverse tasks, yet their ability to construct internal spatial world models for reasoning and planning remains unclear. We systematically evaluate the spatial understanding of large…

Artificial Intelligence · Computer Science 2026-04-14 Weijiang Li , Yilin Zhu , Rajarshi Das , Parijat Dube

Vision systems to see and reason about the compositional nature of visual scenes are fundamental to understanding our world. The complex relations between objects and their locations, ambiguities, and variations in the real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Muhammad Awais , Muzammal Naseer , Salman Khan , Rao Muhammad Anwer , Hisham Cholakkal , Mubarak Shah , Ming-Hsuan Yang , Fahad Shahbaz Khan

Artificial intelligence (AI) has made remarkable progress across various domains, with large language models like ChatGPT gaining substantial attention for their human-like text-generation capabilities. Despite these achievements, spatial…

Artificial Intelligence · Computer Science 2024-01-11 Fangjun Li , David C. Hogg , Anthony G. Cohn

Spatial reasoning is a core component of human cognition, enabling individuals to perceive, comprehend, and interact with the physical world. It relies on a nuanced understanding of spatial structures and inter-object relationships, serving…

Artificial Intelligence · Computer Science 2025-08-27 Zesen Lyu , Dandan Zhang , Wei Ye , Fangdi Li , Zhihang Jiang , Yao Yang

Evaluating the symbolic reasoning of large language models (LLMs) calls for geometry benchmarks that require multi-step proofs grounded in both text and diagrams. However, existing benchmarks are often limited in scale and rarely provide…

Computation and Language · Computer Science 2026-03-23 Yushun Zhang , Weiping Fu , Zesheng Yang , Bo Zhao , Lingling Zhang , Jian Zhang , Yumeng Fu , Jiaxing Huang , Jun Liu

Text-to-image (T2I) models have achieved remarkable success in generating high-fidelity images, but they often fail in handling complex spatial relationships, e.g., spatial perception, reasoning, or interaction. These critical aspects are…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zengbin Wang , Xuecai Hu , Yong Wang , Feng Xiong , Man Zhang , Xiangxiang Chu

Humans possess spatial reasoning abilities that enable them to understand spaces through multimodal observations, such as vision and sound. Large multimodal reasoning models extend these abilities by learning to perceive and reason, showing…

Significant progress in the development of highly adaptable and reusable Artificial Intelligence (AI) models is expected to have a significant impact on Earth science and remote sensing. Foundation models are pre-trained on large unlabeled…

CAPTCHA, originally designed to distinguish humans from robots, has evolved into a real-world benchmark for assessing the spatial reasoning capabilities of vision-language models. In this work, we first show that step-by-step reasoning is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Python Song , Luke Tenyi Chang , Yun-Yun Tsai , Penghui Li , Junfeng Yang

In recent years we have seen substantial advances in foundation models for artificial intelligence, including language, vision, and multimodal models. Recent studies have highlighted the potential of using foundation models in geospatial…

Artificial Intelligence · Computer Science 2023-10-13 Jinmeng Rao , Song Gao , Gengchen Mai , Krzysztof Janowicz

Capturing human mobility is essential for modeling how people interact with and move through physical spaces, reflecting social behavior, access to resources, and dynamic spatial patterns. To support scalable and transferable analysis…

Artificial Intelligence · Computer Science 2025-06-18 Mohammad Hashemi , Andreas Zufle

Mathematical reasoning is critical for tasks such as precise distance and area computations, trajectory estimations, and spatial analysis in unmanned aerial vehicle (UAV) based remote sensing, yet current vision-language models (VLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yue Zhou , Litong Feng , Mengcheng Lan , Xue Yang , Qingyun Li , Yiping Ke , Xue Jiang , Wayne Zhang

Spatial Planning is a crucial part in the field of spatial intelligence, which requires the understanding and planning about object arrangements in space perspective. AI agents with the spatial planning ability can better adapt to various…

Artificial Intelligence · Computer Science 2025-09-30 Ziming Wei , Bingqian Lin , Zijian Jiao , Yunshuang Nie , Liang Ma , Yuecheng Liu , Yuzheng Zhuang , Xiaodan Liang

Contemporary vision-language models (VLMs) perform well on existing multimodal reasoning benchmarks (78-85\% accuracy on MMMU, MathVista). Yet, these results fail to sufficiently distinguish true scientific reasoning articulation…

Computation and Language · Computer Science 2025-11-13 Arka Mukherjee , Shreya Ghosh