English
Related papers

Related papers: Does Spatial Cognition Emerge in Frontier Models?

200 papers

Recent advancements in foundation models have improved autonomous tool usage and reasoning, but their capabilities in map-based reasoning remain underexplored. To address this, we introduce MapEval, a benchmark designed to assess foundation…

We explore the application of large language models (LLMs) to empower domain experts in integrating large, heterogeneous, and noisy urban spatial datasets. Traditional rule-based integration methods are unable to cover all edge cases,…

Artificial Intelligence · Computer Science 2025-08-08 Bin Han , Robert Wolfe , Anat Caspi , Bill Howe

Recent advancements in geographic information systems and mixed reality technologies have positioned spatial computing as a transformative paradigm in computational science. However, the field remains conceptually fragmented, with diverse…

Human-Computer Interaction · Computer Science 2025-09-01 Yibo Wang , Yuhan Luo , Janghee Cho , Junnan Yu

We introduce FrontierCS, a benchmark of 156 open-ended problems across diverse areas of computer science, designed and reviewed by experts, including CS PhDs and top-tier competitive programming participants and problem setters. Unlike…

Vision-language models (VLMs) have advanced rapidly, yet they still struggle with basic spatial reasoning. Despite strong performance on general benchmarks, modern VLMs remain brittle at understanding 2D spatial relationships such as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Nahid Alam , Leema Krishna Murali , Siddhant Bharadwaj , Patrick Liu , Timothy Chung , Drishti Sharma , Akshata A. , Kranthi Kiran , Wesley Tam , Bala Krishna S Vegesna

Increasing model size has unlocked a dazzling array of capabilities in modern language models. At the same time, even frontier models remain vulnerable to jailbreaks and prompt injections, despite concerted efforts to make them robust. As…

Machine Learning · Computer Science 2025-06-06 Nikolaus Howe , Ian McKenzie , Oskar Hollinsworth , Michał Zajac , Tom Tseng , Aaron Tucker , Pierre-Luc Bacon , Adam Gleave

While state-of-the-art large language models (LLMs) demonstrate advanced reasoning capabilities-achieving remarkable performance on challenging competitive math and coding benchmarks-they also frequently fail on tasks that are easy for…

Computation and Language · Computer Science 2025-07-11 Alan Malek , Jiawei Ge , Nevena Lazic , Chi Jin , András György , Csaba Szepesvári

While spatial foundation models have demonstrated impressive performance on standard datasets, a critical question remains: are they truly all-round players capable of generalizing robustly across diverse downstream tasks, arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Haosong Peng , Hao Li , Jiaqi Chen , Yuhao Pan , Runmao Yao , Yalun Dai , Fushuo Huo , Fangzhou Hong , Zhaoxi Chen , Haozhao Wang , Dingwen Zhang , Ziwei Liu , Wenchao Xu

We argue that progress in true multimodal intelligence calls for a shift from reactive, task-driven systems and brute-force long context towards a broader paradigm of supersensing. We frame spatial supersensing as four stages beyond…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Shusheng Yang , Jihan Yang , Pinzhi Huang , Ellis Brown , Zihao Yang , Yue Yu , Shengbang Tong , Zihan Zheng , Yifan Xu , Muhan Wang , Daohan Lu , Rob Fergus , Yann LeCun , Li Fei-Fei , Saining Xie

IQ testing has served as a foundational methodology for evaluating human cognitive capabilities, deliberately decoupling assessment from linguistic background, language proficiency, or domain-specific knowledge to isolate core competencies…

Artificial Intelligence · Computer Science 2025-06-05 Huanqia Cai , Yijun Yang , Winston Hu

The advancement of large language model (LLM) based agents has shifted AI evaluation from single-turn response assessment to multi-step task completion in interactive environments. We present an empirical study evaluating frontier AI models…

Artificial Intelligence · Computer Science 2026-01-15 Logan Ritchie , Sushant Mehta , Nick Heiner , Mason Yu , Edwin Chen

Understanding the spatial relations between objects in images is a surprisingly challenging task. A chair may be "behind" a person even if it appears to the left of the person in the image (depending on which way the person is facing). Two…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Kaiyu Yang , Olga Russakovsky , Jia Deng

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous…

Machine Learning · Statistics 2019-06-21 Atanas Mirchev , Baris Kayalibay , Maximilian Soelch , Patrick van der Smagt , Justin Bayer

Multimodal language models possess a remarkable ability to handle an open-vocabulary's worth of objects. Yet the best models still suffer from hallucinations when reasoning about scenes in the real world, revealing a gap between their…

Machine Learning · Computer Science 2025-11-07 Candace Ross , Florian Bordes , Adina Williams , Polina Kirichenko , Mark Ibrahim

Spatial confounding is a persistent challenge in spatial statistics, influencing the validity of statistical inference in models that analyze spatially-structured data. The concept has been interpreted in various ways but is broadly defined…

Multimodal large language models (MLLMs) are increasingly being applied to spatial cognition tasks, where they are expected to understand and interact with complex environments. Most existing works improve spatial reasoning by introducing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhenghao Chen , Huiqun Wang , Di Huang

Vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and reasoning about visual content, but significant challenges persist in tasks requiring cross-viewpoint understanding and spatial reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Dingming Li , Hongxing Li , Zixuan Wang , Yuchen Yan , Hang Zhang , Siqi Chen , Guiyang Hou , Shengpei Jiang , Wenqi Zhang , Yongliang Shen , Weiming Lu , Yueting Zhuang

Multimodal large language models (MLLMs) have advanced static visual--spatial reasoning, yet they often fail to preserve long-horizon spatial coherence in embodied settings where beliefs must be continuously revised from egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chih-Ting Liao , Xi Xiao , Chunlei Meng , Zhangquan Chen , Yitong Qiao , Weilin Zhou , Tianyang Wang , Xu Zheng , Xin Cao

Spatial cognition enables adaptive goal-directed behavior by constructing internal models of space. Robust biological systems consolidate spatial knowledge into three interconnected forms: \textit{landmarks} for salient cues, \textit{route…

Artificial Intelligence · Computer Science 2025-08-26 Shouwei Ruan , Liyuan Wang , Caixin Kang , Qihui Zhu , Songming Liu , Xingxing Wei , Hang Su

The cognitive framework of conceptual spaces bridges the gap between symbolic and subsymbolic AI by proposing an intermediate conceptual layer where knowledge is represented geometrically. There are two main approaches for obtaining the…

Machine Learning · Computer Science 2019-08-08 Lucas Bechberger , Elektra Kypridemou