English
Related papers

Related papers: From Pixels to Places: A Systematic Benchmark for …

200 papers

Large Vision-Language Models (VLMs) have demonstrated impressive performance on complex tasks involving visual input with natural language instructions. However, it remains unclear to what extent capabilities on natural images transfer to…

Computation and Language · Computer Science 2024-02-01 Chenhui Zhang , Sherrie Wang

Spatial relation reasoning is a crucial task for multimodal large language models (MLLMs) to understand the objective world. However, current benchmarks have issues like relying on bounding boxes, ignoring perspective substitutions, or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jingping Liu , Ziyan Liu , Zhedong Cen , Yan Zhou , Yinan Zou , Weiyan Zhang , Haiyun Jiang , Tong Ruan

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

With the rapid advancement of Multimodal Large Language Models (MLLMs), a variety of benchmarks have been introduced to evaluate their capabilities. While most evaluations have focused on complex tasks such as scientific comprehension and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Huan Liu , Lingyu Xiao , Jiangjiang Liu , Xiaofan Li , Ze Feng , Sen Yang , Jingdong Wang

Pretrained language models (PLMs) often fail to fairly represent target users from certain world regions because of the under-representation of those regions in training datasets. With recent PLMs trained on enormous data sources,…

Computation and Language · Computer Science 2022-12-21 Fahim Faisal , Antonios Anastasopoulos

This thesis introduces "Embodied Spatial Intelligence" to address the challenge of creating robots that can perceive and act in the real world based on natural language instructions. To bridge the gap between Large Language Models (LLMs)…

Robotics · Computer Science 2025-09-03 Jiading Fang

Multimodal large language models (MLLMs) have shown remarkable capabilities across a broad range of tasks but their knowledge and abilities in the geographic and geospatial domains are yet to be explored, despite potential wide-ranging…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jonathan Roberts , Timo Lüddecke , Rehan Sheikh , Kai Han , Samuel Albanie

Predicting the locations an individual will visit in the future is crucial for solving many societal issues like disease diffusion and reduction of pollution. However, next-location predictors require a significant amount of…

Computers and Society · Computer Science 2024-08-26 Ciro Beneduce , Bruno Lepri , Massimiliano Luca

Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in tasks such as code and mathematics. However, their potential to internalize structured spatial knowledge remains underexplored. This study investigates…

Computation and Language · Computer Science 2025-05-28 Sirui Xia , Aili Chen , Xintao Wang , Tinghui Zhu , Yikai Zhang , Jiangjie Chen , Yanghua Xiao

With the continuous advancement of large language models (LLMs), it is essential to create new benchmarks to effectively evaluate their expanding capabilities and identify areas for improvement. This work focuses on multi-image reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Mehran Kazemi , Nishanth Dikkala , Ankit Anand , Petar Devic , Ishita Dasgupta , Fangyu Liu , Bahare Fatemi , Pranjal Awasthi , Dee Guo , Sreenivas Gollapudi , Ahmed Qureshi

Geo-localization aims to infer the geographic origin of a given signal. In computer vision, geo-localization has served as a demanding benchmark for compositional reasoning and is relevant to public safety. In contrast, progress on audio…

Sound · Computer Science 2026-01-07 Ruixing Zhang , Zihan Liu , Leilei Sun , Tongyu Zhu , Weifeng Lv

The application of machine learning (ML) in a range of geospatial tasks is increasingly common but often relies on globally available covariates such as satellite imagery that can either be expensive or lack predictive power. Here we…

Computation and Language · Computer Science 2024-02-27 Rohin Manvi , Samar Khanna , Gengchen Mai , Marshall Burke , David Lobell , Stefano Ermon

Spatial commonsense, the knowledge about spatial position and relationship between objects (like the relative size of a lion and a girl, and the position of a boy relative to a bicycle when cycling), is an important part of commonsense…

Computation and Language · Computer Science 2022-04-28 Xiao Liu , Da Yin , Yansong Feng , Dongyan Zhao

Georeferencing text documents has typically relied on either gazetteer-based methods to assign geographic coordinates to place names, or on language modelling approaches that associate textual terms with geographic locations. However, many…

Artificial Intelligence · Computer Science 2026-01-26 Aneesha Fernando , Surangika Ranathunga , Kristin Stock , Raj Prasanna , Christopher B. Jones

Multimodal Large Language Models (MLLMs) have recently shown promising progress in geospatial reasoning. However, existing remote sensing benchmarks remain largely 2D-centric, evaluating models primarily on optical appearance. In natural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jing Huang , Duanchu Wang , Junjie Yang , Zihang Cheng , Cheng Li , Lin Cui , Zhouyi Wu , Di Wang

Moving beyond traditional surveys, combining heterogeneous data sources with AI-driven inference models brings new opportunities to measure socio-economic conditions, such as poverty and population, over expansive geographic areas. The…

Computers and Society · Computer Science 2024-06-17 Sungwon Han , Donghyun Ahn , Seungeon Lee , Minhyuk Song , Sungwon Park , Sangyoon Park , Jihee Kim , Meeyoung Cha

This paper presents a new approach for the challenging problem of geo-locating an image using image matching in a structured database of city-wide reference images with known GPS coordinates. We cast the geo-localization as a clustering…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Eyasu Zemene , Yonatan Tariku , Haroon Idrees , Andrea Prati , Marcello Pelillo , Mubarak Shah

The 180x360 omnidirectional field of view captured by 360-degree cameras enables their use in a wide range of applications such as embodied AI and virtual reality. Although recent advances in multimodal large language models (MLLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihao Dongfang , Xu Zheng , Ziqiao Weng , Yuanhuiyi Lyu , Danda Pani Paudel , Luc Van Gool , Kailun Yang , Xuming Hu

Recent advances in multimodal large language models (MLLMs) have led to impressive progress across various benchmarks. However, their capability in understanding infrared images remains unexplored. To address this gap, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tao Zhang , Yuyang Hong , Yang Xia , Kun Ding , Zeyu Zhang , Ying Wang , Shiming Xiang , Chunhong Pan

This paper explores the spatial reasoning capability of large language models (LLMs) over textual input through a suite of five tasks aimed at probing their spatial understanding and computational abilities. The models were tested on both…

Computation and Language · Computer Science 2025-10-24 Maggie Bai , Ava Kim Cohen , Eleanor Koss , Charlie Lichtenbaum