English
Related papers

Related papers: Where Do We Go from Here? Multi-scale Allocentric …

200 papers

Understanding spatial and visual information is essential for a navigation agent who follows natural language instructions. The current Transformer-based VLN agents entangle the orientation and vision information, which limits the gain from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yue Zhang , Parisa Kordjamshidi

Robots coexisting with humans in their environment and performing services for them need the ability to interact with them. One particular requirement for such robots is that they are able to understand spatial relations and can place…

Robotics · Computer Science 2020-02-24 Oier Mees , Alp Emek , Johan Vertens , Wolfram Burgard

The challenging task of Vision-and-Language Navigation (VLN) requires embodied agents to follow natural language instructions to reach a goal location or object (e.g. `walk down the hallway and turn left at the piano'). For agents to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Meera Hahn , Amit Raj , James M. Rehg

Representing relevant information of a traffic scene and understanding its environment is crucial for the success of autonomous driving. Modeling the surrounding of an autonomous car using semantic relations, i.e., how different traffic…

Artificial Intelligence · Computer Science 2022-12-07 Maximilian Zipfl , Felix Hertlein , Achim Rettinger , Steffen Thoma , Lavdim Halilaj , Juergen Luettin , Stefan Schmid , Cory Henson

When humans play geolocation games such as GeoGuessr, they rely on concrete visual cues, such as road markings, vegetation, or architectural details, to infer where an image was captured. Whether image geolocation models rely on similar…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Emilie Durrieu , Christophe Hurter , Philippe Muller , Victor Boutin

Capturing human mobility is essential for modeling how people interact with and move through physical spaces, reflecting social behavior, access to resources, and dynamic spatial patterns. To support scalable and transferable analysis…

Artificial Intelligence · Computer Science 2025-06-18 Mohammad Hashemi , Andreas Zufle

Navigation is an essential ability for mobile agents to be completely autonomous and able to perform complex actions. However, the problem of navigation for agents with limited (or no) perception of the world, or devoid of a fully defined…

Robotics · Computer Science 2020-11-30 Danilo Perico , Paulo E. Santos , Reinaldo Bianchi

Understanding how large language models (LLMs) represent and reason about spatial information is crucial for building robust agentic systems that can navigate real and simulated environments. In this work, we investigate the influence of…

Artificial Intelligence · Computer Science 2025-02-25 Nicolas Martorell

The navigation problem is classically approached in two steps: an exploration step, where map-information about the environment is gathered; and an exploitation step, where this information is used to navigate efficiently. Deep…

Robotics · Computer Science 2019-01-08 Vikas Dhiman , Shurjo Banerjee , Brent Griffin , Jeffrey M Siskind , Jason J Corso

An increasing amount of location-based service (LBS) data is being accumulated and helps to study urban dynamics and human mobility. GPS coordinates and other location indicators are normally low dimensional and only representing spatial…

Social and Information Networks · Computer Science 2022-10-11 Chenyu Tian , Yuchun Zhang , Zefeng Weng , Xiusen Gu , Wai Kin Victor Chan

Despite the impressive performance of Large Language Models (LLM) for various natural language processing tasks, little is known about their comprehension of geographic data and related ability to facilitate informed geospatial…

Computation and Language · Computer Science 2023-10-23 Prabin Bhandari , Antonios Anastasopoulos , Dieter Pfoser

The ability to transform location-centric geospatial data into meaningful computational representations has become fundamental to modern spatial analysis and decision-making. Geospatial Representation Learning (GRL), the process of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Xixuan Hao , Yutian Jiang , Xingchen Zou , Jiabo Liu , Yifang Yin , Song Gao , Flora Salim , Tianrui Li , Yuxuan Liang

This paper describes a framework for the object-goal navigation task, which requires a robot to find and move to the closest instance of a target object class from a random starting position. The framework uses a history of robot…

Knowledge discovery from GPS trajectory data is an important topic in several scientific areas, including data mining, human behavior analysis, and user modeling. This paper proposes a task that assigns personalized visited-POIs. Its goal…

Computers and Society · Computer Science 2019-12-04 Jun Suzuki , Yoshihiko Suhara , Hiroyuki Toda , Kyosuke Nishida

Large Vision Language Models (VLMs) have long struggled with spatial reasoning tasks. Surprisingly, even simple spatial reasoning tasks, such as recognizing "under" or "behind" relationships between only two objects, pose significant…

Computation and Language · Computer Science 2025-10-14 Shiqi Chen , Tongyao Zhu , Ruochen Zhou , Jinghan Zhang , Siyang Gao , Juan Carlos Niebles , Mor Geva , Junxian He , Jiajun Wu , Manling Li

Accurate road topology reasoning is critical for autonomous driving, as it requires both perceiving road elements and understanding how lanes connect to each other (L2L) and to traffic elements (L2T). Existing methods often focus on either…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yueru Luo , Changqing Zhou , Yiming Yang , Erlong Li , Chao Zheng , Shuqi Mei , Shuguang Cui , Zhen Li

Humans can interpret geospatial information through natural language, while the geospatial cognition capabilities of Large Language Models (LLMs) remain underexplored. Prior research in this domain has been constrained by non-quantifiable…

Vision-and-language navigation is one of the core tasks in embodied intelligence, requiring an agent to autonomously navigate in an unfamiliar environment based on natural language instructions. However, existing methods often fail to match…

Artificial Intelligence · Computer Science 2025-10-01 Dongsheng Yang , Meiling Zhu , Yinfeng Yu

Map representations learned by expert demonstrations have shown promising research value. However, the field of visual navigation still faces challenges due to the lack of real-world human-navigation datasets that can support efficient,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Faith Johnson , Bryan Bo Cao , Kristin Dana , Shubham Jain , Ashwin Ashok

Maps are powerful carriers of structured and contextual knowledge, encompassing geography, demographics, infrastructure, and environmental patterns. Reasoning over such knowledge requires models to integrate spatial relationships, visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Sharat Bhat , Harshita Khandelwal , Tushar Kataria , Vivek Gupta