English
Related papers

Related papers: Skill-Conditioned Visual Geolocation for Vision-La…

200 papers

Geospatial reasoning requires solving image-grounded problems over the complex spatial structure of a scene. However, developing this capability is hindered by the cost of annotating a vast and combinatorial question space. We propose GeoX,…

Artificial Intelligence · Computer Science 2026-05-20 Kyeongjin Ahn , Seungeon Lee , Krishna P. Gummadi , Meeyoung Cha

We present DyNaVLM, an end-to-end vision-language navigation framework using Vision-Language Models (VLM). In contrast to prior methods constrained by fixed angular or distance intervals, our system empowers agents to freely select…

Robotics · Computer Science 2025-06-19 Zihe Ji , Huangxuan Lin , Yue Gao

Recent advances in legged locomotion learning are still dominated by the utilization of geometric representations of the environment, limiting the robot's capability to respond to higher-level semantics such as human instructions. To…

Robotics · Computer Science 2026-02-12 I Made Aswin Nahrendra , Seunghyun Lee , Dongkyu Lee , Hyun Myung

Robots trained via Reinforcement Learning (RL) or Imitation Learning (IL) often adapt slowly to new tasks, whereas recent Large Language Models (LLMs) and Vision-Language Models (VLMs) promise knowledge-rich planning from minimal data.…

Recent advancements in Large Language Models (LLMs) and their multimodal extensions (MLLMs) have substantially enhanced machine reasoning across diverse tasks. However, these models predominantly rely on pure text as the medium for both…

Machine Learning · Computer Science 2026-02-23 Yi Xu , Chengzu Li , Han Zhou , Xingchen Wan , Caiqi Zhang , Anna Korhonen , Ivan Vulić

The prevailing paradigm of perceptive humanoid locomotion relies heavily on active depth sensors. However, this depth-centric approach fundamentally discards the rich semantic and dense appearance cues of the visual world, severing…

Robotics · Computer Science 2026-03-10 Yufei Liu , Xieyuanli Chen , Hainan Pan , Chenghao Shi , Yanjie Chen , Kaihong Huang , Zhiwen Zeng , Huimin Lu

Geospatial Knowledge Graphs (GeoKGs) model geoentities (e.g., places and natural features) and spatial relationships in an interconnected manner, providing strong knowledge support for geographic applications, including data retrieval,…

Artificial Intelligence · Computer Science 2024-10-25 Lei Hu , Wenwen Li , Yunqiang Zhu

Geolocation, the task of identifying an image's location, requires complex reasoning and is crucial for navigation, monitoring, and cultural preservation. However, current methods often produce coarse, imprecise, and non-interpretable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Zirui Song , Jingpu Yang , Yuan Huang , Jonathan Tonglet , Zeyu Zhang , Tao Cheng , Meng Fang , Iryna Gurevych , Xiuying Chen

Visual geo-localization demands in-depth knowledge and advanced reasoning skills to associate images with precise real-world geographic locations. Existing image database retrieval methods are limited by the impracticality of storing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Xiao Han , Chen Zhu , Xiangyu Zhao , Hengshu Zhu

Image geolocalization, the task of determining an image's geographic origin, poses significant challenges, largely due to visual similarities across disparate locations and the large search space. To address these issues, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Narges Ghasemi , Amir Ziashahabi , Salman Avestimehr , Cyrus Shahabi

Recent advances in MLLMs are reframing segmentation from fixed-category prediction to instruction-grounded localization. While reasoning based segmentation has progressed rapidly in natural scenes, remote sensing lacks a generalizable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Lifan Jiang , Yuhang Pei , oxi Wu , Yan Zhao , Tianrun Wu , Shulong Yu , Lihui Zhang , Deng Cai

A key goal for the advancement of AI is to develop technologies that serve the needs not just of one group but of all communities regardless of their geographical region. In fact, a significant proportion of knowledge is locally shared by…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Da Yin , Feng Gao , Govind Thattai , Michael Johnston , Kai-Wei Chang

Vision-language models (VLMs) are impactful in part because they can be applied to a variety of visual understanding tasks in a zero-shot fashion, without any fine-tuning. We study $\textit{generative VLMs}$ that are trained for next-word…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Zhiqiu Lin , Xinyue Chen , Deepak Pathak , Pengchuan Zhang , Deva Ramanan

Vision-language models (VLMs) have shown strong performance on static visual understanding, yet they still struggle with dynamic spatial reasoning that requires imagining how scenes evolve under egocentric motion. Recent efforts address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wanyue Zhang , Wenxiang Wu , Wang Xu , Jiaxin Luo , Helu Zhi , Yibin Huang , Shuo Ren , Zitao Liu , Jiajun Zhang

Vision Language Models (VLMs) have recently achieved significant progress in bridging visual perception and linguistic reasoning. Recently, OpenAI o3 model introduced a zoom-in search strategy that effectively elicits active perception…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Wanfu Wang , Qipeng Huang , Guangquan Xue , Xiaobo Liang , Juntao Li

In this paper, we propose a training-free framework for vision-and-language navigation (VLN). Existing zero-shot VLN methods are mainly designed for discrete environments or involve unsupervised training in continuous simulator…

Robotics · Computer Science 2025-09-15 Hang Yin , Haoyu Wei , Xiuwei Xu , Wenxuan Guo , Jie Zhou , Jiwen Lu

Despite the impressive performance of Large Language Models (LLM) for various natural language processing tasks, little is known about their comprehension of geographic data and related ability to facilitate informed geospatial…

Computation and Language · Computer Science 2023-10-23 Prabin Bhandari , Antonios Anastasopoulos , Dieter Pfoser

Vision-Language Foundation Models (VLFMs) have made remarkable progress on various multimodal tasks, such as image captioning, image-text retrieval, visual question answering, and visual grounding. However, most methods rely on training…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yue Zhou , Zhihang Zhong , Xue Yang

Vision-language models (VLMs) demonstrate strong image-level scene understanding but often lack persistent memory, explicit spatial representations, and computational efficiency when reasoning over long video sequences. We present VL-KnG, a…

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…