中文
相关论文

相关论文: Into the Unknown: Generating Geospatial Descriptio…

200 篇论文

Vision-Language Navigation (VLN) agents often struggle with long-horizon reasoning in unseen environments, particularly when facing ambiguous, coarse-grained instructions. While recent advances use knowledge graph to enhance reasoning, the…

机器人学 · 计算机科学 2026-03-02 Haoxuan Xu , Tianfu Li , Wenbo Chen , Yi Liu , Xingxing Zuo , Yaoxian Song , Haoang Li

Cross-view geo-localization identifies the locations of street-view images by matching them with geo-tagged satellite images or OSM. However, most existing studies focus on image-to-image retrieval, with fewer addressing text-guided…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Junyan Ye , Honglin Lin , Leyan Ou , Dairong Chen , Zihao Wang , Qi Zhu , Conghui He , Weijia Li

The choice of representation for geographic location significantly impacts the accuracy of models for a broad range of geospatial tasks, including fine-grained species classification, population density estimation, and biome classification.…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Aayush Dhakal , Srikumar Sastry , Subash Khanal , Adeel Ahmad , Eric Xing , Nathan Jacobs

Vision-and-Language Navigation (VLN) requires an agent to navigate in a real-world environment following natural language instructions. From both the textual and visual perspectives, we find that the relationships among the scene, its…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Yicong Hong , Cristian Rodriguez-Opazo , Yuankai Qi , Qi Wu , Stephen Gould

The application of Vision-Language Models (VLMs) in remote sensing (RS) has demonstrated significant potential in traditional tasks such as scene classification, object detection, and image captioning. However, current models, which excel…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Zilun Zhang , Haozhan Shen , Tiancheng Zhao , Bin Chen , Zian Guan , Yuhao Wang , Xu Jia , Yuxiang Cai , Yongheng Shang , Jianwei Yin

Vision-and-Language Navigation (VLN) requires an agent to navigate through complex unseen environments based on natural language instructions. However, existing methods often struggle to effectively capture key semantic cues and accurately…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Dongsheng Yang , Yinfeng Yu , Liejun Wang

Navigating unfamiliar environments presents significant challenges for blind and low-vision (BLV) individuals. In this work, we construct a dataset of images and goals across different scenarios such as searching through kitchens or…

计算与语言 · 计算机科学 2024-07-12 Zain Merchant , Abrar Anwar , Emily Wang , Souti Chattopadhyay , Jesse Thomason

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

Despite the impressive performance of Large Language Models (LLM) for various natural language processing tasks, little is known about their comprehension of geographic data and related ability to facilitate informed geospatial…

计算与语言 · 计算机科学 2023-10-23 Prabin Bhandari , Antonios Anastasopoulos , Dieter Pfoser

Vision-and-Language Navigation (VLN) is the task that requires an agent to navigate through the environment based on natural language instructions. At each step, the agent takes the next action by selecting from a set of navigable…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Jialu Li , Mohit Bansal

In vision-and-language navigation (VLN), an embodied agent is required to navigate in realistic 3D environments following natural language instructions. One major bottleneck for existing VLN approaches is the lack of sufficient training…

计算机视觉与模式识别 · 计算机科学 2022-08-26 Shizhe Chen , Pierre-Louis Guhur , Makarand Tapaswi , Cordelia Schmid , Ivan Laptev

Large language models(LLMs), with their powerful language generation and reasoning capabilities, have already achieved notable success in many domains, e.g., math and code generation. However, they often fall short when tackling real-life…

人工智能 · 计算机科学 2025-06-03 Jie Feng , Tianhui Liu , Yuwei Du , Siqi Guo , Yuming Lin , Yong Li

Maps are powerful carriers of structured and contextual knowledge, encompassing geography, demographics, infrastructure, and environmental patterns. Reasoning over such knowledge requires models to integrate spatial relationships, visual…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Sharat Bhat , Harshita Khandelwal , Tushar Kataria , Vivek Gupta

Vision-and-Language Navigation (VLN) requires the agent to follow language instructions to navigate through 3D environments. One main challenge in VLN is the limited availability of photorealistic training environments, which makes it hard…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Jialu Li , Mohit Bansal

Generating structured, editable diagrams remains a significant challenge for contemporary large language models, despite their proficiency in general-purpose vector code generation. The primary difficulty lies in the structural fragility of…

计算与语言 · 计算机科学 2026-05-26 Sifan Li , Yujun Cai , Hongkai Chen , Yiwei Wang

Indoor navigation presents unique challenges due to complex layouts and the unavailability of GNSS signals. Existing solutions often struggle with contextual adaptation, and typically require dedicated hardware. In this work, we explore the…

人工智能 · 计算机科学 2025-06-23 Alberto Coffrini , Paolo Barsocchi , Francesco Furfari , Antonino Crivello , Alessio Ferrari

Vision-Language Navigation (VLN) enables intelligent agents to navigate environments by integrating visual perception and natural language instructions, yet faces significant challenges due to the scarcity of fine-grained cross-modal…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Yibo Cui , Liang Xie , Yu Zhao , Jiawei Sun , Erwei Yin

Large language models (LLMs) encode vast world knowledge in their parameters, yet they remain fundamentally limited by static knowledge, finite context windows, and weakly structured causal reasoning. This survey provides a unified account…

计算与语言 · 计算机科学 2026-04-06 Prakhar Bansal , Shivangi Agarwal

Autonomous navigation in unknown environments requires multi-scale spatial understanding that captures geometric details, topological connectivity, and global structure to support high-level decision making under partial observability.…

机器人学 · 计算机科学 2026-04-22 Kuankuan Sima , Longbin Tang , Zhenyu Yang , Haozhe Ma , Lin Zhao

Data scarcity is a long-standing challenge in the Vision-Language Navigation (VLN) field, which extremely hinders the generalization of agents to unseen environments. Previous works primarily rely on additional simulator data or…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Ziming Wei , Bingqian Lin , Yunshuang Nie , Jiaqi Chen , Shikui Ma , Hang Xu , Xiaodan Liang