English
Related papers

Related papers: Fine-Grained Instruction-Guided Graph Reasoning fo…

200 papers

Visual language navigation (VLN) is one of the important research in embodied AI. It aims to enable an agent to understand the surrounding environment and complete navigation tasks. VLN instructions could be categorized into coarse-grained…

Information Retrieval · Computer Science 2024-08-06 Zhao Kaichen , Song Yaoxian , Zhao Haiquan , Liu Haoyu , Li Tiefeng , Li Zhixu

This paper addresses the challenge of fine-grained alignment in Vision-and-Language Navigation (VLN) tasks, where robots navigate realistic 3D environments based on natural language instructions. Current approaches use contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yuhang Song , Mario Gianni , Chenguang Yang , Kunyang Lin , Te-Chuan Chiu , Anh Nguyen , Chun-Yi Lee

UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous multi-step instructions over long horizons. Existing zero-shot methods remain limited, as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dian Shao , Zhengzheng Xu , Peiyang Wang , Like Liu , Yule Wang , Jieqi Shi , Jing Huo

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions fails to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Weixi Feng , Tsu-Jui Fu , Yujie Lu , William Yang Wang

Vision-Language Navigation (VLN) is a core challenge in embodied AI, requiring agents to navigate real-world environments using natural language instructions. Current language model-based navigation systems operate on discrete topological…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Zhangyang Qi , Zhixiong Zhang , Yizhou Yu , Jiaqi Wang , Hengshuang Zhao

This study presents a novel evaluation framework for the Vision-Language Navigation (VLN) task. It aims to diagnose current models for various instruction categories at a finer-grained level. The framework is structured around the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zehao Wang , Minye Wu , Yixin Cao , Yubo Ma , Meiqi Chen , Tinne Tuytelaars

In most existing embodied navigation tasks, instructions are well-defined and unambiguous, such as instruction following and object searching. Under this idealized setting, agents are required solely to produce effective navigation outputs…

Robotics · Computer Science 2026-01-26 Wensi Huang , Shaohao Zhu , Meng Wei , Jinming Xu , Xihui Liu , Hanqing Wang , Tai Wang , Feng Zhao , Jiangmiao Pang

Vision-Language Navigation (VLN) enables intelligent agents to navigate environments by integrating visual perception and natural language instructions, yet faces significant challenges due to the scarcity of fine-grained cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Yibo Cui , Liang Xie , Yu Zhao , Jiawei Sun , Erwei Yin

Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities. However, mainstream Vision-and-Language Navigation (VLN) tasks typically assume instructions…

Robotics · Computer Science 2024-08-01 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

Vision-Language Navigation (VLN) agents often struggle with long-horizon reasoning in unseen environments, particularly when facing ambiguous, coarse-grained instructions. While recent advances use knowledge graph to enhance reasoning, the…

Robotics · Computer Science 2026-03-02 Haoxuan Xu , Tianfu Li , Wenbo Chen , Yi Liu , Xingxing Zuo , Yaoxian Song , Haoang Li

Vision-and-language navigation requires an agent to navigate through a real 3D environment following natural language instructions. Despite significant advances, few previous works are able to fully utilize the strong correspondence between…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Yicong Hong , Cristian Rodriguez-Opazo , Qi Wu , Stephen Gould

Vision-Language Navigation (VLN) is a task where agents learn to navigate following natural language instructions. The key to this task is to perceive both the visual scene and natural language sequentially. Conventional approaches exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Fengda Zhu , Yi Zhu , Xiaojun Chang , Xiaodan Liang

Despite the success of Large Vision--Language Models (LVLMs), most existing architectures suffer from a representation bottleneck: they rely on static, instruction-agnostic vision encoders whose visual representations are utilized in an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hanpeng Liu , Yaqian Li , Zidan Wang , Shuoxi Zhang , Zihao Bo , Rinyoichi Takezoe , Kaiwen Long , Kun He

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

Robotics · Computer Science 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang

Vision-and-Language Navigation (VLN) has long been constrained by the limited diversity and scalability of simulator-curated datasets, which fail to capture the complexity of real-world environments. To overcome this limitation, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mingfei Han , Haihong Hao , Liang Ma , Kamila Zhumakhanova , Ekaterina Radionova , Jingyi Zhang , Xiaojun Chang , Xiaodan Liang , Ivan Laptev

Aerial Vision-and-Language Navigation (Aerial VLN) enables unmanned aerial vehicles (UAVs) to follow natural language instructions and navigate complex urban environments. While recent advances have achieved progress through large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuwei Ning , Ganlong Zhao , Yipeng Qin , Si Liu , Yang Liu , Liang Lin , Guanbin Li

Recent advances in Iterative Vision-and-Language Navigation (IVLN) introduce a more meaningful and practical paradigm of VLN by maintaining the agent's memory across tours of scenes. Although the long-term memory aligns better with the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Ganlong Zhao , Guanbin Li , Weikai Chen , Yizhou Yu

Vision-Language Navigation (VLN) requires an embodied agent to navigate complex environments by following natural language instructions, which typically demands tight fusion of visual and language modalities. Existing VLN methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Daojie Peng , Fulong Ma , Jun Ma

In this paper, we propose a training-free framework for vision-and-language navigation (VLN). Existing zero-shot VLN methods are mainly designed for discrete environments or involve unsupervised training in continuous simulator…

Robotics · Computer Science 2025-09-15 Hang Yin , Haoyu Wei , Xiuwei Xu , Wenxuan Guo , Jie Zhou , Jiwen Lu

Aerial Vision-and-Language Navigation (VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and navigate complex urban environments using onboard visual observation. This task holds promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Huilin Xu , Zhuoyang Liu , Yixiang Luomei , Feng Xu
‹ Prev 1 2 3 10 Next ›