English
Related papers

Related papers: World-Consistent Data Generation for Vision-and-La…

200 papers

Vision-and-Language Navigation (VLN) is an essential skill for embodied agents, allowing them to navigate in 3D environments following natural language instructions. High-performance navigation models require a large amount of training…

Artificial Intelligence · Computer Science 2025-03-10 Zihan Wang , Yaohui Zhu , Gim Hee Lee , Yachun Fan

In Vision-and-Language Navigation (VLN), an agent needs to navigate through the environment based on natural language instructions. Due to limited available data for agent training and finite diversity in navigation environments, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Jialu Li , Hao Tan , Mohit Bansal

Vision-and-Language Navigation (VLN) in continuous environments requires agents to interpret natural language instructions while navigating unconstrained 3D spaces. Existing VLN-CE frameworks rely on a two-stage approach: a waypoint…

Robotics · Computer Science 2025-06-18 Xiangyu Shi , Zerui Li , Wenqi Lyu , Jiatong Xia , Feras Dayoub , Yanyuan Qiao , Qi Wu

Vision-and-language navigation (VLN) is a task in which an agent is embodied in a realistic 3D environment and follows an instruction to reach the goal node. While most of the previous studies have built and investigated a discriminative…

Computation and Language · Computer Science 2020-10-09 Shuhei Kurita , Kyunghyun Cho

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in…

Unmanned Aerial Vehicle (UAV) Vision-and-Language Navigation (VLN) is vital for applications such as disaster response, logistics delivery, and urban inspection. However, existing methods often struggle with insufficient multimodal fusion,…

Computation and Language · Computer Science 2025-05-20 Hengxing Cai , Jinhan Dong , Jingjun Tan , Jingcheng Deng , Sihang Li , Zhifeng Gao , Haidong Wang , Zicheng Su , Agachai Sumalee , Renxin Zhong

Recent research in language-guided visual navigation has demonstrated a significant demand for the diversity of traversable environments and the quantity of supervision for training generalizable agents. To tackle the common data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Zun Wang , Jialu Li , Yicong Hong , Yi Wang , Qi Wu , Mohit Bansal , Stephen Gould , Hao Tan , Yu Qiao

Recently emerged Vision-and-Language Navigation (VLN) tasks have drawn significant attention in both computer vision and natural language processing communities. Existing VLN tasks are built for agents that navigate on the ground, either…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Shubo Liu , Hongsheng Zhang , Yuankai Qi , Peng Wang , Yaning Zhang , Qi Wu

Visual Language Navigation (VLN) is a fundamental task within the field of Embodied AI, focusing on the ability of agents to navigate complex environments based on natural language instructions. Despite the progress made by existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Ruoyu Wang , Tong Yu , Junda Wu , Yao Liu , Julian McAuley , Lina Yao

Remote sensing vision tasks require extensive labeled data across multiple, interconnected domains. However, current generative data augmentation frameworks are task-isolated, i.e., each vision task requires training an independent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Datao Tang , Hao Wang , Yudeng Xin , Hui Qiao , Dongsheng Jiang , Yin Li , Zhiheng Yu , Xiangyong Cao

Existing aerial Vision-Language Navigation (VLN) methods predominantly adopt a detection-and-planning pipeline, which converts open-vocabulary detections into discrete textual scene graphs. These approaches are plagued by inadequate spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haoyu Tong , Xiangyu Dong , Xiaoguang Ma , Haoran Zhao , Yaoming Zhou , Chenghao Lin

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

Robotics · Computer Science 2025-06-13 Yicheng Duan , Kaiyu tang

Vision-Language Navigation (VLN) requires an agent to navigate 3D environments following natural language instructions. During navigation, existing agents commonly encounter perceptual uncertainty, such as insufficient evidence for reliable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jianzhe Gao , Rui Liu , Yuxuan Xu , Tongtong Cao , Yingxue Zhang , Zhanguang Zhang , Sida Peng , Yi Yang , Wenguan Wang

Object Goal Navigation-requiring an agent to locate a specific object in an unseen environment-remains a core challenge in embodied AI. Although recent progress in Vision-Language Model (VLM)-based agents has demonstrated promising…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dujun Nie , Xianda Guo , Yiqun Duan , Ruijun Zhang , Long Chen

Vision-and-language navigation (VLN) aims to develop agents capable of navigating in realistic environments. While recent cross-modal training approaches have significantly improved navigation performance in both indoor and outdoor…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jungdae Lee , Taiki Miyanishi , Shuhei Kurita , Koya Sakamoto , Daichi Azuma , Yutaka Matsuo , Nakamasa Inoue

Vision-Language Navigation (VLN) is a task where agents learn to navigate following natural language instructions. The key to this task is to perceive both the visual scene and natural language sequentially. Conventional approaches exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Fengda Zhu , Yi Zhu , Xiaojun Chang , Xiaodan Liang

Similar to vision-and-language navigation (VLN) tasks that focus on bridging the gap between vision and language for embodied navigation, the new Rendezvous (RVS) task requires reasoning over allocentric spatial relationships (independent…

Computation and Language · Computer Science 2024-07-01 Tzuf Paz-Argaman , John Palowitch , Sayali Kulkarni , Reut Tsarfaty , Jason Baldridge

A long-term goal of AI research is to build intelligent agents that can communicate with humans in natural language, perceive the environment, and perform real-world tasks. Vision-and-Language Navigation (VLN) is a fundamental and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jing Gu , Eliana Stefani , Qi Wu , Jesse Thomason , Xin Eric Wang

Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real…

Robotics · Computer Science 2026-03-19 Zhongyuang Liu , Min He , Shaonan Yu , Xinhang Xu , Muqing Cao , Jianping Li , Jianfei Yang , Lihua Xie

Vision-language navigation (VLN) requires an agent to traverse complex 3D environments based on natural language instructions, necessitating a thorough scene understanding. While existing works equip agents with various scene…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jianzhe Gao , Rui Liu , Wenguan Wang