English
Related papers

Related papers: UnitedVLN: Generalizable Gaussian Splatting for Co…

200 papers

In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Sonia Raychaudhuri , Saim Wani , Shivansh Patel , Unnat Jain , Angel X. Chang

Embodied navigation requires robots to understand and interact with the environment based on given tasks. Vision-Language Navigation (VLN) is an embodied navigation task, where a robot navigates within a previously seen and unseen…

Robotics · Computer Science 2024-09-10 Muraleekrishna Gopinathan , Jumana Abu-Khalaf , David Suter , Martin Masek

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

Robotics · Computer Science 2025-06-13 Yicheng Duan , Kaiyu tang

In Vision-and-Language Navigation (VLN), an embodied agent needs to reach a target destination with the only guidance of a natural language instruction. To explore the environment and progress towards the target location, the agent must…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Federico Landi , Lorenzo Baraldi , Massimiliano Corsini , Rita Cucchiara

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Vision-and-Language Navigation (VLN) in continuous environments requires agents to interpret natural language instructions while navigating unconstrained 3D spaces. Existing VLN-CE frameworks rely on a two-stage approach: a waypoint…

Robotics · Computer Science 2025-06-18 Xiangyu Shi , Zerui Li , Wenqi Lyu , Jiatong Xia , Feras Dayoub , Yanyuan Qiao , Qi Wu

Humans can collaborate and complete tasks based on visual signals and instruction from the environment. Training such a robot is difficult especially due to the understanding of the instruction and the complicated environment. Previous…

Artificial Intelligence · Computer Science 2023-05-12 Kairui Zhou

Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities. However, mainstream Vision-and-Language Navigation (VLN) tasks typically assume instructions…

Robotics · Computer Science 2024-08-01 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

Vision-Language Navigation (VLN) approaches have currently followed two primary paradigms: the end-to-end Vision-Language Model (VLM) policy fine-tuned on navigation trajectories to directly predict actions, and the zero-shot modular…

Robotics · Computer Science 2026-05-19 Jingzhi Huang , Junkai Huang , Wenxuan Song , Haoyang Yang , Hailong Huang , Haoang Li , Yi Wang

Vision-and-Language Navigation (VLN) is a challenging task that requires an agent to navigate through photorealistic environments following natural-language instructions. One main obstacle existing in VLN is data scarcity, leading to poor…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Yu Zhong , Rui Zhang , Zihao Zhang , Shuo Wang , Chuan Fang , Xishan Zhang , Jiaming Guo , Shaohui Peng , Di Huang , Yanyang Yan , Xing Hu , Qi Guo

Vision-and-language navigation (VLN) enables the agent to navigate to a remote location following the natural language instruction in 3D environments. To represent the previously visited environment, most approaches for VLN implement memory…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zihan Wang , Xiangyang Li , Jiahao Yang , Yeqi Liu , Shuqiang Jiang

Vision-Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Wansen Wu , Tao Chang , Xinmeng Li

Vision-and-Language Navigation (VLN) requires agents to follow long-horizon instructions and navigate complex 3D environments. However, existing approaches face two major challenges: constructing an effective long-term memory bank and…

Robotics · Computer Science 2026-03-27 Zihao Xin , Wentong Li , Yixuan Jiang , Bin Wang , Runmin Cong , Jie Qin , Shengjun Huang

Vision-and-Language Navigation (VLN) task aims to enable AI agents to accurately understand and follow natural language instructions to navigate through real-world environments, ultimately reaching specific target locations. We recognise a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Qi Chen , Dileepa Pitawela , Chongyang Zhao , Gengze Zhou , Hsiang-Ting Chen , Qi Wu

Unmanned Aerial Vehicles (UAVs) have emerged as versatile tools across various sectors, driven by their mobility and adaptability. This paper introduces SkyVLN, a novel framework integrating vision-and-language navigation (VLN) with…

Robotics · Computer Science 2025-07-10 Tianshun Li , Tianyi Huai , Zhen Li , Yichun Gao , Haoang Li , Xinhu Zheng

Vision-and-Language Navigation (VLN) has long been constrained by the limited diversity and scalability of simulator-curated datasets, which fail to capture the complexity of real-world environments. To overcome this limitation, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mingfei Han , Haihong Hao , Liang Ma , Kamila Zhumakhanova , Ekaterina Radionova , Jingyi Zhang , Xiaojun Chang , Xiaodan Liang , Ivan Laptev

Vision-and-Language Navigation (VLN) is a task where an agent navigates in an embodied indoor environment under human instructions. Previous works ignore the distribution of sample difficulty and we argue that this potentially degrade their…

Machine Learning · Computer Science 2021-11-16 Jiwen Zhang , Zhongyu Wei , Jianqing Fan , Jiajie Peng

Visual Language Navigation (VLN) is a fundamental task within the field of Embodied AI, focusing on the ability of agents to navigate complex environments based on natural language instructions. Despite the progress made by existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Ruoyu Wang , Tong Yu , Junda Wu , Yao Liu , Julian McAuley , Lina Yao

Vision-and-language navigation (VLN) is a long-standing challenge in autonomous robotics, aiming to empower agents with the ability to follow human instructions while navigating complex environments. Two key bottlenecks remain in this…

Robotics · Computer Science 2025-06-13 Yuhang Zhang , Haosheng Yu , Jiaping Xiao , Mir Feroskhan