English
Related papers

Related papers: Diagnosing the Environment Bias in Vision-and-Lang…

200 papers

Aerial vision-and-language navigation (VLN), requiring drones to interpret natural language instructions and navigate complex urban environments, emerges as a critical embodied AI challenge that bridges human-robot interaction, 3D spatial…

Robotics · Computer Science 2025-12-29 Weichen Zhang , Chen Gao , Shiquan Yu , Ruiying Peng , Baining Zhao , Qian Zhang , Jinqiang Cui , Xinlei Chen , Yong Li

Vision-and-Language Navigation (VLN) has gained increasing attention over recent years and many approaches have emerged to advance their development. The remarkable achievements of foundation models have shaped the challenges and proposed…

Computation and Language · Computer Science 2024-12-31 Yue Zhang , Ziqiao Ma , Jialu Li , Yanyuan Qiao , Zun Wang , Joyce Chai , Qi Wu , Mohit Bansal , Parisa Kordjamshidi

Autonomous navigation in highly constrained environments remains challenging for mobile robots. Classical navigation approaches offer safety assurances but require environment-specific parameter tuning; end-to-end learning bypasses…

Robotics · Computer Science 2026-03-11 Yuanjie Lu , Beichen Wang , Zhengqi Wu , Yang Li , Xiaomin Lin , Chengzhi Mao , Xuesu Xiao

Aerial Vision-and-Language Navigation (Aerial VLN) enables unmanned aerial vehicles (UAVs) to follow natural language instructions and navigate complex urban environments. While recent advances have achieved progress through large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuwei Ning , Ganlong Zhao , Yipeng Qin , Si Liu , Yang Liu , Liang Lin , Guanbin Li

Despite remarkable progress in Vision-Language Navigation (VLN), existing benchmarks remain confined to fixed, small-scale datasets with naive physical simulation. These shortcomings limit the insight that the benchmarks provide into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Sihao Lin , Zerui Li , Xunyi Zhao , Gengze Zhou , Liuyi Wang , Rong Wei , Rui Tang , Juncheng Li , Hanqing Wang , Jiangmiao Pang , Anton van den Hengel , Jiajun Liu , Qi Wu

Visual Language Navigation is a task that challenges robots to navigate in realistic environments based on natural language instructions. While previous research has largely focused on static settings, real-world navigation must often…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Dillon Loh , Tomasz Bednarz , Xinxing Xia , Frank Guan

Vision Language Navigation (VLN) requires agents to follow natural language instructions by grounding them in sequential visual observations over long horizons. Explicit reasoning could enhance temporal consistency and perception action…

Vision-and-language navigation (VLN), a frontier study aiming to pave the way for general-purpose robots, has been a hot topic in the computer vision and natural language processing community. The VLN task requires an agent to navigate to a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Yifeng Zhuang , Qiang Sun , Yanwei Fu , Lifeng Chen , Xiangyang Xue

Vision-and-Language Navigation (VLN) requires an agent to find a path to a remote location on the basis of natural-language instructions and a set of photo-realistic panoramas. Most existing methods take the words in the instructions and…

Computation and Language · Computer Science 2021-08-26 Yuankai Qi , Zizheng Pan , Yicong Hong , Ming-Hsuan Yang , Anton van den Hengel , Qi Wu

Vision-and-Language Navigation (VLN) is a challenging task where an agent is required to navigate to a natural language described location via vision observations. The navigation abilities of the agent can be enhanced by the relations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Bowen Huang , Yanwei Zheng , Chuanlin Lan , Xinpeng Zhao , Yifei Zou , Dongxiao yu

Vision-and-language navigation (VLN) is a long-standing challenge in autonomous robotics, aiming to empower agents with the ability to follow human instructions while navigating complex environments. Two key bottlenecks remain in this…

Robotics · Computer Science 2025-06-13 Yuhang Zhang , Haosheng Yu , Jiaping Xiao , Mir Feroskhan

Vision-Language Navigation (VLN) requires embodied agents to interpret natural language instructions and navigate through complex continuous 3D environments. However, the dominant imitation learning paradigm suffers from exposure bias,…

Robotics · Computer Science 2026-02-09 Gang He , Zhenyang Liu , Kepeng Xu , Li Xu , Tong Qiao , Wenxin Yu , Chang Wu , Weiying Xie

In this work, we propose a modular approach for the Vision-Language Navigation (VLN) task by decomposing the problem into four sub-modules that use state-of-the-art Large Language Models (LLMs) and Vision-Language Models (VLMs) in a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Navid Rajabi , Jana Kosecka

Vision-and-Language Navigation (VLN) is a challenging task in the field of artificial intelligence. Although massive progress has been made in this task over the past few years attributed to breakthroughs in deep vision and language models,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Wenda Qin , Teruhisa Misu , Derry Wijaya

Vision-Language Models (VLMs) have shown remarkable progress in Vision-Language Navigation (VLN), offering new possibilities for navigation decision-making that could benefit both robotic platforms and human users. However, real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Xia Su , Ruiqi Chen , Benlin Liu , Jingwei Ma , Zonglin Di , Ranjay Krishna , Jon Froehlich

Visual Language Navigation (VLN) powered robots have the potential to guide blind people by understanding route instructions provided by sighted passersby. This capability allows robots to operate in environments often unknown a prior.…

Robotics · Computer Science 2026-01-29 Masaki Kuribayashi , Kohei Uehara , Allan Wang , Daisuke Sato , Simon Chu , Shigeo Morishima

Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely on dense 3D reconstruction and hand-crafted goal metrics,…

Robotics · Computer Science 2026-05-18 Esteban Padilla-Cerdio , Boyang Sun , Marc Pollefeys , Hermann Blum

In the Vision-and-Language Navigation task, the embodied agent follows linguistic instructions and navigates to a specific goal. It is important in many practical scenarios and has attracted extensive attention from both computer vision and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Sinan Tan , Mengmeng Ge , Di Guo , Huaping Liu , Fuchun Sun

As embodied AI transitions to real-world deployment, the success of the Vision-and-Language Navigation (VLN) task tends to evolve from mere reachability to social compliance. However, current agents suffer from a "goal-driven trap",…

Artificial Intelligence · Computer Science 2026-04-21 Jiawen Wen , Penglei Sun , Wenjie Zhang , Suixuan Qiu , Weisheng Xu , Xiaofei Yang , Xiaowen Chu

Aerial vision-and-language navigation (Aerial VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and autonomously navigate complex three-dimensional environments by grounding language in visual…

Robotics · Computer Science 2026-04-10 Xingyu Xia , Lekai Zhou , Yujie Tang , Xiaozhou Zhu , Hai Zhu , Wen Yao
‹ Prev 1 8 9 10 Next ›