English
Related papers

Related papers: FreeFly-Thinking : Aligning Chain-of-Thought Reaso…

200 papers

Current Visual-Language Navigation (VLN) methodologies face a trade-off between semantic understanding and control precision. While Multimodal Large Language Models (MLLMs) offer superior reasoning, deploying them as low-level controllers…

Robotics · Computer Science 2026-02-19 Zhenxing Xu , Brikit Lu , Weidong Bao , Zhengqiu Zhu , Junsong Zhang , Hui Yan , Wenhao Lu , Ji Wang

Existing aerial Vision-Language Navigation (VLN) methods predominantly adopt a detection-and-planning pipeline, which converts open-vocabulary detections into discrete textual scene graphs. These approaches are plagued by inadequate spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haoyu Tong , Xiangyu Dong , Xiaoguang Ma , Haoran Zhao , Yaoming Zhou , Chenghao Lin

Vision-and-Language Navigation (VLN) requires an embodied agent to navigate in a complex 3D environment according to natural language instructions. Recent progress in large language models (LLMs) has enabled language-driven navigation with…

Robotics · Computer Science 2026-01-27 Zijun Li , Shijie Li , Zhenxi Zhang , Bin Li , Shoujun Zhou

Unmanned Aerial Vehicle (UAV) Vision-and-Language Navigation (VLN) is vital for applications such as disaster response, logistics delivery, and urban inspection. However, existing methods often struggle with insufficient multimodal fusion,…

Computation and Language · Computer Science 2025-05-20 Hengxing Cai , Jinhan Dong , Jingjun Tan , Jingcheng Deng , Sihang Li , Zhifeng Gao , Haidong Wang , Zicheng Su , Agachai Sumalee , Renxin Zhong

Aerial vision-and-language navigation (Aerial VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and autonomously navigate complex three-dimensional environments by grounding language in visual…

Robotics · Computer Science 2026-04-10 Xingyu Xia , Lekai Zhou , Yujie Tang , Xiaozhou Zhu , Hai Zhu , Wen Yao

Visual language navigation (VLN) is an embodied task demanding a wide range of skills encompassing understanding, perception, and planning. For such a multifaceted challenge, previous VLN methods totally rely on one model's own thinking to…

Robotics · Computer Science 2023-09-21 Yuxing Long , Xiaoqi Li , Wenzhe Cai , Hao Dong

Unmanned Aerial Vehicles (UAVs) have emerged as versatile tools across various sectors, driven by their mobility and adaptability. This paper introduces SkyVLN, a novel framework integrating vision-and-language navigation (VLN) with…

Robotics · Computer Science 2025-07-10 Tianshun Li , Tianyi Huai , Zhen Li , Yichun Gao , Haoang Li , Xinhu Zheng

Vision-and-Language Navigation (VLN) presents a complex challenge in embodied AI, requiring agents to interpret natural language instructions and navigate through visually rich, unfamiliar environments. Recent advances in large…

Robotics · Computer Science 2025-06-13 Yicheng Duan , Kaiyu tang

Unmanned Aerial Vehicles (UAVs) are evolving into language-interactive platforms, enabling more intuitive forms of human-drone interaction. While prior works have primarily focused on high-level planning and long-horizon navigation, we…

Robotics · Computer Science 2025-05-27 Xiangyu Wang , Donglin Yang , Yue Liao , Wenhao Zheng , wenjun wu , Bin Dai , Hongsheng Li , Si Liu

Vision-language navigation (VLN) is the task of entailing an agent to carry out navigational instructions inside photo-realistic environments. One of the key challenges in VLN is how to conduct a robust navigation by mitigating the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Hanqing Wang , Wenguan Wang , Tianmin Shu , Wei Liang , Jianbing Shen

Aerial Vision-and-Language Navigation (Aerial VLN) enables unmanned aerial vehicles (UAVs) to follow natural language instructions and navigate complex urban environments. While recent advances have achieved progress through large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuwei Ning , Ganlong Zhao , Yipeng Qin , Si Liu , Yang Liu , Liang Lin , Guanbin Li

Aerial navigation is a fundamental yet underexplored capability in embodied intelligence, enabling agents to operate in large-scale, unstructured environments where traditional navigation paradigms fall short. However, most existing…

Robotics · Computer Science 2025-08-25 Jianqiang Xiao , Yuexuan Sun , Yixin Shao , Boxi Gan , Rongqiang Liu , Yanjing Wu , Weili Guan , Xiang Deng

Achieving human-level performance in Vision-and-Language Navigation (VLN) requires an embodied agent to jointly understand multimodal instructions and visual-spatial context while reasoning over long action sequences. Recent works, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Jing Zuo , Lingzhou Mu , Fan Jiang , Chengcheng Ma , Mu Xu , Yonggang Qi

Aerial Vision-and-Language Navigation (VLN) is an emerging task that enables Unmanned Aerial Vehicles (UAVs) to navigate outdoor environments using natural language instructions and visual cues. However, due to the extended trajectories and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Ruipu Wu , Yige Zhang , Jinyu Chen , Linjiang Huang , Shifeng Zhang , Xu Zhou , Liang Wang , Si Liu

As a long-term vision in the field of artificial intelligence, the core goal of embodied intelligence is to improve the perception, understanding, and interaction capabilities of agents and the environment. Vision-language navigation (VLN),…

Robotics · Computer Science 2024-03-21 Peng Gao , Peng Wang , Feng Gao , Fei Wang , Ruyue Yuan

A long-term goal of AI research is to build intelligent agents that can communicate with humans in natural language, perceive the environment, and perform real-world tasks. Vision-and-Language Navigation (VLN) is a fundamental and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jing Gu , Eliana Stefani , Qi Wu , Jesse Thomason , Xin Eric Wang

Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to…

Robotics · Computer Science 2026-04-03 Xueying Li , Feng Lyu , Hao Wu , Mingliu Liu , Jia-Nan Liu , Guozi Liu

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang

Vision-Language Navigation (VLN) is a core challenge in embodied AI, requiring agents to navigate real-world environments using natural language instructions. Current language model-based navigation systems operate on discrete topological…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Zhangyang Qi , Zhixiong Zhang , Yizhou Yu , Jiaqi Wang , Hengshuang Zhao

This paper introduces VLN-Pilot, a novel framework in which a large Vision-and-Language Model (VLLM) assumes the role of a human pilot for indoor drone navigation. By leveraging the multimodal reasoning abilities of VLLMs, VLN-Pilot…