English
Related papers

Related papers: LogisticsVLN: Vision-Language Navigation For Low-A…

200 papers

This paper explores the application of Vision-Language Models (VLMs) as operator agents in the space domain, focusing on both software and hardware operational paradigms. Building on advances in Large Language Models (LLMs) and their…

Artificial Intelligence · Computer Science 2025-01-15 Alejandro Carrasco , Marco Nedungadi , Enrico M. Zucchelli , Amit Jain , Victor Rodriguez-Fernandez , Richard Linares

Pre-trained large language models (LLMs) have demonstrated strong common-sense reasoning abilities, making them promising for robotic navigation and planning tasks. However, despite recent progress, bridging the gap between language…

Robotics · Computer Science 2025-12-29 Mingfeng Yuan , Letian Wang , Steven L. Waslander

Vision-language navigation (VLN) is the task of entailing an agent to carry out navigational instructions inside photo-realistic environments. One of the key challenges in VLN is how to conduct a robust navigation by mitigating the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Hanqing Wang , Wenguan Wang , Tianmin Shu , Wei Liang , Jianbing Shen

The Visual-and-Language Navigation (VLN) task requires understanding a textual instruction to navigate a natural indoor environment using only visual information. While this is a trivial task for most humans, it is still an open problem for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Joaquin Ossandón , Benjamin Earle , Álvaro Soto

Although large language models (LLMs) are introduced into vision-and-language navigation (VLN) to improve instruction comprehension and generalization, existing LLM- based VLN lacks the ability to selectively recall and use relevant priori…

Artificial Intelligence · Computer Science 2026-03-10 Haozhou Li , Xiangyu Dong , Huiyan Jiang , Yaoming Zhou , Xiaoguang Ma

The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD) have attracted widespread attention due to their outstanding performance and the ability to leverage Large Language Models (LLMs). By incorporating…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Xingcheng Zhou , Mingyu Liu , Ekim Yurtsever , Bare Luka Zagar , Walter Zimmer , Hu Cao , Alois C. Knoll

While recent large vision-language models (VLMs) have improved generalization in vision-language navigation (VLN), existing methods typically rely on end-to-end pipelines that map vision-language inputs directly to short-horizon discrete…

Vision-language models (VLMs) have emerged as a promising direction for end-to-end autonomous driving (AD) by jointly modeling visual observations, driving context, and language-based reasoning. However, existing VLM-based systems face a…

Robotics · Computer Science 2026-03-10 Ximeng Tao , Pardis Taghavi , Dimitar Filev , Reza Langari , Gaurav Pandey

Vision-and-Language Navigation (VLN) tasks require an agent to follow textual instructions to navigate through 3D environments. Traditional approaches use supervised learning methods, relying heavily on domain-specific datasets to train VLN…

Robotics · Computer Science 2025-02-12 Yanyuan Qiao , Wenqi Lyu , Hui Wang , Zixu Wang , Zerui Li , Yuan Zhang , Mingkui Tan , Qi Wu

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent…

Robotics · Computer Science 2025-09-04 Rui Shao , Wei Li , Lingsen Zhang , Renshan Zhang , Zhiyang Liu , Ran Chen , Liqiang Nie

Vision-Language Models (VLMs) excel in diverse multimodal tasks. However, user requirements vary across scenarios, which can be categorized into fast response, high-quality output, and low energy consumption. Relying solely on large models…

Machine Learning · Computer Science 2025-11-03 Xin Tang , Youfang Han , Fangfei Gou , Wei Zhao , Xin Meng , Yang Yu , Jinguo Zhang , Yuanchun Shi , Yuntao Wang , Tengxiang Zhang

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Current Vision-and-Language Navigation (VLN) tasks mainly employ textual instructions to guide agents. However, being inherently abstract, the same textual instruction can be associated with different visual signals, causing severe…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Haodong Hong , Sen Wang , Zi Huang , Qi Wu , Jiajun Liu

Rapid adaptation in unseen environments is essential for scalable real-world autonomy, yet existing approaches rely on exhaustive exploration or rigid navigation policies that fail to generalize. We present VLN-Zero, a two-phase…

Robotics · Computer Science 2025-09-24 Neel P. Bhatt , Yunhao Yang , Rohan Siva , Pranay Samineni , Daniel Milan , Zhangyang Wang , Ufuk Topcu

In high-stakes domains, small task-specific vision models are crucial due to their low computational requirements and the availability of numerous methods to explain their results. However, these explanations often reveal that the models do…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Alexander Koebler , Lukas Kuhn , Ingo Thon , Florian Buettner

For intelligent quadcopter UAVs, a robust and reliable autonomous planning system is crucial. Most current trajectory planning methods for UAVs are suitable for static environments but struggle to handle dynamic obstacles, which can pose…

Robotics · Computer Science 2023-12-29 Jiageng Zhong , Ming Li , Yinliang Chen , Zihang Wei , Fan Yang , Haoran Shen

Vision-and-Language Navigation (VLN) requires robots to follow natural language instructions and navigate complex environments without prior maps. While recent vision-language large models demonstrate strong reasoning abilities, they often…

Robotics · Computer Science 2026-01-26 Liuyi Wang , Zongtao He , Jinlong Li , Ruihao Xia , Mengxian Hu , Chenpeng Yao , Chengju Liu , Yang Tang , Qijun Chen

Zero-shot vision-and-language navigation (VLN) has gained significant attention due to its minimal data collection costs and inherent generalization. This paradigm is typically driven by the integration of pre-trained Vision-Language Models…

Robotics · Computer Science 2026-05-15 Ziyi Xia , Chaoran Xiong , Litao Wei , Xinhao Hu , Ling Pei

This paper addresses the challenge of fine-grained alignment in Vision-and-Language Navigation (VLN) tasks, where robots navigate realistic 3D environments based on natural language instructions. Current approaches use contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yuhang Song , Mario Gianni , Chenguang Yang , Kunyang Lin , Te-Chuan Chiu , Anh Nguyen , Chun-Yi Lee

Vehicle Dispatching Systems (VDSs) are critical to the operational efficiency of Automated Container Terminals (ACTs). However, their widespread commercialization is hindered due to their low transferability across diverse terminals. This…

Artificial Intelligence · Computer Science 2025-12-17 Jia Hu , Junqi Li , Weimeng Lin , Peng Jia , Yuxiong Ji , Jintao Lai