English
Related papers

Related papers: VLM-RRT: Vision Language Model Guided RRT Search f…

200 papers

This paper introduces BEV-VLM, a novel approach for trajectory planning in autonomous driving that leverages Vision-Language Models (VLMs) with Bird's-Eye View (BEV) feature maps as visual input. Unlike conventional trajectory planning…

Robotics · Computer Science 2026-03-02 Guancheng Chen , Sheng Yang , Tong Zhan , Jian Wang

Uncrewed Aerial Vehicles (UAVs) are widely deployed across diverse applications due to their mobility and agility. Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond…

Robotics · Computer Science 2026-03-03 Yousef Emami , Hao Zhou , Radha Reddy , Atefeh Hajijamali Arani , Biliang Wang , Kai Li , Luis Almeida , Zhu Han

Vision-Language Models (VLMs) have been increasingly integrated into object navigation tasks for their rich prior knowledge and strong reasoning abilities. However, applying VLMs to navigation poses two key challenges: effectively…

Robotics · Computer Science 2025-09-17 Haokun Zhu , Zongtai Li , Zhixuan Liu , Wenshan Wang , Ji Zhang , Jonathan Francis , Jean Oh

Rapidly-exploring Random Tree star (RRT*) has recently gained immense popularity in the motion planning community as it provides a probabilistically complete and asymptotically optimal solution without requiring the complete information of…

Robotics · Computer Science 2018-07-24 Zaid Tahir , Ahmed H. Qureshi , Yasar Ayaz , Raheel Nawaz

Vision Language Models (VLMs) play a crucial role in robotic manipulation by enabling robots to understand and interpret the visual properties of objects and their surroundings, allowing them to perform manipulation based on this multimodal…

Robotics · Computer Science 2025-05-21 Nurhan Bulus Guran , Hanchi Ren , Jingjing Deng , Xianghua Xie

The rise of large language models (LLMs) has made natural language-driven route planning an emerging research area that encompasses rich user objectives. Current research exhibits two distinct approaches: direct route planning using…

Artificial Intelligence · Computer Science 2025-09-17 Liangqi Yuan , Dong-Jun Han , Christopher G. Brinton , Sabine Brunswicker

Large Language Models (LLMs) show potential for enhancing robotic path planning. This paper assesses visual input's utility for multimodal LLMs in such tasks via a comprehensive benchmark. We evaluated 15 multimodal LLMs on generating valid…

Robotics · Computer Science 2025-07-17 Jacinto Colan , Ana Davila , Yasuhisa Hasegawa

The growing use of mobile robots in sectors such as automotive, agriculture, and rescue operations reflects progress in robotics and autonomy. In unmanned aerial vehicles (UAVs), most research emphasizes visual SLAM, sensor fusion, and path…

Robotics · Computer Science 2025-06-26 Jingwen Wei

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

The rapid advancement of Low-Altitude Economy Networks (LAENets) has enabled a variety of applications, including aerial surveillance, environmental sensing, and semantic data collection. To support these scenarios, unmanned aerial vehicles…

Machine Learning · Computer Science 2025-10-14 Yang Li , Ruichen Zhang , Yinqiu Liu , Guangyuan Liu , Dusit Niyato , Abbas Jamalipour , Xianbin Wang , Dong In Kim

Autonomous exploration by unmanned surface vehicles (USVs) in near-shore waters requires reliable localisation and consistent mapping over extended areas, but this is challenged by GNSS degradation, environment-induced localisation…

Robotics · Computer Science 2026-03-25 Ye Li , Yewei Huang , Wenlong GaoZhang , Alberto Quattrini Li , Brendan Englot , Yuanchang Liu

Vision-Language Models (VLMs) demonstrate remarkable potential in robotic manipulation, yet challenges persist in executing complex fine manipulation tasks with high speed and precision. While excelling at high-level planning, existing VLM…

Robotics · Computer Science 2025-03-10 Qingxuan Jia , Guoqin Tang , Zeyuan Huang , Zixuan Hao , Ning Ji , Shihang , Yin , Gang Chen

Robots operating in human-centric or hazardous environments must proactively anticipate and mitigate dangers beyond basic obstacle detection. Traditional navigation systems often depend on static maps, which struggle to account for dynamic…

Robotics · Computer Science 2025-08-06 Mintaek Oh , Chan Kim , Seung-Woo Seo , Seong-Woo Kim

With the rapid progress of foundation models and robotics, vision-language navigation (VLN) has emerged as a key task for embodied agents with broad practical applications. We address VLN in continuous environments, a particularly…

Robotics · Computer Science 2025-09-26 Boqi Li , Siyuan Li , Weiyi Wang , Anran Li , Zhong Cao , Henry X. Liu

We propose a training-free, Vision-Language Model (VLM)-guided approach for efficiently generating trajectories to facilitate target inspection planning based on text descriptions. Unlike existing Vision-and-Language Navigation (VLN)…

Robotics · Computer Science 2025-06-04 Xingpeng Sun , Zherong Pan , Xifeng Gao , Kui Wu , Aniket Bera

Autonomous underwater vehicles (AUVs) are increasingly used in marine research, military applications, and undersea exploration. However, their operational range is significantly affected by battery performance. In this paper, a framework…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Zhengji Feng , Hengxiang Chen , Liqun Chen , Heyan Li , Xiaolin Mou

Maritime port inspection plays a critical role in ensuring safety, regulatory compliance, and operational efficiency in complex maritime environments. However, existing inspection methods often rely on manual operations and conventional…

Robotics · Computer Science 2026-01-21 Muhayy Ud Din , Waseem Akram , Ahsan B. Bakht , Irfan Hussain

Sampling-based planning algorithms like Rapidly-exploring Random Tree (RRT) are versatile in solving path planning problems. RRT* offers asymptotic optimality but requires growing the tree uniformly over the free space, which leaves room…

Robotics · Computer Science 2024-03-08 Zhe Huang , Hongyu Chen , John Pohovey , Katherine Driggs-Campbell

Vision-language models (VLMs) have achieved remarkable success in scene understanding and perception tasks, enabling robots to plan and execute actions adaptively in dynamic environments. However, most multimodal large language models lack…

Robotics · Computer Science 2025-02-14 Guoqin Tang , Qingxuan Jia , Zeyuan Huang , Gang Chen , Ning Ji , Zhipeng Yao

We develop a hierarchical LLM-task-motion planning and replanning framework to efficiently ground an abstracted human command into tangible Autonomous Underwater Vehicle (AUV) control through enhanced representations of the world. We also…

Robotics · Computer Science 2024-03-25 Ruochu Yang , Fumin Zhang , Mengxue Hou