English
Related papers

Related papers: LongFly: Long-Horizon UAV Vision-and-Language Navi…

200 papers

Efficient aerial data collection is important in many remote sensing applications. In large-scale monitoring scenarios, deploying a team of unmanned aerial vehicles (UAVs) offers improved spatial coverage and robustness against individual…

Robotics · Computer Science 2023-03-03 Jonas Westheider , Julius Rückin , Marija Popović

Large Multimodal Models (LMMs) have demonstrated impressive performance in short video understanding tasks but face great challenges when applied to long video understanding. In contrast, Large Language Models (LLMs) exhibit outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Hongchen Wei , Zhenzhong Chen

This paper addresses the joint optimization of trajectories and bandwidth allocation for multiple Unmanned Aerial Vehicles (UAVs) to enhance energy efficiency in the cooperative data collection problem. We focus on an important yet…

Multiagent Systems · Computer Science 2026-01-19 Cuong Le , Symeon Chatzinotas , Thang X. Vu

Vision-Language-Action (VLA) models offer significant potential for end-to-end driving, yet their reasoning is often constrained by textual Chains-of-Thought (CoT). This symbolic compression of visual information creates a modality gap…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Shuang Zeng , Xinyuan Chang , Mengwei Xie , Xinran Liu , Yifan Bai , Zheng Pan , Mu Xu , Xing Wei , Ning Guo

Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real…

Robotics · Computer Science 2026-03-19 Zhongyuang Liu , Min He , Shaonan Yu , Xinhang Xu , Muqing Cao , Jianping Li , Jianfei Yang , Lihua Xie

The UAV-VLA (Visual-Language-Action) system is a tool designed to facilitate communication with aerial robots. By integrating satellite imagery processing with the Visual Language Model (VLM) and the powerful capabilities of GPT, UAV-VLA…

Multimodal large language models (MLLMs) have advanced zero-shot end-to-end Vision-Language Navigation (VLN), yet robust navigation requires not only semantic understanding but also predictive modeling of environment dynamics and spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zehua Fan , Wenqi Lyu , Wenxuan Song , Linge Zhao , Yifei Yang , Xi Wang , Junjie He , Lida Huang , Haiyan Liu , Bingchuan Sun , Guangjun Bao , Xuanyao Mao , Liang Xu , Yan Wang , Feng Gao

Recently, Unmanned Aerial Vehicles (UAVs) are increasingly being investigated to collect sensory data in post-disaster monitoring scenarios, such as tsunamis, where early actions are critical to limit coastal damage. A major challenge is to…

Artificial Intelligence · Computer Science 2025-10-08 Yousef Emami , Seyedsina Nabavirazavi , Jingjing Zheng , Hao Zhou , Miguel Gutierrez Gaitan , Kai Li , Luis Almeida

The integration of Unmanned Aerial Vehicles(UAVs) into Intelligent Transportation Systems (ITS) offers synoptic visibility for traffic monitoring, yet scalable deployment is hindered by trajectory fragmentation, where vehicle identity…

Robotics · Computer Science 2026-05-18 Jianlin Ye , Christos Kyrkou , Panayiotis Kolios

Urban transportation systems encounter diverse challenges across multiple tasks, such as traffic forecasting, electric vehicle (EV) charging demand prediction, and taxi dispatch. Existing approaches suffer from two key limitations:…

Computation and Language · Computer Science 2025-08-21 Jiaming Leng , Yunying Bi , Chuan Qin , Bing Yin , Yanyong Zhang , Chao Wang

The integration of Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) is increasingly central to the development of intelligent autonomous systems for applications such as search and rescue, environmental monitoring, and…

The intersection of LLMs (Large Language Models) and UAV (Unoccupied Aerial Vehicles) technology represents a promising field of research with the potential to enhance UAV capabilities significantly. This study explores the application of…

Robotics · Computer Science 2024-10-24 Abhishek Phadke , Alihan Hadimlioglu , Tianxing Chu , Chandra N Sekharan

Trajectory prediction is a challenging task that aims to predict the future trajectory of vehicles or pedestrians over a short time horizon based on their historical positions. The main reason is that the trajectory is a kind of complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Pengqian Han , Jiamou Liu , Tianzhe Bao , Yifei Wang

Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision-free trajectory in multi-UAV non-cooperative scenarios while collecting data from distributed Internet of Things (IoT) nodes…

Signal Processing · Electrical Eng. & Systems 2023-12-12 Xueyuan Wang , M. Cenk Gursoy , Tugba Erpek , Yalin E. Sagduyu

Vision-and-Language Navigation (VLN) tasks require an agent to follow textual instructions to navigate through 3D environments. Traditional approaches use supervised learning methods, relying heavily on domain-specific datasets to train VLN…

Robotics · Computer Science 2025-02-12 Yanyuan Qiao , Wenqi Lyu , Hui Wang , Zixu Wang , Zerui Li , Yuan Zhang , Mingkui Tan , Qi Wu

Lifelong embodied navigation requires agents to accumulate, retain, and exploit spatial-semantic experience across tasks, enabling efficient exploration in novel environments and rapid goal reaching in familiar ones. While object-centric…

Robotics · Computer Science 2025-12-29 Botao Ren , Junjun Hu , Xinda Xue , Minghua Luo , Jintao Chen , Haochen Bai , Liangliang You , Mu Xu

Vision-language models (VLMs) have demonstrated strong performance in 2D scene understanding and generation, but extending this unification to the physical world remains an open challenge. Existing 3D and 4D approaches typically embed scene…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Hanyu Zhou , Gim Hee Lee

Recent advancements in Generative AI, particularly in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), offer new possibilities for integrating cognitive planning into robotic systems. In this work, we present a novel…

Robotics · Computer Science 2024-11-06 Arjun P S , Andrew Melnik , Gora Chand Nandi

Unmanned Aerial Vehicle (UAV) swarm systems necessitate efficient collaborative perception mechanisms for diverse operational scenarios. Current Bird's Eye View (BEV)-based approaches exhibit two main limitations: bounding-box…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Zefu Lin , Wenbo Chen , Xiaojuan Jin , Yuran Yang , Lue Fan , Yixin Zhang , Yufeng Zhang , Zhaoxiang Zhang

High-speed obstacle avoidance of uncrewed aerial vehicles (UAVs) in cluttered environments is a significant challenge. Existing UAV planning and obstacle avoidance systems can only fly at moderate speeds or at high speeds over empty or…

Robotics · Computer Science 2025-05-26 Minghao Lu , Xiyu Fan , Bowen Xu , Zexuan Yan , Rui Peng , Han Chen , Lixian Zhang , Peng Lu