English
Related papers

Related papers: Multi-model fusion for Aerial Vision and Dialog Na…

200 papers

Aerial vision-and-language navigation (Aerial VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and autonomously navigate complex three-dimensional environments by grounding language in visual…

Robotics · Computer Science 2026-04-10 Xingyu Xia , Lekai Zhou , Yujie Tang , Xiaozhou Zhu , Hai Zhu , Wen Yao

Robot navigation is crucial across various domains, yet traditional methods focus on efficiency and obstacle avoidance, often overlooking human behavior in shared spaces. With the rise of service robots, socially aware navigation has gained…

Unmanned aerial vehicle (UAV)-assisted communication becomes a promising technique to realize the beyond fifth generation (5G) wireless networks, due to the high mobility and maneuverability of UAVs which can adapt to heterogeneous…

Signal Processing · Electrical Eng. & Systems 2020-09-17 Chang Liu , Weijie Yuan , Zhiqiang Wei , Xuemeng Liu , Derrick Wing Kwan Ng

Recent advances in agentic and physical artificial intelligence (AI) have largely focused on ground-based platforms such as humanoid and wheeled robots, leaving aerial robots relatively underexplored. Meanwhile, state-of-the-art unmanned…

Robotics · Computer Science 2025-06-10 Shoon Kit Lim , Melissa Jia Ying Chong , Jing Huey Khor , Ting Yang Ling

The rapid advancement of Transformer-based models has reshaped the landscape of uncrewed aerial vehicle (UAV) systems by enhancing perception, decision-making, and autonomy. This review paper systematically categorizes and evaluates recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Hamza Kheddar , Yassine Habchi , Mohamed Chahine Ghanem , Mustapha Hemis , Dusit Niyato

The use of semi-autonomous Unmanned Aerial Vehicles (UAVs or drones) to support emergency response scenarios, such as fire surveillance and search-and-rescue, has the potential for huge societal benefits. Onboard sensors and artificial…

Software Engineering · Computer Science 2020-09-23 Ankit Agrawal , Jan-Philipp Steghofer , Jane Cleland-Huang

Currently, unmanned aerial vehicles, such as drones, are becoming a part of our lives and reaching out to many areas of society, including the industrialized world. A common alternative to control the movements and actions of the drone is…

Robotics · Computer Science 2020-09-22 Ruben Contreras , Angel Ayala , Francisco Cruz

The emergence of large language models (LLMs) opens new frontiers for unmanned aerial vehicle (UAVs), yet existing systems remain confined to predefined tasks due to hardware-software co-design challenges. This paper presents the first…

Robotics · Computer Science 2025-03-12 Ji Zhao , Xiao Lin

Low-altitude mobility, exemplified by unmanned aerial vehicles (UAVs), has introduced transformative advancements across various domains, like transportation, logistics, and agriculture. Leveraging flexible perspectives and rapid…

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

Vision-and-Language Navigation (VLN) aims to develop embodied agents that navigate based on human instructions. However, current VLN frameworks often rely on static environments and optimal expert supervision, limiting their real-world…

Artificial Intelligence · Computer Science 2024-11-05 Heng Li , Minghan Li , Zhi-Qi Cheng , Yifei Dong , Yuxuan Zhou , Jun-Yan He , Qi Dai , Teruko Mitamura , Alexander G. Hauptmann

With the rapid development of intelligent vehicles and Advanced Driver-Assistance Systems (ADAS), a new trend is that mixed levels of human driver engagements will be involved in the transportation system. Therefore, necessary visual…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Yongkang Liu , Ziran Wang , Kyungtae Han , Zhenyu Shou , Prashant Tiwari , John H. L. Hansen

Aerial Vision-and-Language Navigation (VLN) is an emerging task that enables Unmanned Aerial Vehicles (UAVs) to navigate outdoor environments using natural language instructions and visual cues. However, due to the extended trajectories and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Ruipu Wu , Yige Zhang , Jinyu Chen , Linjiang Huang , Shifeng Zhang , Xu Zhou , Liang Wang , Si Liu

As autonomous robotic systems become increasingly mature, users will want to specify missions at the level of intent rather than in low-level detail. Language is an expressive and intuitive medium for such mission specification. However,…

The integration of Unmanned Aerial Vehicles (UAVs) into Search and Rescue (SAR) missions presents a promising avenue for enhancing operational efficiency and effectiveness. However, the success of these missions is not solely dependent on…

Robotics · Computer Science 2024-02-29 Mahya Ramezani , Jose Luis Sanchez-Lopez

Augmenting wireless networks with Unmanned Aerial Vehicles (UAVs), commonly referred to as drones, offers a promising avenue for providing reliable, cost-effective, and on-demand wireless services to desired areas. However, existing UAV…

Networking and Internet Architecture · Computer Science 2021-01-27 Aksh Garg

Existing UAV vision-and-language navigation (VLN) benchmarks rarely provide realistic aerial scenes, natural process-level instructions, and sufficient scale simultaneously, making it difficult to systematically train and evaluate UAV VLN…

Computation and Language · Computer Science 2026-05-18 Hengxing Cai , Yijie Rao , Ligang Huang , Zanyang Zhong , Jinhan Dong , Jingjun Tan , Changhao Nai , Jue Hou , Wenhao Lu , Renxin Zhong

Unmanned aerial vehicles (UAVs) are crucial tools for post-disaster search and rescue, facing challenges such as high information density, rapid changes in viewpoint, and dynamic structures, especially in long-horizon navigation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Wen Jiang , Li Wang , Kangyao Huang , Wei Fan , Jinyuan Liu , Shaoyu Liu , Hongwei Duan , Bin Xu , Xiangyang Ji

Benefiting from the rapid advancements in large language models (LLMs), human-drone interaction has reached unprecedented opportunities. In this paper, we propose a method that integrates a fine-tuned CodeT5 model with the Unreal…

Robotics · Computer Science 2026-01-14 Yizhan Feng , Hichem Snoussi , Jing Teng , Abel Cherouat , Tian Wang

Human-robot collaboration, in which the robot intelligently assists the human with the upcoming task, is an appealing objective. To achieve this goal, the agent needs to be equipped with a fundamental collaborative navigation ability, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Changhao Li , Xinyu Sun , Peihao Chen , Jugang Fan , Zixu Wang , Yanxia Liu , Jinhui Zhu , Chuang Gan , Mingkui Tan