English
Related papers

Related papers: Multi-model fusion for Aerial Vision and Dialog Na…

200 papers

The ability to converse with humans and follow natural language commands is crucial for intelligent unmanned aerial vehicles (a.k.a. drones). It can relieve people's burden of holding a controller all the time, allow multitasking, and make…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Yue Fan , Winson Chen , Tongzhou Jiang , Chun Zhou , Yi Zhang , Xin Eric Wang

Considering the widespread integration of aerial robots in inspection, search and rescue, and monitoring tasks, there is a growing demand to design intuitive human-drone interfaces. These aim to streamline and enhance the user interaction…

Uncrewed aerial vehicles (UAVs) are increasingly deployed in complex networked environments, yet the joint optimization of multi-UAV motion control and connectivity remains a fundamental challenge. In this paper, we study a multi-UAV system…

Artificial Intelligence · Computer Science 2026-05-13 Zijiang Yan , Hao Zhou , Wael Jaafar , Jianhua Pei , Ping Wang , Halim Yanikomeroglu , Hina Tabassum

The field of Unmanned Aerial Vehicles (UAVs) has reached a high level of maturity in the last few years. Hence, bringing such platforms from closed labs, to day-to-day interactions with humans is important for commercialization of UAVs. One…

Robotics · Computer Science 2022-11-15 Anees Peringal , Mohamad Chehadeh , Rana Azzam , Mahmoud Hamandi , Igor Boiko , Yahya Zweiri

Uncrewed Aerial Vehicles (UAVs) are widely deployed across diverse applications due to their mobility and agility. Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond…

Robotics · Computer Science 2026-03-03 Yousef Emami , Hao Zhou , Radha Reddy , Atefeh Hajijamali Arani , Biliang Wang , Kai Li , Luis Almeida , Zhu Han

Audio-visual embodied navigation, as a hot research topic, aims training a robot to reach an audio target using egocentric visual (from the sensors mounted on the robot) and audio (emitted from the target) input. The audio-visual…

Sound · Computer Science 2022-10-06 Yinfeng Yu , Lele Cao , Fuchun Sun , Xiaohong Liu , Liejun Wang

Harnessing human movements to command an Unmanned Aerial Vehicle (UAV) holds the potential to revolutionize their deployment, rendering it more intuitive and user-centric. In this research, we introduce a novel methodology adept at…

Robotics · Computer Science 2024-08-20 Akash Chaudhary , Tiago Nascimento , Martin Saska

Recent technological advancements in small-scale unmanned aerial vehicles (UAVs) have led to the development of companion UAVs. Similar to conventional companion robots, companion UAVs have the potential to assist us in our daily lives and…

Robotics · Computer Science 2020-01-15 Chun Fui Liew , Takehisa Yairi

The future of UAV interaction systems is evolving from engineer-driven to user-driven, aiming to replace traditional predefined Human-UAV Interaction designs. This shift focuses on enabling more personalized task planning and design,…

Robotics · Computer Science 2025-12-10 Haoran Wang , Zhuohang Chen , Guang Li , Bo Ma , Chuanghuang Li

The human-robot interaction (HRI) is a growing area of research. In HRI, complex command (action) classification is still an open problem that usually prevents the real applicability of such a technique. The literature presents some works…

Robotics · Computer Science 2025-06-26 Lucas Nogueira Nobrega , Ewerton de Oliveira , Martin Saska , Tiago Nascimento

Drones operating in human-occupied spaces suffer from insufficient communication mechanisms that create uncertainty about their intentions. We present HoverAI, an embodied aerial agent that integrates drone mobility,…

Aerial robots have the potential to play a crucial role in assisting humans with complex and dangerous tasks. Nevertheless, the future industry demands innovative solutions to streamline the interaction process between humans and drones to…

Robotics · Computer Science 2024-04-09 Luca Morando , Giuseppe Loianno

Unmanned Aerial Vehicles (UAVs) are evolving into language-interactive platforms, enabling more intuitive forms of human-drone interaction. While prior works have primarily focused on high-level planning and long-horizon navigation, we…

Robotics · Computer Science 2025-05-27 Xiangyu Wang , Donglin Yang , Yue Liao , Wenhao Zheng , wenjun wu , Bin Dai , Hongsheng Li , Si Liu

Audiovisual embodied navigation enables robots to locate audio sources by dynamically integrating visual observations from onboard sensors with the auditory signals emitted by the target. The core challenge lies in effectively leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yinfeng Yu , Hailong Zhang , Meiling Zhu

Unmanned aerial vehicles (UAVs) have been widely adopted in various real-world applications. However, the control and optimization of multi-UAV systems remain a significant challenge, particularly in dynamic and constrained environments.…

Machine Learning · Computer Science 2025-06-10 Zijiang Yan , Hao Zhou , Jianhua Pei , Hina Tabassum

This report details the methods of the winning entry of the AVDN Challenge in ICCV CLVL 2023. The competition addresses the Aerial Navigation from Dialog History (ANDH) task, which requires a drone agent to associate dialog history with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Yifei Su , Dong An , Yuan Xu , Kehan Chen , Yan Huang

Autonomous aerial monitoring is an important task aimed at gathering information from areas that may not be easily accessible by humans. At the same time, this task often requires recognizing anomalies from a significant distance or not…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Tzoulio Chamiti , Nikolaos Passalis , Anastasios Tefas

This paper presents a learning-augmented trajectory planning framework for cooperative unmanned aerial vehicle (UAV) and unmanned ground vehicle (UGV) handover missions. While centralized trajectory optimization ensures dynamic feasibility…

Robotics · Computer Science 2026-05-20 Jingshan Chen , Bochen Yu , Henrik Ebel , Peter Eberhard

Unmanned Aerial Vehicles, operating in environments with relatively few obstacles, offer high maneuverability and full three-dimensional mobility. This allows them to rapidly approach objects and perform a wide range of tasks often…

Robotics · Computer Science 2025-07-08 Ziqin Wang , Jinyu Chen , Xiangyi Zheng , Qinan Liao , Linjiang Huang , Si Liu

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

Robotics · Computer Science 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat
‹ Prev 1 2 3 10 Next ›