English
Related papers

Related papers: AirPilot: Interpretable PPO-based DRL Auto-Tuned N…

200 papers

This paper proposes an adaptive near-hover position controller for quadcopters, which can be deployed to quadcopters of very different mass, size and motor constants, and also shows rapid adaptation to unknown disturbances during runtime.…

Robotics · Computer Science 2023-05-04 Dingqi Zhang , Antonio Loquercio , Xiangyu Wu , Ashish Kumar , Jitendra Malik , Mark W. Mueller

In the era of 5G mobile communication, there has been a significant surge in research focused on unmanned aerial vehicles (UAVs) and mobile edge computing technology. UAVs can serve as intelligent servers in edge computing environments,…

Multiagent Systems · Computer Science 2023-09-06 Zhengrong Song , Chuan Ma , Ming Ding , Howard H. Yang , Yuwen Qian , Xiangwei Zhou

Deep Reinforcement Learning (DRL) techniques have received significant attention in control and decision-making algorithms. Most applications involve complex decision-making systems, justified by the algorithms' computational power and…

Systems and Control · Electrical Eng. & Systems 2024-02-28 Fatemeh Tavakkoli , Pouria Sarhadi , Benoit Clement , Wasif Naeem

Increasing traffic demands, higher levels of automation, and communication enhancements provide novel design opportunities for future air traffic controllers (ATCs). This article presents a novel deep reinforcement learning (DRL) controller…

Machine Learning · Computer Science 2022-11-28 Lei Wang , Hongyu Yang , Yi Lin , Suwan Yin , Yuankai Wu

Present-day Deep Reinforcement Learning (RL) systems show great promise towards building intelligent agents surpassing human-level performance. However, the computational complexity associated with the underlying deep neural networks (DNNs)…

Machine Learning · Computer Science 2021-09-20 Adarsh Kumar Kosta , Malik Aqeel Anwar , Priyadarshini Panda , Arijit Raychowdhury , Kaushik Roy

In cellular-connected unmanned aerial vehicle (UAV) network, a minimization problem on the weighted sum of time cost and expected outage duration is considered. Taking advantage of UAV's adjustable mobility, an intelligent UAV navigation…

Signal Processing · Electrical Eng. & Systems 2021-09-20 Yuanjian Li , A. Hamid Aghvami , Daoyi Dong

The main control tasks in autonomous vehicles are steering (lateral) and speed (longitudinal) control. PID controllers are widely used in the industry because of their simplicity and good performance, but they are difficult to tune and need…

Optimization and Control · Mathematics 2025-09-23 Yassine Kebbati , Naima Ait-Oufroukh , Vincent Vigneron , Dalil Ichalal , Dominique Gruyer

With the continual adoption of Uncrewed Aerial Vehicles (UAVs) across a wide-variety of application spaces, robust aerial manipulation remains a key research challenge. Aerial manipulation tasks require interacting with objects in the…

Robotics · Computer Science 2024-07-02 Cora A. Dimmig , Marin Kobilarov

Purpose: Real-life applications using quadrotors introduce a number of disturbances and time-varying properties that pose a challenge to flight controllers. We observed that, when a quadrotor is tasked with picking up and dropping a…

Robotics · Computer Science 2022-10-07 Guilherme Siqueira Eduardo , Wouter Caarls

Designing robust controllers for precise trajectory tracking with quadrotors is challenging due to nonlinear dynamics and underactuation, and becomes harder with flexible cable-suspended payloads that add degrees of freedom and hybrid…

Robotics · Computer Science 2025-10-02 Mintae Kim , Jiaze Cai , Koushil Sreenath

In the coming years, the satellite broadband market will experience significant increases in the service demand, especially for the mobility sector, where demand is burstier. Many of the next generation of satellites will be equipped with…

Signal Processing · Electrical Eng. & Systems 2019-06-04 Juan Jose Garau Luis , Markus Guerster , Inigo del Portillo , Edward Crawley , Bruce Cameron

Tilt rotor aircraft combine the benefits of both helicopters and fixed wing aircraft, this makes them popular for a variety of applications, including Search and Rescue and VVIP transport. However, due to the multiple flight modes,…

Systems and Control · Electrical Eng. & Systems 2024-11-13 William Smith , Xinhua Wang

Image retrieval (IR) has emerged as a promising approach for self-localization in unmanned aerial vehicles (UAVs). However, IR-based methods face several challenges: 1) Pre- and post-processing incur significant computational and storage…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ming Dai , Enhui Zheng , Jiahao Chen , Lei Qi , Zhenhua Feng , Wankou Yang

With the rapid expansion of the low-altitude economy, Unmanned Aerial Vehicles (UAVs) serve as pivotal aerial base stations supporting diverse services from users, ranging from latency-sensitive critical missions to bandwidth-intensive data…

Artificial Intelligence · Computer Science 2026-02-03 Yue Zhong , Jiawen Kang , Yongju Tong , Hong-Ning Dai , Dong In Kim , Abbas Jamalipour , Shengli Xie

Path Following and Collision Avoidance, be it for unmanned surface vessels or other autonomous vehicles, are two fundamental guidance problems in robotics. For many decades, they have been subject to academic study, leading to a vast number…

Robotics · Computer Science 2020-06-18 Eivind Meyer , Amalie Heiberg , Adil Rasheed , Omer San

In this paper, the problem of pilot contamination in a multi-cell massive multiple input multiple output (M-MIMO) system is addressed using deep reinforcement learning (DRL). To this end, a pilot assignment strategy is designed that adapts…

Signal Processing · Electrical Eng. & Systems 2021-03-26 Yasaman Omid , Seyed MohammadReza Hosseini , Seyyed MohammadMahdi Shahabi , Mohammad Shikh-Bahaei , Arumugam Nallanathan

This paper presents a novel approach for aerial drone autonomous navigation along predetermined paths using only visual input form an onboard camera and without reliance on a Global Positioning System (GPS). It is based on using a deep…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 K. Amer , M. Samy , M. Shaker , M. ElHelw

Path planning and optimization for unmanned aerial vehicles (UAVs)-assisted next-generation wireless networks is critical for mobility management and ensuring UAV safety and ubiquitous connectivity, especially in dense urban environments…

Networking and Internet Architecture · Computer Science 2025-04-04 Achilles Kiwanuka Machumilane , Alberto Gotta , Pietro Cassarà

Despite the central role of optimization in deep learning, most optimizers rely on update structures whose functional form is fixed before training begins. This static design can limit their ability to respond to changing gradient behavior…

Machine Learning · Computer Science 2026-05-26 Sattam Altuuaim , Lama Ayash , Muhammad Mubashar , Naeemullah Khan

Deep Reinforcement Learning (DRL) is regarded as a potential method for car-following control and has been mostly studied to support a single following vehicle. However, it is more challenging to learn a stable and efficient car-following…

Systems and Control · Electrical Eng. & Systems 2022-11-21 Tong Liu , Lei Lei , Kan Zheng , Kuan Zhang