English
Related papers

Related papers: AirPilot: Interpretable PPO-based DRL Auto-Tuned N…

200 papers

In this paper, we present our proposed approach for active tracking to increase the autonomy of Unmanned Aerial Vehicles (UAVs) using event cameras, low-energy imaging sensors that offer significant advantages in speed and dynamic range.…

Robotics · Computer Science 2024-10-22 Ala Souissi , Hajer Fradi , Panagiotis Papadakis

According to the rapid development of drone technologies, drones are widely used in many applications including military domains. In this paper, a novel situation-aware DRL- based autonomous nonlinear drone mobility control algorithm in…

Systems and Control · Electrical Eng. & Systems 2023-01-03 Hyunsoo Lee , Soohyun Park , Won Joon Yun , Soyi Jung , Joongheon Kim

To optimize flapping foil performance, the application of deep reinforcement learning (DRL) on controlling foil non-parametric motion is conducted in the present study. Traditional control techniques and simplified motions cannot fully…

Fluid Dynamics · Physics 2023-05-26 Z. P. Wang , R. J. Lin , Z. Y. Zhao , P. M. Guo , N. Yang , D. X. Fan

Vessel navigation is difficult in restricted waterways and in the presence of static and dynamic obstacles. This difficulty can be attributed to the high-level decisions taken by humans during these maneuvers, which is evident from the fact…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Sanjeev Kumar Ramkumar Sudha , Md Shadab Alam , Bindusara Reddy , Abhilash Sharma Somayajula

This article presents a motion planning and control framework for flexible robotic manipulators, integrating deep reinforcement learning (DRL) with a nonlinear partial differential equation (PDE) controller. Unlike conventional approaches…

Robotics · Computer Science 2025-06-11 Amir Hossein Barjini , Seyed Adel Alizadeh Kolagar , Sadeq Yaqubi , Jouni Mattila

Precise near-ground trajectory control is difficult for multi-rotor drones, due to the complex aerodynamic effects caused by interactions between multi-rotor airflow and the environment. Conventional control methods often fail to properly…

Integrating unmanned aerial vehicles into daily use requires controllers that ensure stable flight, efficient energy use, and reduced noise. Proportional integral derivative controllers remain standard but are highly sensitive to gain…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Andrea Vaiuso , Gabriele Immordino , Ludovica Onofri , Giuliano Coppotelli , Marcello Righi

Drones are effective for reducing human activity and interactions by performing tasks such as exploring and inspecting new environments, monitoring resources and delivering packages. Drones need a controller to maintain stability and to…

Systems and Control · Electrical Eng. & Systems 2021-05-19 Azin Shamshirgaran , Hamed Javidi , Dan Simon

This study explores the application of deep reinforcement learning (RL) to design an airfoil pitch controller capable of minimizing lift variations in randomly disturbed flows. The controller, treated as an agent in a partially observable…

Fluid Dynamics · Physics 2024-04-03 Diederik Beckers , Jeff D. Eldredge

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating…

Robotics · Computer Science 2024-08-23 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila

This study conducts a comparative analysis of Model Predictive Control (MPC) and Proximal Policy Optimization (PPO), a Deep Reinforcement Learning (DRL) algorithm, applied to a 1-Degree of Freedom (DOF) Quanser Aero 2 system. Classical…

Systems and Control · Electrical Eng. & Systems 2024-08-29 Georg Schäfer , Jakob Rehrl , Stefan Huber , Simon Hirlaender

The rapid growth of the low-altitude economy has driven the widespread adoption of unmanned aerial vehicles (UAVs). This growing deployment presents new challenges for UAV trajectory planning in complex urban environments. However, existing…

Artificial Intelligence · Computer Science 2025-11-27 Yanwei Gong , Junchao Fan , Ruichen Zhang , Dusit Niyato , Yingying Yao , Xiaolin Chang

The low-altitude Internet of Things (IoT), supported by unmanned aerial vehicles (UAVs), provides ground sensing networks with advanced real-time monitoring and data collection. To maximize data collection volume from distributed IoT nodes,…

Computational Engineering, Finance, and Science · Computer Science 2026-05-25 Zhenjia Xu , Xiaoling Zhang , Nan Qi , Guangxu Zhu , Xiaojie Li , Luliang Jia

This paper introduces SPIRAL (Self-Play Incremental Racing Algorithm for Learning), a novel approach for training autonomous drones in multi-agent racing competitions. SPIRAL distinctively employs a self-play mechanism to incrementally…

Robotics · Computer Science 2025-11-21 Onur Akgün

This paper presents a Predictive Maneuver Planning with Deep Reinforcement Learning (PMP-DRL) model for maneuver planning. Traditional rule-based maneuver planning approaches often have to improve their abilities to handle the variabilities…

This paper introduces a novel zero-force control method for upper-limb exoskeleton robots, which are used in a variety of applications including rehabilitation, assistance, and human physical capability enhancement. The proposed control…

Robotics · Computer Science 2024-07-29 Morteza Mirzaee , Reza Kazemi

Unmanned Aerial Vehicles (UAVs) are increasingly essential in various fields such as surveillance, reconnaissance, and telecommunications. This study aims to develop a learning algorithm for the path planning of UAV wireless communication…

Machine Learning · Computer Science 2025-01-20 Joseanne Viana , Boris Galkin , Lester Ho , Holger Claussen

Drones, like most airborne aerial vehicles, face inherent disadvantages in achieving agile flight due to their limited thrust capabilities. These physical constraints cannot be fully addressed through advancements in control algorithms…

Robotics · Computer Science 2025-05-09 Dohyeon Lee , Jun-Gill Kang , Soohee Han

Exploiting unmanned aerial vehicles (UAVs) to execute tasks is gaining growing popularity recently. To solve the underlying task scheduling problem, the deep reinforcement learning (DRL) based methods demonstrate notable advantage over the…

Machine Learning · Computer Science 2023-06-07 Xiao Mao , Zhiguang Cao , Mingfeng Fan , Guohua Wu , Witold Pedrycz