English
Related papers

Related papers: Fault Tolerant Control of a Quadcopter using Reinf…

200 papers

Learning-based methods, particularly Reinforcement Learning (RL), hold great promise for streamlining deployment, enhancing performance, and achieving generalization in the control of autonomous multirotor aerial vehicles. Deep RL has been…

Robotics · Computer Science 2024-04-10 Jonas Eschmann , Dario Albani , Giuseppe Loianno

This paper presents a framework for controlled emergency landing of a quadcopter, experiencing a rotor failure, away from sensitive areas. A complete mathematical model capturing the dynamics of the system is presented that takes the…

Robotics · Computer Science 2018-09-26 Mojtaba Hedayatpour , Mehran Mehrandezh , Farrokh Janabi-Sharifi

Reinforcement learning (RL) has become a promising approach to developing controllers for quadrupedal robots. Conventionally, an RL design for locomotion follows a position-based paradigm, wherein an RL policy outputs target joint positions…

Robotics · Computer Science 2023-03-14 Shuxiao Chen , Bike Zhang , Mark W. Mueller , Akshara Rai , Koushil Sreenath

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

Software Engineering · Computer Science 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they…

Robotics · Computer Science 2019-11-14 Eivind Bøhn , Erlend M. Coates , Signe Moe , Tor Arne Johansen

The paper presents a technique using reinforcement learning (RL) to adapt the control gains of a quadcopter controller. Specifically, we employed Proximal Policy Optimization (PPO) to train a policy which adapts the gains of a cascaded…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Mike Timmerman , Aryan Patel , Tim Reinhart

Heave compensation is an essential part in various offshore operations. It is used in various applications, which include on-loading or off-loading systems, offshore drilling, landing helicopter on oscillating structures, and deploying and…

Systems and Control · Electrical Eng. & Systems 2021-07-26 Shrenik Zinage , Abhilash Somayajula

Compared with model-based control and optimization methods, reinforcement learning (RL) provides a data-driven, learning-based framework to formulate and solve sequential decision-making problems. The RL framework has become promising due…

Systems and Control · Electrical Eng. & Systems 2024-07-29 Pouria Razzaghi , Amin Tabrizian , Wei Guo , Shulu Chen , Abenezer Taye , Ellis Thompson , Alexis Bregeon , Ali Baheri , Peng Wei

Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art…

Systems and Control · Electrical Eng. & Systems 2023-04-20 Eivind Bøhn , Erlend M. Coates , Dirk Reinhardt , Tor Arne Johansen

This work introduces a toolchain for applying Reinforcement Learning (RL), specifically the Deep Deterministic Policy Gradient (DDPG) algorithm, in safety-critical real-world environments. As an exemplary application, transient load control…

Machine Learning · Computer Science 2026-02-25 Julian Bedei , Lucas Koch , Kevin Badalian , Alexander Winkler , Patrick Schaber , Jakob Andert

Continuous direct yaw moment control systems such as torque-vectoring controller are an essential part for vehicle stabilization. This controller has been extensively researched with the central objective of maintaining the vehicle…

Systems and Control · Electrical Eng. & Systems 2021-03-30 Shayan Taherian , Sampo Kuutti , Marco Visca , Saber Fallah

This study focuses on the development of a simulation-driven reinforcement learning (RL) framework for optimizing routing decisions in complex queueing network systems, with a particular emphasis on manufacturing and communication…

Artificial Intelligence · Computer Science 2025-07-28 Fatima Al-Ani , Molly Wang , Jevon Charles , Aaron Ong , Joshua Forday , Vinayak Modi

This paper proposes a fault-tolerant control strategy based on a tilt-rotor quadcopter prototype, utilizing nonlinear model predictive control to maintain both attitude and position stability in the event of rotor failure. The control…

Systems and Control · Electrical Eng. & Systems 2025-11-10 Yanchao Wang , Xu You , Mehdi Baghdadi

Increasing traffic demands, higher levels of automation, and communication enhancements provide novel design opportunities for future air traffic controllers (ATCs). This article presents a novel deep reinforcement learning (DRL) controller…

Machine Learning · Computer Science 2022-11-28 Lei Wang , Hongyu Yang , Yi Lin , Suwan Yin , Yuankai Wu

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Daniel Tabas , Baosen Zhang

Designing robust controllers for precise trajectory tracking with quadrotors is challenging due to nonlinear dynamics and underactuation, and becomes harder with flexible cable-suspended payloads that add degrees of freedom and hybrid…

Robotics · Computer Science 2025-10-02 Mintae Kim , Jiaze Cai , Koushil Sreenath

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

In this paper, we present a deep reinforcement learning method for quadcopter bypassing the obstacle on the flying path. In the past study, the algorithm only controls the forward direction about quadcopter. In this letter, we use two…

Artificial Intelligence · Computer Science 2018-11-13 Tung-Cheng Wu , Shau-Yin Tseng , Chin-Feng Lai , Chia-Yu Ho , Ying-Hsun Lai

We explore the reinforcement learning approach to designing controllers by extensively discussing the case of a quadcopter attitude controller. We provide all details allowing to reproduce our approach, starting with a model of the dynamics…

Artificial Intelligence · Computer Science 2021-07-28 Nicola Bernini , Mikhail Bessa , Rémi Delmas , Arthur Gold , Eric Goubault , Romain Pennec , Sylvie Putot , François Sillion

The proliferation of unmanned aerial vehicles (UAVs) in controlled airspace presents significant risks, including potential collisions, disruptions to air traffic, and security threats. Ensuring the safe and efficient operation of airspace,…

Robotics · Computer Science 2025-10-22 Francisco Giral , Ignacio Gómez , Soledad Le Clainche