English
Related papers

Related papers: Soft Actor-Critic Deep Reinforcement Learning for …

200 papers

Quadcopters can suffer from loss of propellers in mid-flight, thus requiring a need to have a system that detects single and multiple propeller failures and an adaptive controller that stabilizes the propeller-deficient quadcopter. This…

Robotics · Computer Science 2020-07-07 Rohitkumar Arasanipalai , Aakriti Agrawal , Debasish Ghose

Legged robots have shown promise in locomotion complex environments, but recovery from falls on challenging terrains remains a significant hurdle. This paper presents an Adaptive Fall Recovery (AFR) controller for quadrupedal robots on…

Robotics · Computer Science 2024-12-24 Yidan Lu , Yinzhao Dong , Ji Ma , Jiahui Zhang , Peng Lu

We explore the reinforcement learning approach to designing controllers by extensively discussing the case of a quadcopter attitude controller. We provide all details allowing to reproduce our approach, starting with a model of the dynamics…

Artificial Intelligence · Computer Science 2021-07-28 Nicola Bernini , Mikhail Bessa , Rémi Delmas , Arthur Gold , Eric Goubault , Romain Pennec , Sylvie Putot , François Sillion

We develop provably safe and convergent reinforcement learning (RL) algorithms for control of nonlinear dynamical systems, bridging the gap between the hard safety guarantees of control theory and the convergence guarantees of RL theory.…

Machine Learning · Computer Science 2024-03-08 Wesley A. Suttle , Vipul K. Sharma , Krishna C. Kosaraju , S. Sivaranjani , Ji Liu , Vijay Gupta , Brian M. Sadler

Controlling the flight of flapping-wing drones requires versatile controllers that handle their time-varying, nonlinear, and underactuated dynamics from incomplete and noisy sensor data. Model-based methods struggle with accurate modeling,…

Robotics · Computer Science 2025-05-27 Romain Poletti , Lorenzo Schena , Lilla Koloszar , Joris Degroote , Miguel Alfonso Mendez

Loss-of-control (LOC) remains a leading cause of fixed-wing aircraft accidents, especially in post-stall and flat-spin regimes where conventional gain-scheduled or logic-based recovery laws may fail. This study formulates spin-recovery as a…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Imran Sayyed , Aayush Konar , Nandan Kumar Sinha

This work contributes a novel deep navigation policy that enables collision-free flight of aerial robots based on a modular approach exploiting deep collision encoding and reinforcement learning. The proposed solution builds upon a deep…

Robotics · Computer Science 2024-02-07 Mihir Kulkarni , Kostas Alexis

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard…

Electric quadruped robots used in outdoor exploration are susceptible to leg-related electrical or mechanical failures. Unexpected joint power loss and joint locking can immediately pose a falling threat. Typically, controllers lack the…

Robotics · Computer Science 2024-02-15 Taixian Hou , Jiaxin Tu , Xiaofei Gao , Zhiyan Dong , Peng Zhai , Lihua Zhang

In federated learning (FL), model aggregation has been widely adopted for data privacy. In recent years, assigning different weights to local models has been used to alleviate the FL performance degradation caused by differences between…

Machine Learning · Computer Science 2022-02-01 Chenghao Huang , Weilong Chen , Yuxi Chen , Shunji Yang , Yanru Zhang

Quadrotors have demonstrated remarkable versatility, yet their full aerobatic potential remains largely untapped due to inherent underactuation and the complexity of aggressive maneuvers. Traditional approaches, separating trajectory…

Robotics · Computer Science 2025-06-02 Zhichao Han , Xijie Huang , Zhuxiu Xu , Jiarui Zhang , Yuze Wu , Mingyang Wang , Tianyue Wu , Fei Gao

Quadrotor stabilizing controllers often require careful, model-specific tuning for safe operation. We use reinforcement learning to train policies in simulation that transfer remarkably well to multiple different physical quadrotors. Our…

Robotics · Computer Science 2019-04-17 Artem Molchanov , Tao Chen , Wolfgang Hönig , James A. Preiss , Nora Ayanian , Gaurav S. Sukhatme

In this work, we present an approach to supervisory reinforcement learning control for unmanned aerial vehicles (UAVs). UAVs are dynamic systems where control decisions in response to disturbances in the environment have to be made in the…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

In the evolving landscape of high-speed agile quadrotor flight, achieving precise trajectory tracking at the platform's operational limits is paramount. Controllers must handle actuator constraints, exhibit robustness to disturbances, and…

Robotics · Computer Science 2025-10-15 Lukas Pries , Markus Ryll

This paper presents a reinforcement learning-based path-following controller for a fixed-wing small uncrewed aircraft system (sUAS) that is robust to certain actuator failures. The controller is conditioned on a parameterization of actuator…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Dennis Marquis , Mazen Farhood

In this paper, we present a deep reinforcement learning method for quadcopter bypassing the obstacle on the flying path. In the past study, the algorithm only controls the forward direction about quadcopter. In this letter, we use two…

Artificial Intelligence · Computer Science 2018-11-13 Tung-Cheng Wu , Shau-Yin Tseng , Chin-Feng Lai , Chia-Yu Ho , Ying-Hsun Lai

Faults are endemic to all systems. Adaptive fault-tolerant control maintains degraded performance when faults occur as opposed to unsafe conditions or catastrophic events. In systems with abrupt faults and strict time constraints, it is…

Machine Learning · Computer Science 2020-12-14 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Autonomy is a key challenge for future space exploration endeavours. Deep Reinforcement Learning holds the promises for developing agents able to learn complex behaviours simply by interacting with their environment. This paper investigates…

Robotics · Computer Science 2025-05-02 Matteo El Hariry , Andrea Cini , Giacomo Mellone , Alessandro Balossino

We study adaptive fault tolerant tracking control for uncertain linear systems. Based on recent results in funnel control and the time-varying Byrnes-Isidori form, we develop a low-complexity model-free controller which achieves prescribed…

Optimization and Control · Mathematics 2019-12-05 Thomas Berger