English
Related papers

Related papers: Soft Actor-Critic Deep Reinforcement Learning for …

200 papers

Landing a quadrotor on an inclined surface is a challenging maneuver. The final state of any inclined landing trajectory is not an equilibrium, which precludes the use of most conventional control methods. We propose a deep reinforcement…

Robotics · Computer Science 2022-07-29 Jacob E. Kooi , Robert Babuška

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

Systems and Control · Computer Science 2019-10-09 David Mguni

An integrated framework of computational fluid-structural dynamics (CFD-CSD) and deep reinforcement learning (deep-RL) is developed for control of a fly-scale flexible-winged flyer in complex flow. Dynamics of the flyer in complex flow is…

Machine Learning · Computer Science 2021-11-08 Seungpyo Hong , Sejin Kim , Donghyun You

In the field of autonomous Unmanned Aerial Vehicles (UAVs) landing, conventional approaches fall short in delivering not only the required precision but also the resilience against environmental disturbances. Yet, learning-based algorithms…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Francisco Neves , Luís Branco , Maria Pereira , Rafael Claro , Andry Pinto

Fault tolerance is achieved through multiply redundant hardware systems in large civil aircraft. This means of achieving fault tolerance is infeasible for small compact unmanned aerial vehicles. In this paper we apply a fault tolerant…

Optimization and Control · Mathematics 2016-10-12 Rudaba Khan , Paul Williams , Paul Riseborough , Asha Rao , Robin Hill

Adaptive methods are popular within the control literature due to the flexibility and forgiveness they offer in the area of modelling. Neural network adaptive control is favorable specifically for the powerful nature of the machine learning…

Systems and Control · Electrical Eng. & Systems 2021-07-23 Nathan Lutes , K. Krishnamurthy , Venkata Sriram Siddhardh Nadendla , S. N. Balakrishnan

This study has developed a fault-tolerant controller that is able to recover a quadrotor from arbitrary initial orientations and angular velocities, despite the complete failure of a rotor. This cascaded control method includes a…

Robotics · Computer Science 2020-10-28 Sihao Sun , Matthias Baert , Bram Adriaan Strack van Schijndel , Coen de Visser

Motion planning failures during autonomous navigation often occur when safety constraints are either too conservative, leading to deadlocks, or too liberal, resulting in collisions. To improve robustness, a robot must dynamically adapt its…

Robotics · Computer Science 2025-03-12 Nicholas Mohammad , Nicola Bezzo

Wind resistance control is an essential feature for quadcopters to maintain their position to avoid deviation from target position and prevent collisions with obstacles. Conventionally, cascaded PID controller is used for the control of…

Robotics · Computer Science 2023-08-04 Yu Ishihara , Yuichi Hazama , Kousuke Suzuki , Jerry Jun Yokono , Kohtaro Sabe , Kenta Kawamoto

The ability to recover from a fall is an essential feature for a legged robot to navigate in challenging environments robustly. Until today, there has been very little progress on this topic. Current solutions mostly build upon…

Robotics · Computer Science 2024-12-20 Joonho Lee , Jemin Hwangbo , Marco Hutter

Traditional control methods are inadequate in many deployment settings involving control of Cyber-Physical Systems (CPS). In such settings, CPS controllers must operate and respond to unpredictable interactions, conditions, or failure…

Machine Learning · Computer Science 2019-09-17 William Koch

This paper proposes a fault-tolerant control strategy based on a tilt-rotor quadcopter prototype, utilizing nonlinear model predictive control to maintain both attitude and position stability in the event of rotor failure. The control…

Systems and Control · Electrical Eng. & Systems 2025-11-10 Yanchao Wang , Xu You , Mehdi Baghdadi

The ball-balancing robot (ballbot) is a good platform to test the effectiveness of a balancing controller. Considering balancing control, conventional model-based feedback control methods have been widely used. However, contacts and…

Robotics · Computer Science 2022-08-23 Yifan Zhou , Jianghao Lin , Shuai Wang , Chong Zhang

This paper proposes a new Reinforcement Learning (RL) based control architecture for quadrotors. With the literature focusing on controlling the four rotors' RPMs directly, this paper aims to control the quadrotor's thrust vector. The RL…

Robotics · Computer Science 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

In this paper we investigate the design of an active fault tolerant control system applicable to autonomous flight. The system comprises a nonlinear model predictive based controller integrated with an unscented Kalman filter for fault…

Optimization and Control · Mathematics 2016-10-10 Rudaba Khan , Paul Williams , Paul Riseborough , Asha Rao , Robin Hill

The present study applies a Deep Reinforcement Learning (DRL) algorithm to Active Flow Control (AFC) of a two-dimensional flow around a confined square cylinder. Specifically, the Soft Actor-Critic (SAC) algorithm is employed to modulate…

Fluid Dynamics · Physics 2024-09-27 Wang Jia , Hang Xu

Quadcopter attitude control involves two tasks: smooth attitude tracking and aggressive stabilization from arbitrary states. Although both can be formulated as tracking problems, their distinct state spaces and control strategies complicate…

Robotics · Computer Science 2025-03-12 Yu Tang Liu , Afonso Vale , Aamir Ahmad , Rodrigo Ventura , Meysam Basiri

The proliferation of unmanned aerial vehicles (UAVs) in controlled airspace presents significant risks, including potential collisions, disruptions to air traffic, and security threats. Ensuring the safe and efficient operation of airspace,…

Robotics · Computer Science 2025-10-22 Francisco Giral , Ignacio Gómez , Soledad Le Clainche

Propeller failure is a major cause of multirotor Unmanned Aerial Vehicles (UAVs) crashes. While conventional multirotor systems struggle to address this issue due to underactuation, over-actuated platforms can continue flying with…

Robotics · Computer Science 2023-06-16 Yao Su , Pengkang Yu , Matthew J. Gerber , Lecheng Ruan , Tsu-Chin Tsao

Controlled gliding is one of the most energetically efficient modes of transportation for natural and human powered fliers. Here we demonstrate that gliding and landing strategies with different optimality criteria can be identified through…

Robotics · Computer Science 2018-07-11 Guido Novati , Lakshminarayanan Mahadevan , Petros Koumoutsakos