English
Related papers

Related papers: Reinforcement Learning with Formal Performance Met…

200 papers

Reinforcement learning (RL) has demonstrated the ability to maintain the plasticity of the policy throughout short-term training in aerial robot control. However, these policies have been shown to loss of plasticity when extended to…

Robotics · Computer Science 2025-03-11 Ali Tahir Karasahin , Ziniu Wu , Basaran Bahadir Kocer

The paper presents a technique using reinforcement learning (RL) to adapt the control gains of a quadcopter controller. Specifically, we employed Proximal Policy Optimization (PPO) to train a policy which adapts the gains of a cascaded…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Mike Timmerman , Aryan Patel , Tim Reinhart

Airborne Wind Energy is a lightweight technology that allows power extraction from the wind using airborne devices such as kites and gliders, where the airfoil orientation can be dynamically controlled in order to maximize performance. The…

Fluid Dynamics · Physics 2022-03-29 N. Orzan , C. Leone , A. Mazzolini , J. Oyero , A. Celani

In this paper, we present a method to control a quadrotor with a neural network trained using reinforcement learning techniques. With reinforcement learning, a common network can be trained to directly map state to actuator command making…

Robotics · Computer Science 2017-07-18 Jemin Hwangbo , Inkyu Sa , Roland Siegwart , Marco Hutter

Model-free reinforcement learning based methods such as Proximal Policy Optimization, or Q-learning typically require thousands of interactions with the environment to approximate the optimum controller which may not always be feasible in…

Machine Learning · Computer Science 2019-05-16 Narendra Patwardhan , Zequn Wang

A reinforcement learning (RL) based methodology is proposed and implemented for online fine-tuning of PID controller gains, thus, improving quadrotor effective and accurate trajectory tracking. The RL agent is first trained offline on a…

Systems and Control · Electrical Eng. & Systems 2025-02-10 Serhat Sönmez , Luca Montecchio , Simone Martini , Matthew J. Rutherford , Alessandro Rizzo , Margareta Stefanovic , Kimon P. Valavanis

Enabling the capability of assessing risk and making risk-aware decisions is essential to applying reinforcement learning to safety-critical robots like drones. In this paper, we investigate a specific case where a nano quadcopter robot…

Robotics · Computer Science 2022-09-27 Cheng Liu , Erik-Jan van Kampen , Guido C. H. E. de Croon

The Crazyflie quadcopter is widely recognized as a leading platform for nano-quadcopter research. In early 2025, the Crazyflie Brushless was introduced, featuring brushless motors that provide around 50% more thrust compared to the brushed…

Robotics · Computer Science 2026-03-09 Alexander Gräfe , Christoph Scherer , Wolfgang Hönig , Sebastian Trimpe

This paper presents an equivariant reinforcement learning framework for quadrotor unmanned aerial vehicles. Successful training of reinforcement learning often requires numerous interactions with the environments, which hinders its…

Machine Learning · Computer Science 2023-02-28 Beomyeol Yu , Taeyoung Lee

We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an…

Optimization and Control · Mathematics 2024-07-30 Simon Gottschalk , Lukas Lanza , Karl Worthmann , Kerstin Lux-Gottschalk

Quadcopter attitude control involves two tasks: smooth attitude tracking and aggressive stabilization from arbitrary states. Although both can be formulated as tracking problems, their distinct state spaces and control strategies complicate…

Robotics · Computer Science 2025-03-12 Yu Tang Liu , Afonso Vale , Aamir Ahmad , Rodrigo Ventura , Meysam Basiri

The capability to autonomously track a non-cooperative target is a key technological requirement for micro aerial vehicles. In this paper, we propose an output feedback control scheme based on deep reinforcement learning for controlling a…

Robotics · Computer Science 2024-02-08 Alberto Dionigi , Mirko Leomanni , Alessandro Saviolo , Giuseppe Loianno , Gabriele Costante

This paper proposes an adaptive near-hover position controller for quadcopters, which can be deployed to quadcopters of very different mass, size and motor constants, and also shows rapid adaptation to unknown disturbances during runtime.…

Robotics · Computer Science 2023-05-04 Dingqi Zhang , Antonio Loquercio , Xiangyu Wu , Ashish Kumar , Jitendra Malik , Mark W. Mueller

We propose a joint simulation and real-world learning framework for mapping navigation instructions and raw first-person observations to continuous control. Our model estimates the need for environment exploration, predicts the likelihood…

Robotics · Computer Science 2019-10-23 Valts Blukis , Yannick Terme , Eyvind Niklasson , Ross A. Knepper , Yoav Artzi

Safety is a critical feature of controller design for physical systems. When designing control policies, several approaches to guarantee this aspect of autonomy have been proposed, such as robust controllers or control barrier functions.…

Machine Learning · Computer Science 2021-02-26 Miguel Calvo-Fullana , Luiz F. O. Chamon , Santiago Paternain

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possible faults. Instead it…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Hamed Khorasgani , Gautam Biswas

This study focuses on designing and developing a mathematically based quadcopter rotational dynamics simulation framework for testing reinforcement learning (RL) algorithms in many flexible configurations. The design of the simulation…

Machine Learning · Computer Science 2022-02-22 Burak Han Demirbilek

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang