English
Related papers

Related papers: Control of a Quadrotor with Reinforcement Learning

200 papers

In many robotic tasks, such as autonomous drone racing, the goal is to travel through a set of waypoints as fast as possible. A key challenge for this task is planning the time-optimal trajectory, which is typically solved by assuming…

Robotics · Computer Science 2021-08-03 Yunlong Song , Mats Steinweg , Elia Kaufmann , Davide Scaramuzza

Deep Reinforcement learning has shown to be a powerful tool for developing policies in environments where an optimal solution is unclear. In this paper, we attempt to apply Twin Delayed Deep Deterministic Policy Gradients to train a neural…

Robotics · Computer Science 2024-12-20 Patrick Thomas , Kevin Schroeder , Jonathan Black

Flying quadrotors in tight formations is a challenging problem. It is known that in the near-field airflow of a quadrotor, the aerodynamic effects induced by the propellers are complex and difficult to characterize. Although machine…

Robotics · Computer Science 2024-10-15 Kong Yao Chee , Pei-An Hsieh , George J. Pappas , M. Ani Hsieh

A reinforcement learning (RL) based methodology is proposed and implemented for online fine-tuning of PID controller gains, thus, improving quadrotor effective and accurate trajectory tracking. The RL agent is first trained offline on a…

Systems and Control · Electrical Eng. & Systems 2025-02-10 Serhat Sönmez , Luca Montecchio , Simone Martini , Matthew J. Rutherford , Alessandro Rizzo , Margareta Stefanovic , Kimon P. Valavanis

Multirotors play a significant role in diverse field robotics applications but remain highly susceptible to actuator failures, leading to rapid instability and compromised mission reliability. While various fault-tolerant control (FTC)…

Robotics · Computer Science 2025-05-14 Dohyun Kim , Jayden Dongwoo Lee , Hyochoong Bang , Jungho Bae

The problem of safety for robotic systems has been extensively studied. However, little attention has been given to security issues for three-dimensional systems, such as quadrotors. Malicious adversaries can compromise robot sensors and…

Robotics · Computer Science 2024-09-19 Samuel Belkadi

This paper identifies and addresses the problems with naively combining (reinforcement) learning-based controllers and state estimators for robotic in-hand manipulation. Specifically, we tackle the challenging task of purely tactile,…

Robotics · Computer Science 2024-01-09 Lennart Röstel , Johannes Pitz , Leon Sievers , Berthold Bäuml

First-order reinforcement learning with differentiable simulation is promising for quadrotor control, but practical progress remains fragmented across task-specific settings. To support more systematic development and evaluation, we present…

Robotics · Computer Science 2026-03-24 Fanxing Li , Fangyu Sun , Tianbao Zhang , Shuyu Wu , Dexin Zuo , yufei Yan , Wenxian Yu , Danping Zou

The ability to perform aggressive movements, which are called aggressive flights, is important for quadrotors during navigation. However, aggressive quadrotor flights are still a great challenge to practical applications. The existing…

Robotics · Computer Science 2022-03-29 Qiyu Sun , Jinbao Fang , Wei Xing Zheng , Yang Tang

This paper focuses on finding reinforcement learning policies for control systems with hard state and action constraints. Despite its success in many domains, reinforcement learning is challenging to apply to problems with hard constraints,…

Machine Learning · Computer Science 2020-03-24 Liyuan Zheng , Yuanyuan Shi , Lillian J. Ratliff , Baosen Zhang

The mechanical simplicity, hover capabilities, and high agility of quadrotors lead to a fast adaption in the industry for inspection, exploration, and urban aerial mobility. On the other hand, the unstable and underactuated dynamics of…

Robotics · Computer Science 2022-02-11 Fang Nan , Sihao Sun , Philipp Foehn , Davide Scaramuzza

In comparison to common quadrotors, the shape change of morphing quadrotors endows it with a more better flight performance but also results in more complex flight dynamics. Generally, it is extremely difficult or even impossible for…

Robotics · Computer Science 2024-08-26 Tao Yang , Huai-Ning Wu , Jun-Wei Wang

In this study, we applied reinforcement learning based on the proximal policy optimization algorithm to perform motion planning for an unmanned aerial vehicle (UAV) in an open space with static obstacles. The application of reinforcement…

Robotics · Computer Science 2020-12-17 Sanghyun Kim , Jongmin Park , Jae-Kwan Yun , Jiwon Seo

In this work, we present an approach to supervisory reinforcement learning control for unmanned aerial vehicles (UAVs). UAVs are dynamic systems where control decisions in response to disturbances in the environment have to be made in the…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

In this paper, we investigate the problem of enabling a drone to fly through a tilted narrow gap, without a traditional planning and control pipeline. To this end, we propose an end-to-end policy network, which imitates from the traditional…

Robotics · Computer Science 2019-08-06 Jiarong Lin , Luqi Wang , Fei Gao , Shaojie Shen , Fu Zhang

Fault-tolerant control is crucial for safety-critical systems, such as quadrotors. State-of-art flight controllers can stabilize and control a quadrotor even when subjected to the complete loss of a rotor. However, these methods rely on…

Robotics · Computer Science 2021-03-01 Sihao Sun , Giovanni Cioffi , Coen de Visser , Davide Scaramuzza

Reinforcement learning (RL)-based quadrotor control policies have achieved impressive performance in tasks such as fast navigation in cluttered environments and drone racing, where the focus is on speed and agility. However, in several…

This paper proposes a learning-based passive fault-tolerant control (PFTC) method for quadrotor capable of handling arbitrary single-rotor failures, including conditions ranging from fault-free to complete rotor failure, without requiring…

Robotics · Computer Science 2025-03-05 Jiehao Chen , Kaidong Zhao , Zihan Liu , YanJie Li , Yunjiang Lou

This paper proposes a geometric adaptive controller for a quadrotor unmanned aerial vehicle with artificial neural networks. It is assumed that the dynamics of a quadrotor is disturbed by arbitrary, unstructured forces and moments caused by…

Optimization and Control · Mathematics 2019-03-07 Mahdis Bisheban , Taeyoung Lee

Model predictive control can optimally deal with nonlinear systems under consideration of constraints. The control performance depends on the model accuracy and the prediction horizon. Recent advances propose to use reinforcement learning…

Machine Learning · Computer Science 2024-11-01 Dean Brandner , Sergio Lucia