English
Related papers

Related papers: Control of a Quadrotor with Reinforcement Learning

200 papers

This paper presents a reinforcement learning-based neuroadaptive control framework for robotic manipulators operating under deferred constraints. The proposed approach improves traditional barrier Lyapunov functions by introducing a smooth…

Robotics · Computer Science 2025-03-20 Hamed Rahimi Nohooji , Abolfazl Zaraki , Holger Voos

This paper proposes a reinforcement learning approach for traffic control with the adaptive horizon. To build the controller for the traffic network, a Q-learning-based strategy that controls the green light passing time at the network…

Systems and Control · Computer Science 2019-04-01 Wentao Chen , Tehuan Chen , Guang Lin

The paper presents a technique using reinforcement learning (RL) to adapt the control gains of a quadcopter controller. Specifically, we employed Proximal Policy Optimization (PPO) to train a policy which adapts the gains of a cascaded…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Mike Timmerman , Aryan Patel , Tim Reinhart

In this paper, we tackle the problem of flying a quadrotor using time-optimal control policies that can be replanned online when the environment changes or when encountering unknown disturbances. This problem is challenging as the…

Robotics · Computer Science 2022-07-22 Angel Romero , Robert Penicka , Davide Scaramuzza

Designing effective low-level robot controllers often entail platform-specific implementations that require manual heuristic parameter tuning, significant system knowledge, or long design times. With the rising number of robotic and…

Robust adaptive model predictive control (RAMPC) is a novel control method that combines robustness guarantees with respect to unknown parameters and bounded disturbances into a model predictive control scheme. However, RAMPC has so far…

Systems and Control · Electrical Eng. & Systems 2021-08-27 Alexandre Didier , Anilkumar Parsi , Jeremy Coulson , Roy S. Smith

A long-cherished vision of drones is to autonomously traverse through clutter to reach every corner of the world using onboard sensing and computation. In this paper, we combine onboard 3D lidar sensing and sim-to-real reinforcement…

Robotics · Computer Science 2025-03-04 Guangtong Xu , Tianyue Wu , Zihan Wang , Qianhao Wang , Fei Gao

This paper introduces a new multi-model predictive control (MMPC) method for quadrotor attitude control with performance nearly on par with nonlinear model predictive control (NMPC) and computational efficiency similar to linear model…

Robotics · Computer Science 2024-06-25 Mohammadreza Izadi , Zeinab Shayan , Reza Faieghi

Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges,…

There has recently been an increased interest in reinforcement learning for nonlinear control problems. However standard reinforcement learning algorithms can often struggle even on seemingly simple set-point control problems. This paper…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattsson , Torbjörn Wigren

In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off-the-shelf deep reinforcement learning…

Robotics · Computer Science 2021-06-18 Nikita Rudin , Hendrik Kolvenbach , Vassilios Tsounis , Marco Hutter

Recurrent Neural Networks (RNNs) can encode rich dynamics which makes them suitable for modeling dynamic systems. To train an RNN for multi-step prediction of dynamic systems, it is crucial to efficiently address the state initialization…

Neural and Evolutionary Computing · Computer Science 2018-06-05 Nima Mohajerin , Steven L. Waslander

Deep Reinforcement Learning (DRL) has been applied successfully to many robotic applications. However, the large number of trials needed for training is a key issue. Most of existing techniques developed to improve training efficiency (e.g.…

Robotics · Computer Science 2018-12-13 Linhai Xie , Sen Wang , Stefano Rosa , Andrew Markham , Niki Trigoni

In marine operations underwater manipulators play a primordial role. However, due to uncertainties in the dynamic model and disturbances caused by the environment, low-level control methods require great capabilities to adapt to change.…

Robotics · Computer Science 2021-08-06 Ignacio Carlucho , Mariano De Paula , Gerardo G. Acosta , Corina Barbalata

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

Quadcopters can suffer from loss of propellers in mid-flight, thus requiring a need to have a system that detects single and multiple propeller failures and an adaptive controller that stabilizes the propeller-deficient quadcopter. This…

Robotics · Computer Science 2020-07-07 Rohitkumar Arasanipalai , Aakriti Agrawal , Debasish Ghose

Machine learning algorithms learn to solve a task, but are unable to improve their ability to learn. Meta-learning methods learn about machine learning algorithms and improve them so that they learn more quickly. However, existing…

Machine Learning · Computer Science 2025-01-28 Calarina Muslimani , Alex Lewandowski , Dale Schuurmans , Matthew E. Taylor , Jun Luo

A new training algorithm is presented for delayed reinforcement learning problems that does not assume the existence of a critic model and employs the polytope optimization algorithm to adjust the weights of the action network so that a…

Neural and Evolutionary Computing · Computer Science 2007-05-23 A. Likas , I. E. Lagaris

Reinforcement learning methods often produce brittle policies -- policies that perform well during training, but generalize poorly beyond their direct training experience, thus becoming unstable under small disturbances. To address this…

Robotics · Computer Science 2023-02-14 Sergey Pankov

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch