English
Related papers

Related papers: Soft Actor-Critic Deep Reinforcement Learning for …

200 papers

In this paper, we present a novel developmental reinforcement learning-based controller for a quadcopter with thrust vectoring capabilities. This multirotor UAV design has tilt-enabled rotors. It utilizes the rotor force magnitude and…

Robotics · Computer Science 2020-07-16 Aditya M. Deshpande , Rumit Kumar , Ali A. Minai , Manish Kumar

Autonomous unpowered flight is a challenge for control and guidance systems: all the energy the aircraft might use during flight has to be harvested directly from the atmosphere. We investigate the design of an algorithm that optimizes the…

Machine Learning · Computer Science 2017-07-19 Erwan Lecarpentier , Sebastian Rapp , Marc Melo , Emmanuel Rachelson

Inverted landing in a rapid and robust manner is a challenging feat for aerial robots, especially while depending entirely on onboard sensing and computation. In spite of this, this feat is routinely performed by biological fliers such as…

Robotics · Computer Science 2023-04-26 Bryan Habas , Jack W. Langelaan , Bo Cheng

This paper develops a reinforcement learning-based controller for the stabilization of partial differential equation (PDE) systems. Within the soft actor-critic (SAC) framework, we embed a DeepONet, a well-known neural operator (NO), which…

Optimization and Control · Mathematics 2026-03-13 Chenchen Wang , Jie Qi , Jiaqi Hu

We explore the potential to control terrain vehicles using deep reinforcement in scenarios where human operators and traditional control methods are inadequate. This letter presents a controller that perceives, plans, and successfully…

Robotics · Computer Science 2021-07-06 Viktor Wiberg , Erik Wallin , Martin Servin , Tomas Nordfjell

Multirotors play a significant role in diverse field robotics applications but remain highly susceptible to actuator failures, leading to rapid instability and compromised mission reliability. While various fault-tolerant control (FTC)…

Robotics · Computer Science 2025-05-14 Dohyun Kim , Jayden Dongwoo Lee , Hyochoong Bang , Jungho Bae

The significant components of any successful autonomous flight system are task completion and collision avoidance. Most deep learning algorithms successfully execute these aspects under the environment and conditions they are trained.…

Achieving controlled jumping behaviour for a quadruped robot is a challenging task, especially when introducing passive compliance in mechanical design. This study addresses this challenge via imitation-based deep reinforcement learning…

Robotics · Computer Science 2025-08-28 Georgios Apostolides , Wei Pan , Jens Kober , Cosimo Della Santina , Jiatao Ding

Purpose: Real-life applications using quadrotors introduce a number of disturbances and time-varying properties that pose a challenge to flight controllers. We observed that, when a quadrotor is tasked with picking up and dropping a…

Robotics · Computer Science 2022-10-07 Guilherme Siqueira Eduardo , Wouter Caarls

Soft-actuated insect-scale micro aerial vehicles (IMAVs) pose unique challenges for designing robust and computationally efficient controllers. At the millimeter scale, fast robot dynamics ($\sim$ms), together with system delay, model…

Robotics · Computer Science 2025-02-19 Yi-Hsuan Hsiao , Wei-Tung Chen , Yun-Sheng Chang , Pulkit Agrawal , YuFeng Chen

In this paper, we propose a novel cross-platform fault-tolerant surfacing controller for underwater robots, based on reinforcement learning (RL). Unlike conventional approaches, which require explicit identification of malfunctioning…

Robotics · Computer Science 2025-10-10 Yuya Hamamatsu , Walid Remmas , Jaan Rebane , Maarja Kruusmaa , Asko Ristolainen

This paper introduces a learning-based low-level controller for quadcopters, which adaptively controls quadcopters with significant variations in mass, size, and actuator capabilities. Our approach leverages a combination of imitation…

Robotics · Computer Science 2025-06-10 Dingqi Zhang , Antonio Loquercio , Jerry Tang , Ting-Hao Wang , Jitendra Malik , Mark W. Mueller

Reinforcement learning is a promising model-free and adaptive controller for demand side management, as part of the future smart grid, at the district level. This paper presents the results of the algorithm that was submitted for the…

Machine Learning · Computer Science 2021-04-27 Anjukan Kathirgamanathan , Kacper Twardowski , Eleni Mangina , Donal Finn

Neglecting complex aerodynamic effects hinders high-speed yet high-precision multirotor autonomy. In this paper, we present a computationally efficient learning-based model predictive controller that simultaneously optimizes a trajectory…

Robotics · Computer Science 2024-02-19 Babak Akbari , Melissa Greeff

Studies that broaden drone applications into complex tasks require a stable control framework. Recently, deep reinforcement learning (RL) algorithms have been exploited in many studies for robot control to accomplish complex tasks.…

This study is aimed at addressing the problem of fault tolerance of quadruped robots to actuator failure, which is critical for robots operating in remote or extreme environments. In particular, an adaptive curriculum reinforcement learning…

Robotics · Computer Science 2024-10-28 Wataru Okamoto , Hiroshi Kera , Kazuhiko Kawamoto

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they…

Robotics · Computer Science 2019-11-14 Eivind Bøhn , Erlend M. Coates , Signe Moe , Tor Arne Johansen

Realtime model learning proves challenging for complex dynamical systems, such as drones flying in variable wind conditions. Machine learning technique such as deep neural networks have high representation power but is often too slow to…

Robotics · Computer Science 2022-05-26 Michael O'Connell , Guanya Shi , Xichen Shi , Soon-Jo Chung

We train active neural-network flow controllers using a deep learning PDE augmentation method to optimize lift-to-drag ratios in turbulent airfoil flows at Reynolds number $5\times10^4$ and Mach number 0.4. Direct numerical simulation and…

Fluid Dynamics · Physics 2025-10-09 Xuemin Liu , Tom Hickling , Jonathan F. MacArt

The recent development of novel aerial vehicles capable of physically interacting with the environment leads to new applications such as contact-based inspection. These tasks require the robotic system to exchange forces with…

Robotics · Computer Science 2022-07-06 Weixuan Zhang , Lionel Ott , Marco Tognon , Roland Siegwart