English
Related papers

Related papers: Using Soft Actor-Critic for Low-Level UAV Control

200 papers

The ability of a soft robot to perform specific tasks is determined by its contact configuration, and transitioning between configurations is often necessary to reach a desired position or manipulate an object. Based on this observation, we…

Robotics · Computer Science 2024-02-22 Etienne Ménager , Christian Duriez

Reinforcement Learning (RL) has shown great potential in complex control tasks, particularly when combined with deep neural networks within the Actor-Critic (AC) framework. However, in practical applications, balancing exploration, learning…

Robotics · Computer Science 2026-02-25 Zhiwei Shang , Xinyi Yuan , Wenjun Huang , Yunduan Cui , Di Chen , Meixin Zhu

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

Machine Learning · Computer Science 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

With the rising popularity of UAVs in the civilian world, we are currently witnessing and paradim shift in terms of operational safety of flying vehicles. Safe and ubiquitous human-system interaction shall remain the core requirement but…

Robotics · Computer Science 2018-03-28 Juan-Pablo Afman , Laurent Ciarletta , Eric Feron , John Franklin , Thomas Gurriet , Eric N. Johnson

In recent years, unmanned aerial vehicle (UAV) related technology has expanded knowledge in the area, bringing to light new problems and challenges that require solutions. Furthermore, because the technology allows processes usually carried…

Artificial Intelligence · Computer Science 2022-12-08 Cristian Millán-Arias , Ruben Contreras , Francisco Cruz , Bruno Fernandes

Recently, learning-based controllers have been shown to push mobile robotic systems to their limits and provide the robustness needed for many real-world applications. However, only classical optimization-based control frameworks offer the…

Robotics · Computer Science 2023-04-04 Leonard Bauersfeld , Elia Kaufmann , Davide Scaramuzza

Unmanned Aerial Vehicles (UAVs) depend on onboard sensors for perception, navigation, and control. However, these sensors are susceptible to physical attacks, such as GPS spoofing, that can corrupt state estimates and lead to unsafe…

Machine Learning · Computer Science 2025-06-30 Pritam Dash , Ethan Chan , Nathan P. Lawrence , Karthik Pattabiraman

Improving sampling efficiency and generalization capability is critical for the successful data-driven control of quadrotor unmanned aerial vehicles (UAVs) that are inherently unstable. While various reinforcement learning (RL) approaches…

Robotics · Computer Science 2025-03-03 Beomyeol Yu , Taeyoung Lee

Performing intervention tasks in the maritime domain is crucial for safety and operational efficiency. The unpredictable and dynamic marine environment makes the intervention tasks such as object manipulation extremely challenging. This…

Robotics · Computer Science 2024-06-06 Ahmed Nader , Muhayy Ud Din , Mughni Irfan , Irfan Hussain

Actor-critic algorithms address the dual goals of reinforcement learning (RL), policy evaluation and improvement via two separate function approximators. The practicality of this approach comes at the expense of training instability, caused…

Machine Learning · Computer Science 2024-06-11 Bahareh Tasdighi , Abdullah Akgül , Manuel Haussmann , Kenny Kazimirzak Brink , Melih Kandemir

We present a Multi-task Soft Actor-Critic (SAC) Reinforcement Learning framework designed for open-system quantum control across diverse Hamiltonians, which learns optimal pulse sequences while simultaneously discovering problem-specific…

Quantum Physics · Physics 2026-05-27 Haftu W. Fentaw , Steve Campbell , Simon Caton

With the increase in use of Unmanned Aerial Vehicles (UAVs)/drones, it is important to detect and identify causes of failure in real time for proper recovery from a potential crash-like scenario or post incident forensics analysis. The…

Signal Processing · Electrical Eng. & Systems 2020-05-08 Vidyasagar Sadhu , Saman Zonouz , Dario Pompili

The performance of deep reinforcement learning methods prone to degenerate when applied to environments with non-stationary dynamics. In this paper, we utilize the latent context recurrent encoders motivated by recent Meta-RL materials, and…

Machine Learning · Computer Science 2021-05-11 Yuan Pu , Shaochen Wang , Xin Yao , Bin Li

Rigid grippers used in existing aerial manipulators require precise positioning to achieve successful grasps and transmit large contact forces that may destabilize the drone. This limits the speed during grasping and prevents "dynamic…

Robotics · Computer Science 2021-10-04 Joshua Fishman , Samuel Ubellacker , Nathan Hughes , Luca Carlone

Learning from data of past tasks can substantially improve the accuracy of mechatronic systems. Often, for fast and safe learning a model of the system is required. The aim of this paper is to develop a model-free approach for fast and safe…

Systems and Control · Electrical Eng. & Systems 2020-07-06 Maurice Poot , Jim Portegies , Tom Oomen

In this paper, we present a method to control a quadrotor with a neural network trained using reinforcement learning techniques. With reinforcement learning, a common network can be trained to directly map state to actuator command making…

Robotics · Computer Science 2017-07-18 Jemin Hwangbo , Inkyu Sa , Roland Siegwart , Marco Hutter

Ability to recover from faults and continue mission is desirable for many quadrotor applications. The quadrotor's rotor may fail while performing a mission and it is essential to develop recovery strategies so that the vehicle is not…

Robotics · Computer Science 2021-09-23 Paras Sharma , Prithvi Poddar , P. B. Sujit

Model-free deep reinforcement learning (RL) has been successfully applied to challenging continuous control domains. However, poor sample efficiency prevents these methods from being widely used in real-world domains. This paper introduces…

Machine Learning · Computer Science 2022-10-27 Sicen Li , Qinyun Tang , Yiming Pang , Xinmeng Ma , Gang Wang

Reinforcement learning (RL) is widely used for humanoid control, with on-policy methods such as Proximal Policy Optimization (PPO) enabling robust training via large-scale parallel simulation and, in some cases, zero-shot deployment to real…

Robotics · Computer Science 2026-02-24 Weidong Huang , Zhehan Li , Hangxin Liu , Biao Hou , Yao Su , Jingwen Zhang

Landing an unmanned aerial vehicle (UAV) on a ground marker is an open problem despite the effort of the research community. Previous attempts mostly focused on the analysis of hand-crafted geometric features and the use of external sensors…

Artificial Intelligence · Computer Science 2018-02-28 Riccardo Polvara , Massimiliano Patacchiola , Sanjay Sharma , Jian Wan , Andrew Manning , Robert Sutton , Angelo Cangelosi