English
Related papers

Related papers: Using Soft Actor-Critic for Low-Level UAV Control

200 papers

We present a deep reinforcement learning framework based on Soft Actor-Critic (SAC) for safe and precise maneuvering of double-Ackermann-steering mobile robots (DASMRs). Unlike holonomic or simpler non-holonomic robots such as…

Robotics · Computer Science 2025-10-15 Kohio Deflesselle , Mélodie Daniel , Aly Magassouba , Miguel Aranda , Olivier Ly

Unmanned Aerial Vehicles(UAVs) are attaining more and more maneuverability and sensory ability as a promising teleoperation platform for intelligent interaction with the environments. This work presents a novel 5-degree-of-freedom (DoF)…

Robotics · Computer Science 2022-10-28 Caiwu Ding , Hongwu Peng , Lu Lu , Caiwen Ding

This paper presents a novel approach to utilizing underactuated quadrotor Unmanned Aerial Vehicles (UAVs) as assistive devices in cooperative payload transportation task through human guidance and physical interaction. The proposed system…

Robotics · Computer Science 2024-12-24 Hussein Naser , Hashim A. Hashim , Mojtaba Ahmadi

Autonomous UAV inspection of confined industrial infrastructure, such as ventilation ducts, demands robust navigation policies where collisions are unacceptable. While Deep Reinforcement Learning (DRL) offers a powerful paradigm for…

Autonomous unmanned aerial vehicle (UAV) swarm networks (UAVSNs) can effectively execute surveillance, connectivity, and computing services to ground users (GUs). These missions require trajectory planning, UAV-GUs association, task…

Systems and Control · Electrical Eng. & Systems 2024-10-15 Muhammad Morshed Alam , Muhammad Yeasir Aarafat , Tamim Hossain

Off-policy actor-critic algorithms have shown strong potential in deep reinforcement learning for continuous control tasks. Their success primarily comes from leveraging pessimistic state-action value function updates, which reduce function…

Machine Learning · Computer Science 2025-08-21 Bahareh Tasdighi , Nicklas Werge , Yi-Shan Wu , Melih Kandemir

Obstacle avoidance for small unmanned aircraft is vital for the safety of future urban air mobility (UAM) and Unmanned Aircraft System (UAS) Traffic Management (UTM). There are many techniques for real-time robust drone guidance, but many…

Robotics · Computer Science 2021-11-16 Jueming Hu , Xuxi Yang , Weichang Wang , Peng Wei , Lei Ying , Yongming Liu

This paper presents a reinforcement learning-based path-following controller for a fixed-wing small uncrewed aircraft system (sUAS) that is robust to uncertainties in the aerodynamic model of the sUAS. The controller is trained using the…

Optimization and Control · Mathematics 2025-10-21 Dennis J. Marquis , Blake Wilhelm , Devaprakash Muniraj , Mazen Farhood

This paper presents the ARCAD simulator for the rapid development of Unmanned Aerial Systems (UAS), including underactuated and fully-actuated multirotors, fixed-wing aircraft, and Vertical Take-Off and Landing (VTOL) hybrid vehicles. The…

Robotics · Computer Science 2023-04-11 Azarakhsh Keipour , Mohammadreza Mousaei , Dongwei Bai , Junyi Geng , Sebastian Scherer

Robotic manipulation in unstructured environments requires reliable execution under diverse conditions, yet many state-of-the-art systems still struggle with high-dimensional action spaces, sparse rewards, and slow generalization beyond…

Robotics · Computer Science 2026-01-30 Leonidas Askianakis , Aleksandr Artemov

Existing actor-critic algorithms, which are popular for continuous control reinforcement learning (RL) tasks, suffer from poor sample efficiency due to lack of principled exploration mechanism within them. Motivated by the success of…

Machine Learning · Computer Science 2025-01-30 Haque Ishfaq , Guangyuan Wang , Sami Nur Islam , Doina Precup

In this work we present a novel extension of soft actor critic, a state of the art deep reinforcement algorithm. Our method allows us to combine traditional controllers with learned neural network policies. This combination allows us to…

Robotics · Computer Science 2020-12-23 Sean Gillen , Marco Molnar , Katie Byl

This article introduces a safe control strategy for application of forces to an external object using a dexterous robotic arm mounted on an unmanned Aerial Vehicle (UAV). A hybrid force-motion controller has been developed for this purpose.…

Autonomous parking is a key technology in modern autonomous driving systems, requiring high precision, strong adaptability, and efficiency in complex environments. This paper proposes a Deep Reinforcement Learning (DRL) framework based on…

Robotics · Computer Science 2025-05-01 Zheyu Zhang , Yutong Luo , Yongzhou Chen , Haopeng Zhao , Zhichao Ma , Hao Liu

Autonomous navigation in unknown complex environment is still a hard problem, especially for small Unmanned Aerial Vehicles (UAVs) with limited computation resources. In this paper, a neural network-based reactive controller is proposed for…

Robotics · Computer Science 2021-02-03 Lei He , Aouf Nabil , Bifeng Song

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL…

Machine Learning · Computer Science 2021-05-27 Zohreh Raziei , Mohsen Moghaddam

A core challenge for an autonomous agent acting in the real world is to adapt its repertoire of skills to cope with its noisy perception and dynamics. To scale learning of skills to long-horizon tasks, robots should be able to learn and…

Unmanned aerial vehicles (UAV) are commonly used for missions in unknown environments, where an exact mathematical model of the environment may not be available. This paper provides a framework for using reinforcement learning to allow the…

Robotics · Computer Science 2018-01-17 Huy X. Pham , Hung M. La , David Feil-Seifer , Luan V. Nguyen

In this study, we applied reinforcement learning based on the proximal policy optimization algorithm to perform motion planning for an unmanned aerial vehicle (UAV) in an open space with static obstacles. The application of reinforcement…

Robotics · Computer Science 2020-12-17 Sanghyun Kim , Jongmin Park , Jae-Kwan Yun , Jiwon Seo

Low-precision training has become a popular approach to reduce compute requirements, memory footprint, and energy consumption in supervised learning. In contrast, this promising approach has not yet enjoyed similarly widespread adoption…

Machine Learning · Computer Science 2021-06-07 Johan Bjorck , Xiangyu Chen , Christopher De Sa , Carla P. Gomes , Kilian Q. Weinberger