English
Related papers

Related papers: Bridging the Gap: Enabling Soft Actor Critic for H…

200 papers

During recent years, deep reinforcement learning (DRL) has made successful incursions into complex decision-making applications such as robotics, autonomous driving or video games. Off-policy algorithms tend to be more sample-efficient than…

Machine Learning · Computer Science 2021-12-06 Jesus Bujalance Martin , Raphael Chekroun , Fabien Moutarde

Proximal policy optimization (PPO) algorithm is a deep reinforcement learning algorithm with outstanding performance, especially in continuous control tasks. But the performance of this method is still affected by its exploration ability.…

Machine Learning · Computer Science 2020-11-12 Junwei Zhang , Zhenghao Zhang , Shuai Han , Shuai Lü

This article proposes a proximal policy optimization (PPO)-based reinforcement learning (RL) approach for DC-DC boost converter control that is compared with traditional control methods. The performance of the PPO algorithm is evaluated…

Systems and Control · Electrical Eng. & Systems 2025-01-03 Utsab Saha , Atik Jawad , Shakib Shahria , A. B. M Harun-Ur Rashid

Reinforcement learning (RL) is inherently rife with non-stationarity since the states and rewards the agent observes during training depend on its changing policy. Therefore, networks in deep RL must be capable of adapting to new…

Machine Learning · Computer Science 2024-11-21 Skander Moalla , Andrea Miele , Daniil Pyatko , Razvan Pascanu , Caglar Gulcehre

Offline reinforcement learning (RL) is a challenging setting where existing off-policy actor-critic methods perform poorly due to the overestimation of out-of-distribution state-action pairs. Thus, various additional augmentations are…

Machine Learning · Computer Science 2023-02-23 Zifeng Zhuang , Kun Lei , Jinxin Liu , Donglin Wang , Yilang Guo

Deep reinforcement learning (RL) uses model-free techniques to optimize task-specific control policies. Despite having emerged as a promising approach for complex problems, RL is still hard to use reliably for real-world applications. Apart…

Robotics · Computer Science 2020-02-25 Siddhant Gangapurwala , Alexander Mitchell , Ioannis Havoutis

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL…

Machine Learning · Computer Science 2021-05-27 Zohreh Raziei , Mohsen Moghaddam

Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. However, Robotics poses many challenges for RL, most notably training on a physical system can be expensive and dangerous, which…

Robotics · Computer Science 2017-10-19 Lerrel Pinto , Marcin Andrychowicz , Peter Welinder , Wojciech Zaremba , Pieter Abbeel

Proximal Policy Optimization (PPO) is a widely used reinforcement learning algorithm that heavily relies on accurate advantage estimates for stable and efficient training. However, raw advantage signals can exhibit significant variance,…

Machine Learning · Computer Science 2025-05-22 Soham Sane

The actor-critic (AC) algorithm is a popular method to find an optimal policy in reinforcement learning. In the infinite horizon scenario, the finite-sample convergence rate for the AC and natural actor-critic (NAC) algorithms has been…

Machine Learning · Computer Science 2021-02-15 Tengyu Xu , Zhe Wang , Yingbin Liang

Proximal policy optimization(PPO) has been proposed as a first-order optimization method for reinforcement learning. We should notice that an exterior penalty method is used in it. Often, the minimizers of the exterior penalty functions…

Machine Learning · Computer Science 2018-12-18 Cheng Zeng , Hongming Zhang

Unmanned Aerial Vehicles (UAVs), or drones, have recently been used in several civil application domains from organ delivery to remote locations to wireless network coverage. These platforms, however, are naturally unstable systems for…

Robotics · Computer Science 2020-10-07 Gabriel Moraes Barros , Esther Luna Colombini

With the explosive growth of rigid-body simulators, policy learning in simulation has become the de facto standard for most rigid morphologies. In contrast, soft robotic simulation frameworks remain scarce and are seldom adopted by the soft…

Robotics · Computer Science 2025-11-11 Andrew Choi , Dezhong Tong

We present a proximal policy optimization (PPO) agent trained through curriculum learning (CL) principles and meticulous reward engineering to optimize a real-world high-throughput waste sorting facility. Our work addresses the challenge of…

Machine Learning · Computer Science 2024-07-24 Abhijeet Pendyala , Asma Atamna , Tobias Glasmachers

Proximal policy optimization (PPO) is a widely-used algorithm for on-policy reinforcement learning. This work offers an alternative perspective of PPO, in which it is decomposed into the inner-loop estimation of update vectors, and the…

Machine Learning · Computer Science 2024-11-04 Charlie B. Tan , Edan Toledo , Benjamin Ellis , Jakob N. Foerster , Ferenc Huszár

Unmanned aerial vehicles (UAVs) have become increasingly popular in various fields, including precision agriculture, search and rescue, and remote sensing. However, exploring unknown environments remains a significant challenge. This study…

Multiagent Systems · Computer Science 2024-09-18 Ali Moltajaei Farid , Jafar Roshanian , Malek Mouhoub

Reinforcement learning (RL), driven by data-driven methods, has become an effective solution for robot leg motion control problems. However, the mainstream RL methods for bipedal robot terrain traversal, such as teacher-student policy…

Robotics · Computer Science 2025-08-05 Haodong Huang , Shilong Sun , Yuanpeng Wang , Chiyao Li , Hailin Huang , Wenfu Xu

Despite the popularity of the actor-critic method and the practical needs of collaborative policy training, existing works typically either overlook environmental heterogeneity or give up personalization altogether by training a single…

Machine Learning · Computer Science 2026-05-15 Leo Muxing Wang , Pengkun Yang , Lili Su

The proximal policy optimization (PPO) algorithm stands as one of the most prosperous methods in the field of reinforcement learning (RL). Despite its success, the theoretical understanding of PPO remains deficient. Specifically, it is…

Machine Learning · Computer Science 2023-06-09 Han Zhong , Tong Zhang

Motion planning is the soul of robot decision making. Classical planning algorithms like graph search and reaction-based algorithms face challenges in cases of dense and dynamic obstacles. Deep learning algorithms generate suboptimal…

Robotics · Computer Science 2023-09-08 Chengmin Zhou , Xin Lu , Jiapeng Dai , Bingding Huang , Xiaoxu Liu , Pasi Fränti