English
Related papers

Related papers: Combine PPO with NES to Improve Exploration

200 papers

At first sight it may seem straightforward to use recurrent layers in Deep Reinforcement Learning algorithms to enable agents to make use of memory in the setting of partially observable environments. Starting from widely used Proximal…

Machine Learning · Computer Science 2022-05-24 Marco Pleines , Matthias Pallasch , Frank Zimmer , Mike Preuss

Proximal Policy Optimization (PPO) is widely used in continuous control due to its robustness and stable training, yet it remains sample-inefficient in tasks with expensive interactions and high-dimensional action spaces. This paper…

Machine Learning · Computer Science 2025-12-16 Tianci Gao , Konstantin A. Neusypin , Dmitry D. Dmitriev , Bo Yang , Shengren Rao

This paper proposes an exploration method for deep reinforcement learning based on parameter space noise. Recent studies have experimentally shown that parameter space noise results in better exploration than the commonly used action space…

Machine Learning · Statistics 2018-09-28 Izumi Karino , Kazutoshi Tanaka , Ryuma Niiyama , Yasuo Kuniyoshi

Proximal policy optimization(PPO) has been proposed as a first-order optimization method for reinforcement learning. We should notice that an exterior penalty method is used in it. Often, the minimizers of the exterior penalty functions…

Machine Learning · Computer Science 2018-12-18 Cheng Zeng , Hongming Zhang

We consider the stochastic single node energy storage problem (SNES) and revisit Approximate Policy Iteration (API) to solve SNES. We show that the performance of API can be boosted by using neural networks as an approximation architecture…

Optimization and Control · Mathematics 2019-10-07 Trivikram Dokka , Richlove Frimpong

Residential demand response programs aim to activate demand flexibility at the household level. In recent years, reinforcement learning (RL) has gained significant attention for these type of applications. A major challenge of RL algorithms…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Thijs Peirelinck , Chris Hermans , Fred Spiessens , Geert Deconinck

Proximal policy optimization (PPO) algorithm is a deep reinforcement learning algorithm with outstanding performance, especially in continuous control tasks. But the performance of this method is still affected by its exploration ability.…

Machine Learning · Computer Science 2020-11-12 Junwei Zhang , Zhenghao Zhang , Shuai Han , Shuai Lü

In recent years, reinforcement learning (RL) has gained increasing attention in control engineering. Especially, policy gradient methods are widely used. In this work, we improve the tracking performance of proximal policy optimization…

Machine Learning · Computer Science 2021-07-21 Jana Mayer , Johannes Westermann , Juan Pedro Gutiérrez H. Muriedas , Uwe Mettin , Alexander Lampe

Automated machine learning aims to automate the whole process of machine learning, including model configuration. In this paper, we focus on automated hyperparameter optimization (HPO) based on sequential model-based optimization (SMBO).…

Machine Learning · Computer Science 2019-09-11 Ying Wei , Peilin Zhao , Huaxiu Yao , Junzhou Huang

Proximal Policy Optimization (PPO) is a popular deep policy gradient algorithm. In standard implementations, PPO regularizes policy updates with clipped probability ratios, and parameterizes policies with either continuous Gaussian…

Machine Learning · Computer Science 2020-09-24 Chloe Ching-Yun Hsu , Celestine Mendler-Dünner , Moritz Hardt

Proximal Policy Optimization (PPO) is a widely used reinforcement learning algorithm that heavily relies on accurate advantage estimates for stable and efficient training. However, raw advantage signals can exhibit significant variance,…

Machine Learning · Computer Science 2025-05-22 Soham Sane

We analyze a learning-to-optimize (L2O) algorithm that exploits parameter space symmetry to enhance optimization efficiency. Prior work has shown that jointly learning symmetry transformations and local updates improves meta-optimizer…

Machine Learning · Computer Science 2025-04-23 Guy Zamir , Aryan Dokania , Bo Zhao , Rose Yu

Reinforcement Learning has yielded promising results for Neural Architecture Search (NAS). In this paper, we demonstrate how its performance can be improved by using a simplified Transformer block to model the policy network. The simplified…

Machine Learning · Computer Science 2020-11-06 Chepuri Shri Krishna , Ashish Gupta , Swarnim Narayan , Himanshu Rai , Diksha Manchanda

Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limited resources. This…

Machine Learning · Computer Science 2024-01-30 Burcu Küçükoğlu , Walraaf Borkent , Bodo Rueckauer , Nasir Ahmad , Umut Güçlü , Marcel van Gerven

Proximal Policy Optimization with Adaptive Exploration (axPPO) is introduced as a novel learning algorithm. This paper investigates the exploration-exploitation tradeoff within the context of reinforcement learning and aims to contribute…

Machine Learning · Computer Science 2024-05-09 Andrei Lixandru

Zeroth-order local optimisation algorithms are essential for solving real-valued black-box optimisation problems. Among these, Natural Evolution Strategies (NES) represent a prominent class, particularly well-suited for scenarios where…

Machine Learning · Computer Science 2025-07-11 Pierre Osselin , Masaki Adachi , Xiaowen Dong , Michael A. Osborne

Proficient game agents with diverse play styles enrich the gaming experience and enhance the replay value of games. However, recent advancements in game AI based on reinforcement learning have predominantly focused on improving proficiency,…

Artificial Intelligence · Computer Science 2025-09-23 Lingfeng Li , Yunlong Lu , Yongyi Wang , Wenxin Li

Policy optimization methods with function approximation are widely used in multi-agent reinforcement learning. However, it remains elusive how to design such algorithms with statistical guarantees. Leveraging a multi-agent performance…

Machine Learning · Computer Science 2023-05-09 Yulai Zhao , Zhuoran Yang , Zhaoran Wang , Jason D. Lee

Recent developments have established the vulnerability of deep reinforcement learning to policy manipulation attacks via intentionally perturbed inputs, known as adversarial examples. In this work, we propose a technique for mitigation of…

Machine Learning · Computer Science 2018-06-07 Vahid Behzadan , Arslan Munir

This paper presents Natural Evolution Strategies (NES), a recent family of algorithms that constitute a more principled approach to black-box optimization than established evolutionary algorithms. NES maintains a parameterized distribution…

Machine Learning · Statistics 2011-06-23 Daan Wierstra , Tom Schaul , Tobias Glasmachers , Yi Sun , Jürgen Schmidhuber