English
Related papers

Related papers: Accelerating Reinforcement Learning with a Directi…

200 papers

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

Evolution Strategy (ES) is a powerful black-box optimization technique based on the idea of natural evolution. In each of its iterations, a key step entails ranking candidate solutions based on some fitness score. For an ES method in…

Machine Learning · Computer Science 2023-02-22 Eshwar S R , Shishir Kolathaya , Gugan Thoppe

Evolution Strategies (ES) have emerged as a scalable gradient-free alternative to reinforcement learning based LLM fine-tuning, but it remains unclear whether comparable task performance implies comparable solutions in parameter space. We…

Machine Learning · Computer Science 2026-04-03 William Hoy , Binxu Wang , Xu Pan

Evolutionary Strategies (ES) are known to be an effective black-box optimization technique for deep neural networks when the true gradients cannot be computed, such as in Reinforcement Learning. We continue a recent line of research that…

Neural and Evolutionary Computing · Computer Science 2019-10-14 Florian Meier , Asier Mujika , Marcelo Matheus Gauy , Angelika Steger

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

Because stochastic gradient descent (SGD) has shown promise optimizing neural networks with millions of parameters and few if any alternatives are known to exist, it has moved to the heart of leading approaches to reinforcement learning…

Neural and Evolutionary Computing · Computer Science 2017-12-19 Xingwen Zhang , Jeff Clune , Kenneth O. Stanley

Deep artificial neural networks (DNNs) are typically trained via gradient-based learning algorithms, namely backpropagation. Evolution strategies (ES) can rival backprop-based algorithms such as Q-learning and policy gradients on…

Neural and Evolutionary Computing · Computer Science 2018-04-24 Felipe Petroski Such , Vashisht Madhavan , Edoardo Conti , Joel Lehman , Kenneth O. Stanley , Jeff Clune

Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization problems. While…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Yanjie Song , Yutong Wu , Yangyang Guo , Ran Yan , P. N. Suganthan , Yue Zhang , Witold Pedrycz , Swagatam Das , Rammohan Mallipeddi , Oladayo Solomon Ajani. Qiang Feng

In recent years, Evolutionary Strategies were actively explored in robotic tasks for policy search as they provide a simpler alternative to reinforcement learning algorithms. However, this class of algorithms is often claimed to be…

Robotics · Computer Science 2021-11-10 Vladislav Kurenkov , Bulat Maksudov

Reinforcement learning for control over continuous spaces typically uses high-entropy stochastic policies, such as Gaussian distributions, for local exploration and estimating policy gradient to optimize performance. Many robotic control…

Machine Learning · Computer Science 2024-04-03 Ya-Chien Chang , Sicun Gao

Evolution strategies (ESs) are zeroth-order stochastic black-box optimization heuristics invariant to monotonic transformations of the objective function. They evolve a multivariate normal distribution, from which candidate solutions are…

Numerical Analysis · Mathematics 2022-02-09 Youhei Akimoto , Anne Auger , Tobias Glasmachers , Daiki Morinaga

We explore the use of Evolution Strategies (ES), a class of black box optimization algorithms, as an alternative to popular MDP-based RL techniques such as Q-learning and Policy Gradients. Experiments on MuJoCo and Atari show that ES is a…

Machine Learning · Statistics 2017-09-11 Tim Salimans , Jonathan Ho , Xi Chen , Szymon Sidor , Ilya Sutskever

Evolutionary Strategies (ES) are a popular family of black-box zeroth-order optimization algorithms which rely on search distributions to efficiently optimize a large variety of objective functions. This paper investigates the potential…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Louis Faury , Clement Calauzenes , Olivier Fercoq , Syrine Krichen

Improving competent robot policies with on-policy RL is often hampered by noisy, low-signal gradients. We revisit Evolution Strategies (ES) as a policy-gradient proxy and localize exploration with bounded, antithetic triangular…

Machine Learning · Computer Science 2025-11-17 Ethan Hirschowitz , Fabio Ramos

Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead.…

Machine Learning · Statistics 2018-11-13 Víctor Campos , Xavier Giro-i-Nieto , Jordi Torres

One of the biggest missing capabilities in current AI systems is the ability to learn continuously after deployment. Implementing such continually learning systems have several challenges, one of which is the large memory requirement of…

Machine Learning · Computer Science 2026-01-29 Immanuel Abdi , Akshat Gupta , Micah Mok , Alexander Lu , Nicholas Lee , Gopala Anumanchipalli

Recently reinforcement learning (RL) has emerged as a promising approach for quadrupedal locomotion, which can save the manual effort in conventional approaches such as designing skill-specific controllers. However, due to the complex…

Robotics · Computer Science 2021-09-17 Haojie Shi , Bo Zhou , Hongsheng Zeng , Fan Wang , Yueqiang Dong , Jiangyong Li , Kang Wang , Hao Tian , Max Q. -H. Meng

We present a simple, sample-efficient algorithm for introducing large but directed learning steps in reinforcement learning (RL), through the use of evolutionary operators. The methodology uses a population of RL agents training with a…

Neural and Evolutionary Computing · Computer Science 2023-05-15 Harshad Khadilkar

Policy gradient reinforcement learning (RL) algorithms have achieved impressive performance in challenging learning tasks such as continuous control, but suffer from high sample complexity. Experience replay is a commonly used approach to…

Machine Learning · Statistics 2020-02-19 Saad Mohamad , Giovanni Montana

Evolution Strategy (ES) algorithms have shown promising results in training complex robotic control policies due to their massive parallelism capability, simple implementation, effective parameter-space exploration, and fast training time.…

Robotics · Computer Science 2022-07-28 Kuang-Huei Lee , Ofir Nachum , Tingnan Zhang , Sergio Guadarrama , Jie Tan , Wenhao Yu