English
Related papers

Related papers: Evolution Strategies as a Scalable Alternative to …

200 papers

Evolution Strategies (ES) are a powerful class of blackbox optimization techniques that recently became a competitive alternative to state-of-the-art policy gradient (PG) algorithms for reinforcement learning (RL). We propose a new method…

Neural and Evolutionary Computing · Computer Science 2020-03-16 Yunhao Tang , Krzysztof Choromanski , Alp Kucukelbir

Evolution Strategies (ES) have recently been demonstrated to be a viable alternative to reinforcement learning (RL) algorithms on a set of challenging deep RL problems, including Atari games and MuJoCo humanoid locomotion benchmarks. While…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Patryk Chrabaszcz , Ilya Loshchilov , Frank Hutter

Evolution strategies (ES) are a family of black-box optimization algorithms able to train deep neural networks roughly as well as Q-learning and policy gradient methods on challenging deep reinforcement learning (RL) problems, but are much…

Artificial Intelligence · Computer Science 2018-10-31 Edoardo Conti , Vashisht Madhavan , Felipe Petroski Such , Joel Lehman , Kenneth O. Stanley , Jeff Clune

Evolution Strategies (ES) is a class of powerful black-box optimisation methods that are highly parallelisable and can handle non-differentiable and noisy objectives. However, na\"ive ES becomes prohibitively expensive at scale on GPUs due…

Evolution Strategy (ES) is a powerful black-box optimization technique based on the idea of natural evolution. In each of its iterations, a key step entails ranking candidate solutions based on some fitness score. For an ES method in…

Machine Learning · Computer Science 2023-02-22 Eshwar S R , Shishir Kolathaya , Gugan Thoppe

In this paper, we try to improve exploration in Blackbox methods, particularly Evolution strategies (ES), when applied to Reinforcement Learning (RL) problems where intermediate waypoints/subgoals are available. Since Evolutionary…

Robotics · Computer Science 2023-07-04 Kiran Lekkala , Laurent Itti

Evolutionary Strategies (ES) are a popular family of black-box zeroth-order optimization algorithms which rely on search distributions to efficiently optimize a large variety of objective functions. This paper investigates the potential…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Louis Faury , Clement Calauzenes , Olivier Fercoq , Syrine Krichen

We explore the capability of evolution strategies to train an agent with a policy based on a transformer architecture in a reinforcement learning setting. We performed experiments using OpenAI's highly parallelizable evolution strategy to…

Machine Learning · Computer Science 2025-07-31 Matyáš Lorenc , Roman Neruda

Evolution Strategies (ESs) have recently become popular for training deep neural networks, in particular on reinforcement learning tasks, a special form of controller design. Compared to classic problems in continuous direct search, deep…

Neural and Evolutionary Computing · Computer Science 2018-07-03 Nils Müller , Tobias Glasmachers

Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead.…

Machine Learning · Statistics 2018-11-13 Víctor Campos , Xavier Giro-i-Nieto , Jordi Torres

We present a new method of blackbox optimization via gradient approximation with the use of structured random orthogonal matrices, providing more accurate estimators than baselines and with provable theoretical guarantees. We show that this…

Machine Learning · Computer Science 2018-06-13 Krzysztof Choromanski , Mark Rowland , Vikas Sindhwani , Richard E. Turner , Adrian Weller

Many scientific and technological problems are related to optimization. Among them, black-box optimization in high-dimensional space is particularly challenging. Recent neural network-based black-box optimization studies have shown…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Changhwi Park

Evolution Strategies (ES) have emerged as a scalable gradient-free alternative to reinforcement learning based LLM fine-tuning, but it remains unclear whether comparable task performance implies comparable solutions in parameter space. We…

Machine Learning · Computer Science 2026-04-03 William Hoy , Binxu Wang , Xu Pan

Evolution strategies (ES), as a family of black-box optimization algorithms, recently emerge as a scalable alternative to reinforcement learning (RL) approaches such as Q-learning or policy gradient, and are much faster when many central…

Machine Learning · Computer Science 2022-04-01 Zhi Wang , Chunlin Chen , Daoyi Dong

In this paper, we propose a novel meta-learning method in a reinforcement learning setting, based on evolution strategies (ES), exploration in parameter space and deterministic policy gradients. ES methods are easy to parallelize, which is…

Machine Learning · Computer Science 2019-05-09 Yiming Shen , Kehan Yang , Yufeng Yuan , Simon Cheng Liu

In this work we show that Evolution Strategies (ES) are a viable method for learning non-differentiable parameters of large supervised models. ES are black-box optimization algorithms that estimate distributions of model parameters; however…

Neural and Evolutionary Computing · Computer Science 2019-06-10 Karel Lenc , Erich Elsen , Tom Schaul , Karen Simonyan

Evolutionarily stable strategy (ESS) is an important solution concept in game theory which has been applied frequently to biological models. Informally an ESS is a strategy that if followed by the population cannot be taken over by a…

Computer Science and Game Theory · Computer Science 2019-01-18 Sam Ganzfried

Evolutionary Strategies (ES) are known to be an effective black-box optimization technique for deep neural networks when the true gradients cannot be computed, such as in Reinforcement Learning. We continue a recent line of research that…

Neural and Evolutionary Computing · Computer Science 2019-10-14 Florian Meier , Asier Mujika , Marcelo Matheus Gauy , Angelika Steger

This paper presents Natural Evolution Strategies (NES), a recent family of algorithms that constitute a more principled approach to black-box optimization than established evolutionary algorithms. NES maintains a parameterized distribution…

Machine Learning · Statistics 2011-06-23 Daan Wierstra , Tom Schaul , Tobias Glasmachers , Yi Sun , Jürgen Schmidhuber

Evolution Strategies (ES) are effective gradient-free optimization methods that can be competitive with gradient-based approaches for policy search. ES only rely on the total episodic scores of solutions in their population, from which they…

Neural and Evolutionary Computing · Computer Science 2024-05-08 Paul Templier , Luca Grillotti , Emmanuel Rachelson , Dennis G. Wilson , Antoine Cully
‹ Prev 1 2 3 10 Next ›