English
Related papers

Related papers: Abnormal Mutations: Evolution Strategies Don't Req…

200 papers

Efficient Natural Evolution Strategies (eNES) is a novel alternative to conventional evolutionary algorithms, using the natural gradient to adapt the mutation distribution. Unlike previous methods based on natural gradients, eNES uses a…

Artificial Intelligence · Computer Science 2012-09-27 Yi Sun , Daan Wierstra , Tom Schaul , Juergen Schmidhuber

We establish global convergence of the (1+1) evolution strategy, i.e., convergence to a critical point independent of the initial state. More precisely, we show the existence of a critical limit point, using a suitable extension of the…

Neural and Evolutionary Computing · Computer Science 2020-11-20 Tobias Glasmachers

Evolutionary algorithms (EAs) are general-purpose problem solvers that usually perform an unbiased search. This is reasonable and desirable in a black-box scenario. For combinatorial optimization problems, often more knowledge about the…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Vahid Roostapour , Jakob Bossek , Frank Neumann

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost…

Neural and Evolutionary Computing · Computer Science 2014-06-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag , Nikolaus Hansen

A distributional route to Gaussianity, associated with the concept of Conservative Mixing Transformations in ensembles of random vector-valued variables, is proposed. This route is completely different from the additive mechanism…

Statistical Mechanics · Physics 2023-01-11 Massimiliano Giona , Chiara Pezzotti , Giuseppe Procopio

Evolutionary algorithms (EAs) form a popular optimisation paradigm inspired by natural evolution. In recent years the field of evolutionary computation has developed a rigorous analytical theory to analyse their runtime on many illustrative…

Neural and Evolutionary Computing · Computer Science 2015-10-02 Tiago Paixão , Jorge Pérez Heredia , Dirk Sudholt , Barbora Trubenová

Under constant selection, each trait has a fixed fitness, and small mutation rates allow populations to efficiently exploit the optimal trait. Therefore it is reasonable to expect mutation rates will evolve downwards. However, we find this…

Populations and Evolution · Quantitative Biology 2022-08-23 Brian Mintz , Feng Fu

It is known that the evolutionary algorithm $(1+1)$-EA with mutation rate $c/n$ optimises every monotone function efficiently if $c<1$, and needs exponential time on some monotone functions (HotTopic functions) if $c\geq 2.2$. We study the…

Neural and Evolutionary Computing · Computer Science 2018-03-29 Johannes Lengler

This work concerns the evolutionary approaches to distributed stochastic black-box optimization, in which each worker can individually solve an approximation of the problem with nature-inspired algorithms. We propose a distributed evolution…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Xiaoyu He , Zibin Zheng , Chuan Chen , Yuren Zhou , Chuan Luo , Qingwei Lin

An evolutionary algorithm (EA) is developed as an alternative to the EM algorithm for parameter estimation in model-based clustering. This EA facilitates a different search of the fitness landscape, i.e., the likelihood surface, utilizing…

Computation · Statistics 2020-06-09 Sharon M. McNicholas , Paul D. McNicholas , Daniel A. Ashlock

Evolution Strategies (ESs) have recently become popular for training deep neural networks, in particular on reinforcement learning tasks, a special form of controller design. Compared to classic problems in continuous direct search, deep…

Neural and Evolutionary Computing · Computer Science 2018-07-03 Nils Müller , Tobias Glasmachers

The inheritance of characteristics induced by the environment has often been opposed to the theory of evolution by natural selection. Yet, while evolution by natural selection requires new heritable traits to be produced and transmitted, it…

Populations and Evolution · Quantitative Biology 2015-06-18 Olivier Rivoire , Stanislas Leibler

An ab-initio numerical study of the density-dependent, evolutionary stable dispersal strategy is presented. The simulations are based on a simple discretei generation island model with four processes: reproduction, dispersal, competition…

Populations and Evolution · Quantitative Biology 2013-01-09 Shlomit Weisman , Nadav M. Shnerb , David A. Kessler

In evolutionary games the fitness of individuals is not constant but depends on the relative abundance of the various strategies in the population. Here we study general games among n strategies in populations of large but finite size. We…

Populations and Evolution · Quantitative Biology 2009-05-16 Tibor Antal , Arne Traulsen , Hisashi Ohtsuki , Corina E. Tarnita , Martin A. Nowak

A theoretical performance analysis of the $(\mu/\mu_I,\lambda)$-$\sigma$-Self-Adaptation Evolution Strategy ($\sigma$SA-ES) is presented considering a conically constrained problem. Infeasible offspring are repaired using projection onto…

Neural and Evolutionary Computing · Computer Science 2018-12-18 Patrick Spettel , Hans-Georg Beyer

An evolution strategy (ES) variant based on a simplification of a natural evolution strategy recently attracted attention because it performs surprisingly well in challenging deep reinforcement learning domains. It searches for neural…

Neural and Evolutionary Computing · Computer Science 2018-05-03 Joel Lehman , Jay Chen , Jeff Clune , Kenneth O. Stanley

We consider a system of two competing populations in two-dimensional heterogeneous environments. The populations are assumed to move horizontally and vertically with different probabilities, but are otherwise identical. We regard these…

Analysis of PDEs · Mathematics 2020-02-26 Emeric Bouin , Guillaume Legendre , Yuan Lou , Nichole Slover

Population-based evolutionary algorithms (EAs) have been widely applied to solve various optimization problems. The question of how the performance of a population-based EA depends on the population size arises naturally. The performance of…

Neural and Evolutionary Computing · Computer Science 2013-05-13 Jun He , Tianshi Chen , Boris Mitavskiy

The class of algorithms called Hessian Estimation Evolution Strategies (HE-ESs) update the covariance matrix of their sampling distribution by directly estimating the curvature of the objective function. The approach is practically…

Optimization and Control · Mathematics 2021-06-16 Tobias Glasmachers , Oswin Krause

A new model for evolving Evolutionary Algorithms (EAs) is proposed in this paper. The model is based on the Multi Expression Programming (MEP) technique. Each MEP chromosome encodes an evolutionary pattern that is repeatedly used for…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Mihai Oltean