English
Related papers

Related papers: Self-Adjusting Mutation Rates with Provably Optima…

200 papers

The $(1+(\lambda,\lambda))$ genetic algorithm is a bright example of an evolutionary algorithm which was developed based on the insights from theoretical findings. This algorithm uses crossover, and it was shown to asymptotically outperform…

Neural and Evolutionary Computing · Computer Science 2020-05-12 Anton Bassin , Maxim Buzdalov

It is generally accepted that populations are useful for the global exploration of multi-modal optimisation problems. Indeed, several theoretical results are available showing such advantages over single-trajectory search heuristics. In…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Dogan Corus , Pietro S. Oliveto

Parameter control and dynamic algorithm configuration study how to dynamically choose suitable configurations of a parametrized algorithm during the optimization process. Despite being an intensively researched topic in evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-07-14 Gianluca Covini , Denis Antipov , Carola Doerr

Parameter control has succeeded in accelerating the convergence process of evolutionary algorithms. While empirical and theoretical studies have shed light on the behavior of algorithms for single-objective optimization, little is known…

Neural and Evolutionary Computing · Computer Science 2023-05-09 Furong Ye , Frank Neumann , Jacob de Nobel , Aneta Neumann , Thomas Bäck

The heavy-tailed mutation operator proposed in Doerr, Le, Makhmara, and Nguyen (GECCO 2017), called \emph{fast mutation} to agree with the previously used language, so far was proven to be advantageous only in mutation-based algorithms.…

Neural and Evolutionary Computing · Computer Science 2022-06-09 Denis Antipov , Maxim Buzdalov , Benjamin Doerr

It is well known that evolutionary algorithms can benefit from dynamic choices of the key parameters that control their behavior, to adjust their search strategy to the different stages of the optimization process. A prominent example where…

Machine Learning · Computer Science 2025-07-22 Tai Nguyen , Phong Le , Carola Doerr , Nguyen Dang

It may seem very intuitive that for the maximization of the OneMax problem $\OM(x):=\sum_{i=1}^n{x_i}$ the best that an elitist unary unbiased search algorithm can do is to store a best so far solution, and to modify it with the operator…

Neural and Evolutionary Computing · Computer Science 2021-01-18 Nathan Buskulic , Carola Doerr

In real-world optimization scenarios, the problem instance that we are asked to solve may change during the optimization process, e.g., when new information becomes available or when the environmental conditions change. In such situations,…

Neural and Evolutionary Computing · Computer Science 2022-09-12 Nina Bulanova , Arina Buzdalova , Carola Doerr

The analysis of randomized search heuristics on classes of functions is fundamental for the understanding of the underlying stochastic process and the development of suitable proof techniques. Recently, remarkable progress has been made in…

Neural and Evolutionary Computing · Computer Science 2011-12-16 Carsten Witt

We give a detailed analysis of the cost used by the (1+1)-evolutionary algorithm. The problem has been approached in the evolutionary algorithm literature under various views, formulation and degree of rigor. Our asymptotic approximations…

Probability · Mathematics 2014-09-18 Hsien-Kuei Hwang , Alois Panholzer , Nicolas Rolin , Tsung-Hsi Tsai , Wei-Mei Chen

Under Frequency Fitness Assignment (FFA), the fitness corresponding to an objective value is its encounter frequency in fitness assignment steps and is subject to minimization. FFA renders optimization processes invariant under bijective…

Neural and Evolutionary Computing · Computer Science 2020-10-19 Thomas Weise , Zhize Wu , Xinlu Li , Yan Chen

Apart from few exceptions, the mathematical runtime analysis of evolutionary algorithms is mostly concerned with expected runtimes. In this work, we argue that stochastic domination is a notion that should be used more frequently in this…

Neural and Evolutionary Computing · Computer Science 2019-05-02 Benjamin Doerr

In many real-world optimization problems, the objective function evaluation is subject to noise, and we cannot obtain the exact objective value. Evolutionary algorithms (EAs), a type of general-purpose randomized optimization algorithm,…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Chao Bian , Wu Jiang , Ke Tang

We study unbiased $(1+1)$ evolutionary algorithms on linear functions with an unknown number $n$ of bits with non-zero weight. Static algorithms achieve an optimal runtime of $O(n (\ln n)^{2+\epsilon})$, however, it remained unclear whether…

Neural and Evolutionary Computing · Computer Science 2018-08-17 Hafsteinn Einarsson , Marcelo Matheus Gauy , Johannes Lengler , Florian Meier , Asier Mujika , Angelika Steger , Felix Weissenberger

Hillclimbing is an essential part of any optimization algorithm. An important benchmark for hillclimbing algorithms on pseudo-Boolean functions $f: \{0,1\}^n \to \mathbb{R}$ are (strictly) montone functions, on which a surprising number of…

Probability · Mathematics 2018-08-06 Johannes Lengler , Anders Martinsson , Angelika Steger

It is known that the $(1+(\lambda,\lambda))$~Genetic Algorithm (GA) with self-adjusting parameter choices achieves a linear expected optimization time on OneMax if its hyper-parameters are suitably chosen. However, it is not very well…

Neural and Evolutionary Computing · Computer Science 2019-04-10 Nguyen Dang , Carola Doerr

Randomized search heuristics have been applied successfully to a plethora of problems. This success is complemented by a large body of theoretical results. Unfortunately, the vast majority of these results regard problems with binary or…

Neural and Evolutionary Computing · Computer Science 2025-04-22 Benjamin Doerr , Martin S. Krejca , Günter Rudolph

We show that, for any c>0, the (1+1) evolutionary algorithm using an arbitrary mutation rate p_n = c/n finds the optimum of a linear objective function over bit strings of length n in expected time Theta(n log n). Previously, this was only…

Data Structures and Algorithms · Computer Science 2012-04-20 Benjamin Doerr , Leslie Ann Goldberg

We consider two versions of a simple evolutionary algorithm model for protein folding at temperature zero: the (1+1)-EA on the LeadingOnes problem. In this schematic model, the structure of the protein, which is encoded as a bit-string of…

Probability · Mathematics 2008-06-23 Veronique Ladret

This paper extends the runtime analysis of non-elitist evolutionary algorithms (EAs) with fitness-proportionate selection from the simple OneMax function to the linear functions. Not only does our analysis cover a larger class of fitness…

Neural and Evolutionary Computing · Computer Science 2019-08-26 Duc-Cuong Dang , Anton Eremeev , Per Kristian Lehre