English
Related papers

Related papers: Lower Bounds for Non-Elitist Evolutionary Algorith…

200 papers

Stochastic gradient descent is the most prevalent algorithm to train neural networks. However, other approaches such as evolutionary algorithms are also applicable to this task. Evolutionary algorithms bring unique trade-offs that are worth…

Neural and Evolutionary Computing · Computer Science 2018-06-27 Jonas Prellberg , Oliver Kramer

We consider a classical scheduling problem on $m$ identical machines. For an arbitrary constant $q>1$, the aim is to assign jobs to machines such that $\sum_{i=1}^m C_i^q$ is minimized, where $C_i$ is the total processing time of jobs…

Computational Complexity · Computer Science 2021-07-14 Lin Chen , Liangde Tao , José Verschae

We study the simple genetic algorithm with a ranking selection mechanism (linear ranking or tournament). We denote by $\ell$ the length of the chromosomes, by $m$ the population size, by $p_C$ the crossover probability and by $p_M$ the…

Probability · Mathematics 2014-03-24 Raphaël Cerf

The analysis of randomized search heuristics on classes of functions is fundamental for the understanding of the underlying stochastic process and the development of suitable proof techniques. Recently, remarkable progress has been made in…

Neural and Evolutionary Computing · Computer Science 2011-12-16 Carsten Witt

The global simple evolutionary multi-objective optimizer (GSEMO) is a simple, yet often effective multi-objective evolutionary algorithm (MOEA). By only maintaining non-dominated solutions, it has a variable population size that…

Neural and Evolutionary Computing · Computer Science 2025-05-05 Benjamin Doerr , Martin Krejca , Andre Opris

Many real-world applications have the time-linkage property, and the only theoretical analysis is recently given by Zheng, et al. (TEVC 2021) on their proposed time-linkage OneMax problem, OneMax$_{(0,1^n)}$. However, only two elitist…

Neural and Evolutionary Computing · Computer Science 2021-04-15 Weijie Zheng , Qiaozhi Zhang , Huanhuan Chen , Xin Yao

We introduce a framework for proving lower bounds on computational problems over distributions against algorithms that can be implemented using access to a statistical query oracle. For such algorithms, access to the input distribution is…

Computational Complexity · Computer Science 2016-08-16 Vitaly Feldman , Elena Grigorescu , Lev Reyzin , Santosh Vempala , Ying Xiao

The all-pairs shortest path problem is the first non-artificial problem for which it was shown that adding crossover can significantly speed up a mutation-only evolutionary algorithm. Recently, the analysis of this algorithm was refined and…

Neural and Evolutionary Computing · Computer Science 2015-03-20 Benjamin Doerr , Daniel Johannsen , Timo Kötzing , Frank Neumann , Madeleine Theile

The evolution of genetic systems has been analyzed through the use of modifier gene models, in which a neutral gene is posited to control the transmission of other genes under selection. Analysis of modifier gene models has found the…

Populations and Evolution · Quantitative Biology 2013-02-04 Lee Altenberg

Evolutionary algorithms are widely used for solving multi-objective optimization problems. A prominent example is NSGA-III, which is particularly well suited for solving problems involving more than three objectives, distinguishing it from…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Andre Opris

Nowadays hybrid evolutionary algorithms, i.e, heuristic search algorithms combining several mutation operators some of which are meant to implement stochastically a well known technique designed for the specific problem in question while…

Neural and Evolutionary Computing · Computer Science 2014-04-23 Boris Mitavskiy , Jun He

One hope when using non-elitism in evolutionary computation is that the ability to abandon the current-best solution aids leaving local optima. To improve our understanding of this mechanism, we perform a rigorous runtime analysis of a…

Neural and Evolutionary Computing · Computer Science 2022-06-17 Benjamin Doerr

The celebrated result of Kabanets and Impagliazzo (Computational Complexity, 2004) showed that PIT algorithms imply circuit lower bounds, and vice versa. Since then it has been a major challenge to understand the precise connections between…

Computational Complexity · Computer Science 2025-08-19 Robert Andrews , Deepanshu Kush , Roei Tell

This paper studies the online scheduling problem of minimizing total flow time for $n$ jobs on $m$ identical machines. A classical $\Omega(n)$ lower bound shows that no deterministic single-machine algorithm can beat the trivial greedy,…

Data Structures and Algorithms · Computer Science 2026-04-02 Yutong Geng , Enze Sun , Zonghan Yang , Yuhao Zhang

In this article we present an Elitism Levels Traverse Mechanism that we designed to find bounds on population-based Evolutionary algorithms solving unimodal functions. We prove its efficiency theoretically and test it on OneMax function…

Neural and Evolutionary Computing · Computer Science 2012-04-03 Aram Ter-Sarkisov

The congested clique model of distributed computing has been receiving attention as a model for densely connected distributed systems. While there has been significant progress on the side of upper bounds, we have very little in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-25 Janne H. Korhonen , Jukka Suomela

Population diversity is crucial in evolutionary algorithms as it helps with global exploration and facilitates the use of crossover. Despite many runtime analyses showing advantages of population diversity, we have no clear picture of how…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Johannes Lengler , Andre Opris , Dirk Sudholt

Black-box complexity theory provides lower bounds for the runtime of black-box optimizers like evolutionary algorithms and serves as an inspiration for the design of new genetic algorithms. Several black-box models covering different…

Neural and Evolutionary Computing · Computer Science 2015-08-28 Carola Doerr , Johannes Lengler

We establish upper bounds for the expected excess risk of models trained by proper iterative algorithms which approximate the local minima. Unlike the results built upon the strong globally strongly convexity or global growth conditions…

Machine Learning · Computer Science 2022-10-11 Mingyang Yi , Ruoyu Wang , Zhi-Ming Ma

Learning a transition model via Maximum Likelihood Estimation (MLE) followed by planning inside the learned model is perhaps the most standard and simplest Model-based Reinforcement Learning (RL) framework. In this work, we show that such a…

Machine Learning · Computer Science 2024-10-30 Zhiyong Wang , Dongruo Zhou , John C. S. Lui , Wen Sun