English
Related papers

Related papers: An Exponential Lower Bound for the Runtime of the …

200 papers

Estimation of Distribution Algorithms (EDAs) are stochastic heuristics that search for optimal solutions by learning and sampling from probabilistic models. Despite their popularity in real-world applications, there is little rigorous…

Neural and Evolutionary Computing · Computer Science 2018-07-27 Duc-Cuong Dang , Per Kristian Lehre , Phan Trung Hai Nguyen

Evolutionary algorithms (EAs) are a kind of nature-inspired general-purpose optimization algorithm, and have shown empirically good performance in solving various real-word optimization problems. During the past two decades, promising…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Yang Yu , Ke Tang , Xin Yao , Zhi-Hua Zhou

The interplay between mutation and selection plays a fundamental role in the behaviour of evolutionary algorithms (EAs). However, this interplay is still not completely understood. This paper presents a rigorous runtime analysis of a…

Neural and Evolutionary Computing · Computer Science 2010-12-15 Per Kristian Lehre , Xin Yao

The compact genetic algorithm (cGA) is an non-elitist estimation of distribution algorithm which has shown to be able to deal with difficult multimodal fitness landscapes that are hard to solve by elitist algorithms. In this paper, we…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Frank Neumann , Dirk Sudholt , Carsten Witt

Pseudo-Boolean monotone functions are unimodal functions which are trivial to optimize for some hillclimbers, but are challenging for a surprising number of evolutionary algorithms (EAs). A general trend is that EAs are efficient if…

Neural and Evolutionary Computing · Computer Science 2021-04-09 Johannes Lengler , Xun Zou

While multi-joint continuum robots are highly dexterous and flexible, designing an optimal robot can be challenging due to its kinematics involving curvatures. Hence, the current work presents a computational method developed to find…

Robotics · Computer Science 2025-03-17 Hyunmin Cheong , Mehran Ebrahimi , Timothy Duggan

In this paper, we obtain bounds on the probability of convergence to the optimal solution for the compact Genetic Algorithm (cGA) and the Population Based Incremental Learning (PBIL). We also give a sufficient condition for convergence of…

Neural and Evolutionary Computing · Computer Science 2010-09-14 Reza Rastegar

Exponential moving average (EMA) has recently gained significant popularity in training modern deep learning models, especially diffusion-based generative models. However, there have been few theoretical results explaining the effectiveness…

Machine Learning · Computer Science 2025-02-21 Xuheng Li , Quanquan Gu

We consider a classical scheduling problem on $m$ identical machines. For an arbitrary constant $q>1$, the aim is to assign jobs to machines such that $\sum_{i=1}^m C_i^q$ is minimized, where $C_i$ is the total processing time of jobs…

Computational Complexity · Computer Science 2021-07-14 Lin Chen , Liangde Tao , José Verschae

In this paper, we introduce a new two-parameter lifetime distribution, called the exponential-generalized truncated logarithmic (EGTL) distribution, by compounding the exponential and generalized truncated logarithmic distributions. Our…

Statistics Theory · Mathematics 2018-09-28 Mohieddine Rahmouni , Ayman Orabi

Recently, the runtime analysis of multi-valued estimation-of-distribution algorithms in the framework of Ben Jedidia et al. (TCS 2024) has made significant advancements. However, almost all existing analyses are limited to multi-valued…

Neural and Evolutionary Computing · Computer Science 2026-05-29 Martin S. Krejca , Carsten Witt

Evolutionary algorithms (EAs) are general-purpose problem solvers that usually perform an unbiased search. This is reasonable and desirable in a black-box scenario. For combinatorial optimization problems, often more knowledge about the…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Vahid Roostapour , Jakob Bossek , Frank Neumann

This paper explores the enhancement of solution diversity in evolutionary algorithms (EAs) for the maximum matching problem, concentrating on complete bipartite graphs and paths. We adopt binary string encoding for matchings and use Hamming…

Neural and Evolutionary Computing · Computer Science 2024-04-19 Jonathan Gadea Harder , Aneta Neumann , Frank Neumann

While the theoretical analysis of evolutionary algorithms (EAs) has made significant progress for pseudo-Boolean optimization problems in the last 25 years, only sporadic theoretical results exist on how EAs solve permutation-based…

Neural and Evolutionary Computing · Computer Science 2024-04-23 Benjamin Doerr , Yassine Ghannane , Marouane Ibn Brahim

Together with the NSGA-II, the SPEA2 is one of the most widely used domination-based multi-objective evolutionary algorithms. For both algorithms, the known runtime guarantees are linear in the population size; for the NSGA-II, matching…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Benjamin Doerr , Martin S. Krejca , Milan Stanković

This paper aims to study how the population size affects the computation time of evolutionary algorithms in a rigorous way. The computation time of an evolutionary algorithm can be measured by either the expected number of generations…

Neural and Evolutionary Computing · Computer Science 2016-06-15 Jun He , Xin Yao

An increasing number of machine learning problems, such as robust or adversarial variants of existing algorithms, require minimizing a loss function that is itself defined as a maximum. Carrying a loop of stochastic gradient ascent (SGA)…

Machine Learning · Computer Science 2021-11-29 Othmane Sebbouh , Marco Cuturi , Gabriel Peyré

Using gradient descent (GD) with fixed or decaying step-size is a standard practice in unconstrained optimization problems. However, when the loss function is only locally convex, such a step-size schedule artificially slows GD down as it…

Machine Learning · Statistics 2023-02-03 Nhat Ho , Tongzheng Ren , Sujay Sanghavi , Purnamrita Sarkar , Rachel Ward

In their recent work, Lehre and Nguyen (FOGA 2019) show that the univariate marginal distribution algorithm (UMDA) needs time exponential in the parent populations size to optimize the DeceptiveLeadingBlocks (DLB) problem. They conclude…

Neural and Evolutionary Computing · Computer Science 2022-04-28 Benjamin Doerr , Martin S. Krejca

The best arm identification problem requires identifying the best alternative (i.e., arm) in active experimentation using the smallest number of experiments (i.e., arm pulls), which is crucial for cost-efficient and timely decision-making…

Machine Learning · Computer Science 2025-06-17 Kapilan Balagopalan , Tuan Ngo Nguyen , Yao Zhao , Kwang-Sung Jun