English
Related papers

Related papers: Tail Bounds on the Runtime of Categorical Compact …

200 papers

Despite the ubiquitous use of stochastic optimization algorithms in machine learning, the precise impact of these algorithms and their dynamics on generalization performance in realistic non-convex settings is still poorly understood. While…

Machine Learning · Statistics 2022-07-12 Liam Hodgkinson , Umut Şimşekli , Rajiv Khanna , Michael W. Mahoney

A runtime analysis of the Univariate Marginal Distribution Algorithm (UMDA) is presented on the OneMax function for wide ranges of its parameters $\mu$ and $\lambda$. If $\mu\ge c\log n$ for some constant $c>0$ and…

Neural and Evolutionary Computing · Computer Science 2018-06-08 Carsten Witt

Theory of evolutionary computation (EC) aims at providing mathematically founded statements about the performance of evolutionary algorithms (EAs). The predominant topic in this research domain is runtime analysis, which studies the time it…

Neural and Evolutionary Computing · Computer Science 2018-12-04 Eduardo Carvalho Pinto , Carola Doerr

Evolutionary algorithms rely very heavily on randomized behavior. Execution speed, therefore, depends strongly on how we implement randomness, such as our choice of pseudorandom number generator, or the algorithms used to map pseudorandom…

Neural and Evolutionary Computing · Computer Science 2024-12-04 Vincent A. Cicirello

Understanding how evolutionary algorithms perform on constrained problems has gained increasing attention in recent years. In this paper, we study how evolutionary algorithms optimize constrained versions of the classical LeadingOnes…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Tobias Friedrich , Timo Kötzing , Aneta Neumann , Frank Neumann , Aishwarya Radhakrishnan

It is known that the evolutionary algorithm $(1+1)$-EA with mutation rate $c/n$ optimises every monotone function efficiently if $c<1$, and needs exponential time on some monotone functions (HotTopic functions) if $c\geq 2.2$. We study the…

Neural and Evolutionary Computing · Computer Science 2018-03-29 Johannes Lengler

A Genetic Algorithm (GA) is proposed in which each member of the population can change schemata only with its neighbors according to a rule. The rule methodology and the neighborhood structure employ elements from the Cellular Automata (CA)…

Neural and Evolutionary Computing · Computer Science 2007-11-16 Vasileios Barmpoutis , Gary F. Dargush

Genetic Algorithms (GA) are a class of metaheuristic global optimization methods inspired by the process of natural selection among individuals in a population. Despite their widespread use, a comprehensive theoretical analysis of these…

Optimization and Control · Mathematics 2025-02-24 Giacomo Borghi , Lorenzo Pareschi

In general, we can not use algebraic or enumerative methods to optimize a quality control (QC) procedure so as to detect the critical random and systematic analytical errors with stated probabilities, while the probability for false…

Neural and Evolutionary Computing · Computer Science 2018-12-03 Aristides T. Hatjimihail , Theophanes T. Hatjimihail

It is generally accepted that populations are useful for the global exploration of multi-modal optimisation problems. Indeed, several theoretical results are available showing such advantages over single-trajectory search heuristics. In…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Dogan Corus , Pietro S. Oliveto

Most evolutionary algorithms (EAs) used in practice employ crossover. In contrast, only for few and mostly artificial examples a runtime advantage from crossover could be proven with mathematical means. The most convincing such result shows…

Neural and Evolutionary Computing · Computer Science 2023-02-27 Benjamin Doerr , Aymen Echarghaoui , Mohammed Jamal , Martin S. Krejca

Genetic Algorithms (GAs) are used to solve search and optimization problems in which an optimal solution can be found using an iterative process with probabilistic and non-deterministic transitions. However, depending on the problem's…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-23 Matheus F. Torquato , Marcelo A. C. Fernandes

The $(1 + (\lambda,\lambda))$ genetic algorithm is a younger evolutionary algorithm trying to profit also from inferior solutions. Rigorous runtime analyses on unimodal fitness functions showed that it can indeed be faster than classical…

Neural and Evolutionary Computing · Computer Science 2022-06-17 Denis Antipov , Benjamin Doerr , Vitalii Karavaev

Recently, researchers have applied genetic algorithms (GAs) to address some problems in quantum computation. Also, there has been some works in the designing of genetic algorithms based on quantum theoretical concepts and techniques. The so…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Gilson A. Giraldi , Renato Portugal , Ricardo N. Thess

This paper presents a genetic algorithm (GA) approach to cost-optimal task scheduling in a production line. The system consists of a set of serial processing tasks, each with a given duration, unit execution cost, and precedence…

Neural and Evolutionary Computing · Computer Science 2026-01-05 Alireza Rezaee

With elementary means, we prove a stronger run time guarantee for the univariate marginal distribution algorithm (UMDA) optimizing the LeadingOnes benchmark function in the desirable regime with low genetic drift. If the population size is…

Neural and Evolutionary Computing · Computer Science 2020-04-13 Benjamin Doerr , Martin Krejca

Unlike traditional evolutionary algorithms which produce offspring via genetic operators, Estimation of Distribution Algorithms (EDAs) sample solutions from probabilistic models which are learned from selected individuals. It is hoped that…

Neural and Evolutionary Computing · Computer Science 2018-02-05 Per Kristian Lehre , Phan Trung Hai Nguyen

It is known that the $(1+(\lambda,\lambda))$~Genetic Algorithm (GA) with self-adjusting parameter choices achieves a linear expected optimization time on OneMax if its hyper-parameters are suitably chosen. However, it is not very well…

Neural and Evolutionary Computing · Computer Science 2019-04-10 Nguyen Dang , Carola Doerr

Genetic algorithms have played an important role in engineering optimization. Traditional GAs treat each gene separately. However, biophysical studies of gene regulatory networks revealed direct associations between different genes. It…

Neural and Evolutionary Computing · Computer Science 2024-05-01 Zhaoning Shi , Meng Xiang , Zhaoyang Hai , Xiabi Liu , Yan Pei

Feature selection has always been a critical step in pattern recognition, in which evolutionary algorithms, such as the genetic algorithm (GA), are most commonly used. However, the individual encoding scheme used in various GAs would either…

Machine Learning · Computer Science 2017-05-01 Benteng Ma , Yong Xia