English
Related papers

Related papers: Adaptive Drift Analysis

200 papers

We develop and analyze a general technique for learning with an unknown distribution drift. Given a sequence of independent observations from the last $T$ steps of a drifting distribution, our algorithm agnostically learns a family of…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal

A core feature of evolutionary algorithms is their mutation operator. Recently, much attention has been devoted to the study of mutation operators with dynamic and non-uniform mutation rates. Following up on this line of work, we propose a…

Data Structures and Algorithms · Computer Science 2018-11-22 Tobias Friedrich , Andreas Göbel , Francesco Quinzan , Markus Wagner

It is generally accepted that populations are useful for the global exploration of multi-modal optimisation problems. Indeed, several theoretical results are available showing such advantages over single-trajectory search heuristics. In…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Dogan Corus , Pietro S. Oliveto

In this paper we show how to use drift analysis in the case of two random variables $X_1, X_2$, when the drift is approximatively given by $A\cdot (X_1,X_2)^T$ for a matrix $A$. The non-trivial case is that $X_1$ and $X_2$ impede each…

Neural and Evolutionary Computing · Computer Science 2023-05-11 Duri Janett , Johannes Lengler

In the first and so far only mathematical runtime analysis of an estimation-of-distribution algorithm (EDA) on a multimodal problem, Hasen\"ohrl and Sutton (GECCO 2018) showed for any $k = o(n)$ that the compact genetic algorithm (cGA) with…

Neural and Evolutionary Computing · Computer Science 2021-10-12 Benjamin Doerr

It has been observed that some working principles of evolutionary algorithms, in particular, the influence of the parameters, cannot be understood from results on the asymptotic order of the runtime, but only from more precise results. In…

Neural and Evolutionary Computing · Computer Science 2018-10-18 Benjamin Doerr , Carola Doerr , Jing Yang

We propose a new way to self-adjust the mutation rate in population-based evolutionary algorithms in discrete search spaces. Roughly speaking, it consists of creating half the offspring with a mutation rate that is twice the current…

Neural and Evolutionary Computing · Computer Science 2018-05-28 Benjamin Doerr , Christian Gießen , Carsten Witt , Jing Yang

Existing drift detection methods focus on designing sensitive test statistics. They treat the detection threshold as a fixed hyperparameter, set once to balance false alarms and late detections, and applied uniformly across all datasets and…

Machine Learning · Computer Science 2025-11-14 Pengqian Lu , Jie Lu , Anjin Liu , En Yu , Guangquan Zhang

This paper aims to study how the population size affects the computation time of evolutionary algorithms in a rigorous way. The computation time of an evolutionary algorithm can be measured by either the expected number of generations…

Neural and Evolutionary Computing · Computer Science 2016-06-15 Jun He , Xin Yao

We propose a new, flexible approach for dynamically maintaining successful mutation rates in evolutionary algorithms using $k$-bit flip mutations. The algorithm adds successful mutation rates to an archive of promising rates that are…

Neural and Evolutionary Computing · Computer Science 2024-04-08 Martin S. Krejca , Carsten Witt

For every mutation rate $p \in (0, 1)$, and for all $\varepsilon > 0$, there is a fitness function $f : \{0,1\}^n \to \mathbb{R}$ with a unique maximum for which the optimal mutation rate for the $(1+1)$ evolutionary algorithm on $f$ is in…

Neural and Evolutionary Computing · Computer Science 2026-05-12 Andrew James Kelley

Understanding how crossover works is still one of the big challenges in evolutionary computation research, and making our understanding precise and proven by mathematical means might be an even bigger one. As one of few examples where…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Benjamin Doerr , Carola Doerr

We present a new adaptive algorithm for learning discrete distributions under distribution drift. In this setting, we observe a sequence of independent samples from a discrete distribution that is changing over time, and the goal is to…

Machine Learning · Computer Science 2024-03-11 Alessio Mazzetto

In real-world applications, many optimization problems have the time-linkage property, that is, the objective function value relies on the current solution as well as the historical solutions. Although the rigorous theoretical analysis on…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Weijie Zheng , Huanhuan Chen , Xin Yao

While most theoretical run time analyses of discrete randomized search heuristics focused on finite search spaces, we consider the search space $\mathbb{Z}^n$. This is a further generalization of the search space of multi-valued decision…

Neural and Evolutionary Computing · Computer Science 2023-10-10 Jonathan Gadea Harder , Timo Kötzing , Xiaoyue Li , Aishwarya Radhakrishnan

The compact genetic algorithm (cGA) is an non-elitist estimation of distribution algorithm which has shown to be able to deal with difficult multimodal fitness landscapes that are hard to solve by elitist algorithms. In this paper, we…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Frank Neumann , Dirk Sudholt , Carsten Witt

We establish global convergence of the (1+1) evolution strategy, i.e., convergence to a critical point independent of the initial state. More precisely, we show the existence of a critical limit point, using a suitable extension of the…

Neural and Evolutionary Computing · Computer Science 2020-11-20 Tobias Glasmachers

Mutation has traditionally been regarded as an important operator in evolutionary algorithms. In particular, there have been many experimental studies which showed the effectiveness of adapting mutation rates for various static optimization…

Artificial Intelligence · Computer Science 2011-06-06 Tianshi Chen , Yunji Chen , Ke Tang , Guoliang Chen , Xin Yao

This erratum points out an error in the simplified drift theorem (SDT) [Algorithmica 59(3), 369-386, 2011]. It is also shown that a minor modification of one of its conditions is sufficient to establish a valid result. In many respects, the…

Neural and Evolutionary Computing · Computer Science 2012-12-03 Pietro S. Oliveto , Carsten Witt

We perform a rigorous runtime analysis for the Univariate Marginal Distribution Algorithm on the LeadingOnes function, a well-known benchmark function in the theory community of evolutionary computation with a high correlation between…

Neural and Evolutionary Computing · Computer Science 2019-04-22 Per Kristian Lehre , Phan Trung Hai Nguyen