English
Related papers

Related papers: Non-Existence of Linear Universal Drift Functions

200 papers

The majority of research on estimation-of-distribution algorithms (EDAs) concentrates on pseudo-Boolean optimization and permutation problems, leaving the domain of EDAs for problems in which the decision variables can take more than two…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Firas Ben Jedidia , Benjamin Doerr , Martin S. Krejca

In studying randomized search heuristics, a frequent quantity of interest is the first time a (real-valued) stochastic process obtains (or passes) a certain value. The processes under investigation commonly show a bias towards this goal,…

Probability · Mathematics 2024-06-24 Timo Kötzing

A key property underlying the success of evolutionary algorithms (EAs) is their global search behavior, which allows the algorithms to `jump' from a current state to other parts of the search space, thereby avoiding to get stuck in local…

Neural and Evolutionary Computing · Computer Science 2019-01-18 Furong Ye , Carola Doerr , Thomas Bäck

In the present article we study strong approximation of solutions of scalar stochastic differential equations (SDEs) with bounded and $\alpha$-H\"older continuous drift coefficient and constant diffusion coefficient at time point $1$.…

Probability · Mathematics 2025-04-30 Simon Ellinger , Thomas Müller-Gronbach , Larisa Yaroslavtseva

Genetic drift is stochastic fluctuations of alleles frequencies in a population due to sampling effects. We consider a model of drift in an equilibrium population, with high mutation rates: few functional mutations per generation. Such…

Populations and Evolution · Quantitative Biology 2017-01-12 Alexey A. Shadrin , Dmitri V. Parkhomchuk

The goal of this article is to establish a central limit theorem for the Euler-Maruyama scheme approximating multidimensional SDEs with elliptic Brownian diffusion, under very mild regularity requirements on the drift coefficients. When the…

Probability · Mathematics 2023-09-29 Konstantinos Dareiotis , Máté Gerencsér , Khoa Lê

Most research in the theory of evolutionary computation assumes that the problem at hand has a fixed problem size. This assumption does not always apply to real-world optimization challenges, where the length of an optimal solution may be…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Benjamin Doerr , Carola Doerr , Timo Kötzing

We study unbiased $(1+1)$ evolutionary algorithms on linear functions with an unknown number $n$ of bits with non-zero weight. Static algorithms achieve an optimal runtime of $O(n (\ln n)^{2+\epsilon})$, however, it remained unclear whether…

Neural and Evolutionary Computing · Computer Science 2018-08-17 Hafsteinn Einarsson , Marcelo Matheus Gauy , Johannes Lengler , Florian Meier , Asier Mujika , Angelika Steger , Felix Weissenberger

Understanding how the time-complexity of evolutionary algorithms (EAs) depend on their parameter settings and characteristics of fitness landscapes is a fundamental problem in evolutionary computation. Most rigorous results were derived…

Neural and Evolutionary Computing · Computer Science 2016-10-28 Dogan Corus , Duc-Cuong Dang , Anton V. Eremeev , Per Kristian Lehre

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We are interested in an identification of those features, that are most relevant for the observed drift.…

Machine Learning · Computer Science 2020-12-02 Fabian Hinder , Jonathan Jakob , Barbara Hammer

We propose and analyze a self-adaptive version of the $(1,\lambda)$ evolutionary algorithm in which the current mutation rate is part of the individual and thus also subject to mutation. A rigorous runtime analysis on the OneMax benchmark…

Neural and Evolutionary Computing · Computer Science 2018-12-03 Benjamin Doerr , Carsten Witt , Jing Yang

This paper concerns the mathematical analyses of the diffusion model in machine learning. The drift term of the backward sampling process is represented as a conditional expectation involving the data distribution and the forward diffusion.…

Machine Learning · Computer Science 2024-12-11 Yubin Lu , Zhongjian Wang , Guillaume Bal

Recently, many studies have shed light on the high adaptivity of deep neural network methods in nonparametric regression models, and their superior performance has been established for various function classes. Motivated by this…

Statistics Theory · Mathematics 2023-07-04 Akihiro Oga , Yuta Koike

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models may become inaccurate and need adjustment. Many technologies for…

Machine Learning · Computer Science 2022-12-05 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

We prove global well-posedness for a class of dissipative semilinear stochastic evolution equations with singular drift and multiplicative Wiener noise. In particular, the nonlinear term in the drift is the superposition operator associated…

Analysis of PDEs · Mathematics 2018-10-03 Carlo Marinelli , Luca Scarpa

We develop and analyze a general technique for learning with an unknown distribution drift. Given a sequence of independent observations from the last $T$ steps of a drifting distribution, our algorithm agnostically learns a family of…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal

Concept drift refers to the change of data distributions over time. While drift poses a challenge for learning models, requiring their continual adaption, it is also relevant in system monitoring to detect malfunctions, system failures, and…

Machine Learning · Computer Science 2025-02-07 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Usually the problem of drift estimation for a diffusion process is considered under the hypothesis of ergodicity. It is less often considered under the hypothesis of null-recurrence, simply because there are fewer limit theorems and…

Probability · Mathematics 2008-08-25 D. Loukianova , O. Loukianov

Estimation-of-distribution algorithms (EDAs) are general metaheuristics used in optimization that represent a more recent alternative to classical approaches like evolutionary algorithms. In a nutshell, EDAs typically do not directly evolve…

Neural and Evolutionary Computing · Computer Science 2018-06-15 Martin S. Krejca , Carsten Witt

We establish in this paper the existence of weak solutions of infinite-dimensional shift invariant stochastic differential equations driven by a Brownian term. The drift function is very general, in the sense that it is supposed to be…

Probability · Mathematics 2015-09-01 David Dereudre , Sylvie Roelly