English
Related papers

Related papers: An Exponential Lower Bound for the Runtime of the …

200 papers

This paper extends previous work done by Tanese on the distributed genetic algorithm (DGA). Tanese found that the DGA outperformed the canonical serial genetic algorithm (CGA) on a class of difficult, randomly-generated Walsh polynomials.…

adap-org · Physics 2008-02-03 Theodore C. Belding

A fundamental question in the theory of reinforcement learning is: suppose the optimal $Q$-function lies in the linear span of a given $d$ dimensional feature mapping, is sample-efficient reinforcement learning (RL) possible? The recent and…

Machine Learning · Computer Science 2021-10-22 Yuanhao Wang , Ruosong Wang , Sham M. Kakade

We present an algorithm for the statistical learning setting with a bounded exp-concave loss in $d$ dimensions that obtains excess risk $O(d \log(1/\delta)/n)$ with probability at least $1 - \delta$. The core technique is to boost the…

Machine Learning · Computer Science 2016-10-17 Nishant A. Mehta

In this paper we revisit the question how hard it can be for the $(1+1)$ Evolutionary Algorithm to optimize monotone pseudo-Boolean functions. By introducing a more pessimistic stochastic process, the partially-ordered evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-07-02 Marc Kaufmann , Maxime Larcher , Johannes Lengler , Oliver Sieberling

We consider the minimax query complexity of online planning with a generative model in fixed-horizon Markov decision processes (MDPs) with linear function approximation. Following recent works, we consider broad classes of problems where…

Machine Learning · Computer Science 2022-03-11 Gellért Weisz , Csaba Szepesvári , András György

We analyse the impact of the selective pressure for the global optimisation capabilities of steady-state EAs. For the standard bimodal benchmark function \twomax we rigorously prove that using uniform parent selection leads to exponential…

Neural and Evolutionary Computing · Computer Science 2021-03-19 Dogan Corus , Andrei Lissovoi , Pietro S. Oliveto , Carsten Witt

The global simple evolutionary multi-objective optimizer (GSEMO) is a simple, yet often effective multi-objective evolutionary algorithm (MOEA). By only maintaining non-dominated solutions, it has a variable population size that…

Neural and Evolutionary Computing · Computer Science 2025-05-05 Benjamin Doerr , Martin Krejca , Andre Opris

Parameterized runtime analysis seeks to understand the influence of problem structure on algorithmic runtime. In this paper, we contribute to the theoretical understanding of evolutionary algorithms and carry out a parameterized analysis of…

Neural and Evolutionary Computing · Computer Science 2012-10-10 Andrew M. Sutton , Frank Neumann

While evolutionary algorithms are known to be very successful for a broad range of applications, the algorithm designer is often left with many algorithmic choices, for example, the size of the population, the mutation rates, and the…

Neural and Evolutionary Computing · Computer Science 2015-04-14 Benjamin Doerr , Carola Doerr

We show that for a number of parameterized problems for which only $2^{O(k)} n^{O(1)}$ time algorithms are known on general graphs, subexponential parameterized algorithms with running time $2^{O(k^{1-\frac{1}{1+\delta}} \log^2 k)}…

Data Structures and Algorithms · Computer Science 2016-10-26 Dániel Marx , Marcin Pilipczuk

We analyze the performance of the 2-rate $(1+\lambda)$ Evolutionary Algorithm (EA) with self-adjusting mutation rate control, its 3-rate counterpart, and a $(1+\lambda)$~EA variant using multiplicative update rules on the OneMax problem. We…

Neural and Evolutionary Computing · Computer Science 2019-04-19 Anna Rodionova , Kirill Antonov , Arina Buzdalova , Carola Doerr

There is accumulating evidence in the literature that stability of learning algorithms is a key characteristic that permits a learning algorithm to generalize. Despite various insightful results in this direction, there seems to be an…

Machine Learning · Statistics 2019-05-10 Karim Abou-Moustafa , Csaba Szepesvari

We present an argument based on the multidimensional and the uniform central limit theorems, proving that, under some geometrical assumptions between the target function $T$ and the learning class $F$, the excess risk of the empirical risk…

Statistics Theory · Mathematics 2011-02-25 Guillaume Lecué , Shahar Mendelson

Stochastic gradient descent is the most prevalent algorithm to train neural networks. However, other approaches such as evolutionary algorithms are also applicable to this task. Evolutionary algorithms bring unique trade-offs that are worth…

Neural and Evolutionary Computing · Computer Science 2018-06-27 Jonas Prellberg , Oliver Kramer

We study the large time behavior of the survival probability $\mathbb{P}_x\left(\tau_D>t\right)$ for symmetric jump processes in unbounded domains with a positive bottom of the spectrum. We prove asymptotic upper and lower bounds with…

Probability · Mathematics 2025-09-01 Phanuel Mariano , Jing Wang

The decomposition-based multi-objective evolutionary algorithm (MOEA/D) does not directly optimize a given multi-objective function $f$, but instead optimizes $N + 1$ single-objective subproblems of $f$ in a co-evolutionary manner. It…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Benjamin Doerr , Martin S. Krejca , Noé Weeks

We consider upper exponential bounds for the probability of the event that an absolute deviation of sample mean from mathematical expectation p is bigger comparing with some ordered level epsilon. These bounds include 2 coefficients {alpha,…

Probability · Mathematics 2010-04-13 Vladimir Nikulin

Evolutionary algorithms (EAs) are general-purpose optimization algorithms, inspired by natural evolution. Recent theoretical studies have shown that EAs can achieve good approximation guarantees for solving the problem classes of submodular…

Neural and Evolutionary Computing · Computer Science 2022-12-19 Chao Qian , Dan-Xuan Liu , Chao Feng , Ke Tang

We provide an upper bound as a random variable for the functions of estimators in high dimensions. This upper bound may help establish the rate of convergence of functions in high dimensions. The upper bound random variable may converge…

Econometrics · Economics 2020-08-07 Mehmet Caner , Xu Han

In the real world, there exist a class of optimization problems that multiple (local) optimal solutions in the solution space correspond to a single point in the objective space. In this paper, we theoretically show that for such multimodal…

Neural and Evolutionary Computing · Computer Science 2024-06-06 Shengjie Ren , Zhijia Qiu , Chao Bian , Miqing Li , Chao Qian