English
Related papers

Related papers: Optimal Parameter Choices via Precise Black-Box An…

200 papers

In real-world applications, many optimization problems have the time-linkage property, that is, the objective function value relies on the current solution as well as the historical solutions. Although the rigorous theoretical analysis on…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Weijie Zheng , Huanhuan Chen , Xin Yao

Despite significant progress in the theory of evolutionary algorithms, the theoretical understanding of evolutionary algorithms which use non-trivial populations remains challenging and only few rigorous results exist. Already for the most…

Neural and Evolutionary Computing · Computer Science 2021-09-21 Denis Antipov , Benjamin Doerr

Black-box complexity theory provides lower bounds for the runtime of black-box optimizers like evolutionary algorithms and serves as an inspiration for the design of new genetic algorithms. Several black-box models covering different…

Neural and Evolutionary Computing · Computer Science 2015-08-28 Carola Doerr , Johannes Lengler

Experience shows that typical evolutionary algorithms can cope well with stochastic disturbances such as noisy function evaluations. In this first mathematical runtime analysis of the $(1+\lambda)$ and $(1,\lambda)$ evolutionary algorithms…

Neural and Evolutionary Computing · Computer Science 2024-07-17 Denis Antipov , Benjamin Doerr , Alexandra Ivanova

Extending previous analyses on function classes like linear functions, we analyze how the simple (1+1) evolutionary algorithm optimizes pseudo-Boolean functions that are strictly monotone. Contrary to what one would expect, not all of these…

Neural and Evolutionary Computing · Computer Science 2015-03-17 Benjamin Doerr , Thomas Jansen , Dirk Sudholt , Carola Winzen , Christine Zarges

We study how Reinforcement Learning can be employed to optimally control parameters in evolutionary algorithms. We control the mutation probability of a (1+1) evolutionary algorithm on the OneMax function. This problem is modeled as a…

Neural and Evolutionary Computing · Computer Science 2019-05-10 Luca Mossina , Emmanuel Rachelson , Daniel Delahaye

This paper extends the runtime analysis of non-elitist evolutionary algorithms (EAs) with fitness-proportionate selection from the simple OneMax function to the linear functions. Not only does our analysis cover a larger class of fitness…

Neural and Evolutionary Computing · Computer Science 2019-08-26 Duc-Cuong Dang , Anton Eremeev , Per Kristian Lehre

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

Machine Learning · Computer Science 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters

While most theoretical run time analyses of discrete randomized search heuristics focused on finite search spaces, we consider the search space $\mathbb{Z}^n$. This is a further generalization of the search space of multi-valued decision…

Neural and Evolutionary Computing · Computer Science 2023-10-10 Jonathan Gadea Harder , Timo Kötzing , Xiaoyue Li , Aishwarya Radhakrishnan

We extend the work of Lehre and Witt (GECCO 2010) on the unbiased black-box model by considering higher arity variation operators. In particular, we show that already for binary operators the black-box complexity of \leadingones drops from…

Neural and Evolutionary Computing · Computer Science 2010-12-07 Benjamin Doerr , Daniel Johannsen , Timo Kötzing , Per Kristian Lehre , Markus Wagner , Carola Winzen

Black-box complexity is a complexity theoretic measure for how difficult a problem is to be optimized by a general purpose optimization algorithm. It is thus one of the few means trying to understand which problems are tractable for genetic…

Neural and Evolutionary Computing · Computer Science 2015-03-19 Benjamin Doerr , Timo Kötzing , Johannes Lengler , Carola Winzen

The analysis of randomized search heuristics on classes of functions is fundamental for the understanding of the underlying stochastic process and the development of suitable proof techniques. Recently, remarkable progress has been made in…

Neural and Evolutionary Computing · Computer Science 2011-12-16 Carsten Witt

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given population after comparing…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Judith Echevarrieta , Etor Arza , Aritz Pérez

In this paper, we study the tradeoff between the approximation guarantee and adaptivity for the problem of maximizing a monotone submodular function subject to a cardinality constraint. The adaptivity of an algorithm is the number of…

Data Structures and Algorithms · Computer Science 2018-11-01 Alina Ene , Huy L. Nguyen

In this paper, we consider the problem of black box continuous submodular maximization where we only have access to the function values and no information about the derivatives is provided. For a monotone and continuous DR-submodular…

Machine Learning · Computer Science 2020-03-03 Lin Chen , Mingrui Zhang , Hamed Hassani , Amin Karbasi

Apart from few exceptions, the mathematical runtime analysis of evolutionary algorithms is mostly concerned with expected runtimes. In this work, we argue that stochastic domination is a notion that should be used more frequently in this…

Neural and Evolutionary Computing · Computer Science 2019-05-02 Benjamin Doerr

The diverse world of machine learning applications has given rise to a plethora of algorithms and optimization methods, finely tuned to the specific regression or classification task at hand. We reduce the complexity of algorithm design for…

Optimization and Control · Mathematics 2016-05-23 Zeyuan Allen-Zhu , Elad Hazan

Most research in the theory of evolutionary computation assumes that the problem at hand has a fixed problem size. This assumption does not always apply to real-world optimization challenges, where the length of an optimal solution may be…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Benjamin Doerr , Carola Doerr , Timo Kötzing

Algorithmic stability is a central notion in learning theory that quantifies the sensitivity of an algorithm to small changes in the training data. If a learning algorithm satisfies certain stability properties, this leads to many important…

Machine Learning · Statistics 2025-04-01 Yuetian Luo , Rina Foygel Barber

Parameter control and dynamic algorithm configuration study how to dynamically choose suitable configurations of a parametrized algorithm during the optimization process. Despite being an intensively researched topic in evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-07-14 Gianluca Covini , Denis Antipov , Carola Doerr