English
Related papers

Related papers: Exponential Upper Bounds for the Runtime of Random…

200 papers

For genetic algorithms using a bit-string representation of length~$n$, the general recommendation is to take $1/n$ as mutation rate. In this work, we discuss whether this is really justified for multimodal functions. Taking jump functions…

Neural and Evolutionary Computing · Computer Science 2017-03-23 Benjamin Doerr , Huu Phuoc Le , Régis Makhmara , Ta Duy Nguyen

In this paper we study the adaptivity of submodular maximization. Adaptivity quantifies the number of sequential rounds that an algorithm makes when function evaluations can be executed in parallel. Adaptivity is a fundamental concept that…

Data Structures and Algorithms · Computer Science 2018-04-18 Eric Balkanski , Aviad Rubinstein , Yaron Singer

We consider the maximization of a submodular objective function $f:2^U\to\mathbb{R}_{\geq 0}$, where the objective $f$ is not accessed as a value oracle but instead subject to noisy queries. We introduce a versatile adaptive sampling…

Data Structures and Algorithms · Computer Science 2024-04-11 Wenjing Chen , Shuo Xing , Victoria G. Crawford

The one-fifth rule and its generalizations are a classical parameter control mechanism in discrete domains. They have also been transferred to control the offspring population size of the $(1, \lambda)$-EA. This has been shown to work very…

Neural and Evolutionary Computing · Computer Science 2024-04-19 Johannes Lengler , Konstantin Sturm

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

We study contextual linear bandit problems under feature uncertainty, where the features are noisy and have missing entries. To address the challenges posed by this noise, we analyze Bayesian oracles given the observed noisy features. Our…

Artificial Intelligence · Computer Science 2024-10-11 Jung-hun Kim , Se-Young Yun , Minchan Jeong , Jun Hyun Nam , Jinwoo Shin , Richard Combes

Local search algorithms and iterated local search algorithms are a basic technique. Local search can be a stand along search methods, but it can also be hybridized with evolutionary algorithms. Recently, it has been shown that it is…

Artificial Intelligence · Computer Science 2016-01-29 Francisco Chicano , Darrell Whitley , Renato Tinos

It was recently observed that the $(1+(\lambda,\lambda))$ genetic algorithm can comparably easily escape the local optimum of the jump functions benchmark. Consequently, this algorithm can optimize the jump function with jump size $k$ in an…

Neural and Evolutionary Computing · Computer Science 2020-06-08 Denis Antipov , Benjamin Doerr

The research area of real-time heuristics search has produced quite many algorithms. In the landscape of real-time heuristics search research, it is not rare to find that an algorithm X that appears to perform better than algorithm Y on a…

Artificial Intelligence · Computer Science 2018-05-23 Md Solimul Chowdhury , Victor Silva

During recent years the interest of optimization and machine learning communities in high-probability convergence of stochastic optimization methods has been growing. One of the main reasons for this is that high-probability complexity…

We study algorithms using randomized value functions for exploration in reinforcement learning. This type of algorithms enjoys appealing empirical performance. We show that when we use 1) a single random seed in each episode, and 2) a…

Machine Learning · Computer Science 2022-10-14 Zhihan Xiong , Ruoqi Shen , Qiwen Cui , Maryam Fazel , Simon S. Du

A key property underlying the success of evolutionary algorithms (EAs) is their global search behavior, which allows the algorithms to `jump' from a current state to other parts of the search space, thereby avoiding to get stuck in local…

Neural and Evolutionary Computing · Computer Science 2019-01-18 Furong Ye , Carola Doerr , Thomas Bäck

Research in unsupervised text generation has been gaining attention over the years. One recent approach is local search towards a heuristically defined objective, which specifies language fluency, semantic meanings, and other task-specific…

Computation and Language · Computer Science 2022-03-24 Weikai Steven Lu

We present the first nontrivial procedure for configuring heuristic algorithms to maximize the utility provided to their end users while also offering theoretical guarantees about performance. Existing procedures seek configurations that…

Artificial Intelligence · Computer Science 2023-11-01 Devon R. Graham , Kevin Leyton-Brown , Tim Roughgarden

Finding a large set of optima in a multimodal optimization landscape is a challenging task. Classical population-based evolutionary algorithms typically converge only to a single solution. While this can be counteracted by applying niching…

Neural and Evolutionary Computing · Computer Science 2023-10-10 Benjamin Doerr , Martin S. Krejca

We construct algorithms with optimal error for learning with adversarial noise. The overarching theme of this work is that the use of \textsl{randomized} hypotheses can substantially improve upon the best error rates achievable with…

Data Structures and Algorithms · Computer Science 2026-04-06 Guy Blanc

Drift analysis has become a powerful tool to prove bounds on the runtime of randomized search heuristics. It allows, for example, fairly simple proofs for the classical problem how the (1+1) Evolutionary Algorithm (EA) optimizes an…

Neural and Evolutionary Computing · Computer Science 2015-03-17 Benjamin Doerr , Daniel Johannsen , Carola Winzen

In many practical applications, heuristic or approximation algorithms are used to efficiently solve the task at hand. However their solutions frequently do not satisfy natural monotonicity properties of optimal solutions. In this work we…

Machine Learning · Computer Science 2020-03-24 Evangelia Gergatsouli , Brendan Lucier , Christos Tzamos

Meta-heuristics are powerful tools for solving optimization problems whose structural properties are unknown or cannot be exploited algorithmically. We propose such a meta-heuristic for a large class of optimization problems over discrete…

Discrete Mathematics · Computer Science 2021-06-22 Moritz Mühlenthaler , Alexander Raß , Manuel Schmitt , Rolf Wanka

The expected running time of the classical (1+1) EA on the OneMax benchmark function has recently been determined by Hwang et al. (2018) up to additive errors of $O((\log n)/n)$. The same approach proposed there also leads to a full…

Neural and Evolutionary Computing · Computer Science 2019-06-26 Hsien-Kuei Hwang , Carsten Witt