English
Related papers

Related papers: An Exponential Lower Bound for the Runtime of the …

200 papers

Considering the problem of risk-sensitive parameter estimation, we propose a fairly wide family of lower bounds on the exponential moments of the quadratic error, both in the Bayesian and the non--Bayesian regime. This family of bounds,…

Information Theory · Computer Science 2017-03-02 Neri Merhav

The goal of this paper is to understand how exponential-time approximation algorithms can be obtained from existing polynomial-time approximation algorithms, existing parameterized exact algorithms, and existing parameterized approximation…

Data Structures and Algorithms · Computer Science 2023-06-28 Barış Can Esmer , Ariel Kulik , Dániel Marx , Daniel Neuen , Roohani Sharma

We show that, for any c>0, the (1+1) evolutionary algorithm using an arbitrary mutation rate p_n = c/n finds the optimum of a linear objective function over bit strings of length n in expected time Theta(n log n). Previously, this was only…

Data Structures and Algorithms · Computer Science 2012-04-20 Benjamin Doerr , Leslie Ann Goldberg

The search ability of an Evolutionary Algorithm (EA) depends on the variation among the individuals in the population [3, 4, 8]. Maintaining an optimal level of diversity in the EA population is imperative to ensure that progress of the EA…

Neural and Evolutionary Computing · Computer Science 2015-10-27 Maumita Bhattacharya

The existence of a pivot rule for the simplex method that guarantees a strongly polynomial run-time is a longstanding, fundamental open problem in the theory of linear programming. The leading pivot rule in theory is the shadow pivot rule,…

Optimization and Control · Mathematics 2024-05-09 Alexander E. Black

In a seminal paper in 2013, Witt showed that the (1+1) Evolutionary Algorithm with standard bit mutation needs time $(1+o(1))n \ln n/p_1$ to find the optimum of any linear function, as long as the probability $p_1$ to flip exactly one bit…

Neural and Evolutionary Computing · Computer Science 2024-10-01 Carola Doerr , Duri Andrea Janett , Johannes Lengler

The utilization of populations is one of the most important features of evolutionary algorithms (EAs). There have been many studies analyzing the impact of different population sizes on the performance of EAs. However, most of such studies…

Neural and Evolutionary Computing · Computer Science 2012-08-14 Tianshi Chen , Ke Tang , Guoliang Chen , Xin Yao

We examine two different techniques for parameter averaging in GAN training. Moving Average (MA) computes the time-average of parameters, whereas Exponential Moving Average (EMA) computes an exponentially discounted sum. Whilst MA is known…

Estimation of distribution algorithms (EDAs) provide a distribution - based approach for optimization which adapts its probability distribution during the run of the algorithm. We contribute to the theoretical understanding of EDAs and…

Neural and Evolutionary Computing · Computer Science 2022-11-28 Tobias Friedrich , Timo Kötzing , Frank Neumann , Aishwarya Radhakrishnan

Randomized search heuristics such as evolutionary algorithms are frequently applied to dynamic combinatorial optimization problems. Within this paper, we present a dynamic model of the classic Weighted Vertex Cover problem and analyze the…

Neural and Evolutionary Computing · Computer Science 2020-01-27 Feng Shi , Frank Neumann , Jianxin Wang

Very recently, the first mathematical runtime analyses of the multi-objective evolutionary optimizer NSGA-II have been conducted. We continue this line of research with a first runtime analysis of this algorithm on a benchmark problem…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Benjamin Doerr , Zhongdi Qu

Finding the optimal parameter setting (i.e. the optimal population size, the optimal mutation probability, the optimal evolutionary model etc) for an Evolutionary Algorithm (EA) is a difficult task. Instead of evolving only the parameters…

Neural and Evolutionary Computing · Computer Science 2021-09-29 Mihai Oltean , Crina Groşan

We propose a new way to self-adjust the mutation rate in population-based evolutionary algorithms in discrete search spaces. Roughly speaking, it consists of creating half the offspring with a mutation rate that is twice the current…

Neural and Evolutionary Computing · Computer Science 2018-05-28 Benjamin Doerr , Christian Gießen , Carsten Witt , Jing Yang

Given a hierarchical plan (or schedule) with uncertain task times, we propose a deterministic polynomial (time and memory) algorithm for estimating the probability that its meets a deadline, or, alternately, that its {\em makespan} is less…

Artificial Intelligence · Computer Science 2017-12-27 Liat Cohen , Solomon Eyal Shimony , Gera Weiss

One of the key performance measures in queueing systems is the exponential decay rate of the steady-state tail probabilities of the queue lengths. It is known that if a corresponding fluid model is stable and the stochastic primitives have…

Probability · Mathematics 2007-05-23 David Gamarnik , Sean Meyn

Multi-objective evolutionary algorithms (MOEAs) have become essential tools for solving multi-objective optimization problems (MOPs), making their running time analysis crucial for assessing algorithmic efficiency and guiding practical…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Han Huang , Tianyu Wang , Chaoda Peng , Tongli He , Zhifeng Hao

We investigate a family of $(\mu+\lambda)$ Genetic Algorithms (GAs) which creates offspring either from mutation or by recombining two randomly chosen parents. By scaling the crossover probability, we can thus interpolate from a fully…

Neural and Evolutionary Computing · Computer Science 2021-02-16 Furong Ye , Hao Wang , Carola Doerr , Thomas Bäck

Many important problems can be regarded as maximizing submodular functions under some constraints. A simple multi-objective evolutionary algorithm called GSEMO has been shown to achieve good approximation for submodular functions…

Neural and Evolutionary Computing · Computer Science 2020-10-21 Anh Viet Do , Frank Neumann

Here, we give an algorithm for deciding if the nonnegative rank of a matrix $M$ of dimension $m \times n$ is at most $r$ which runs in time $(nm)^{O(r^2)}$. This is the first exact algorithm that runs in time singly-exponential in $r$. This…

Data Structures and Algorithms · Computer Science 2012-05-02 Ankur Moitra

We consider the optimization problem of minimizing the logistic loss with gradient descent to train a linear model for binary classification with separable data. With a budget of $T$ iterations, it was recently shown that an accelerated…

Machine Learning · Computer Science 2026-02-16 Michael Crawshaw , Mingrui Liu