English
Related papers

Related papers: Optimizing Monotone Functions Can Be Difficult

200 papers

Apart from few exceptions, the mathematical runtime analysis of evolutionary algorithms is mostly concerned with expected runtimes. In this work, we argue that stochastic domination is a notion that should be used more frequently in this…

Neural and Evolutionary Computing · Computer Science 2019-05-02 Benjamin Doerr

In many classification tasks there is a requirement of monotonicity. Concretely, if all else remains constant, increasing (resp. decreasing) the value of one or more features must not decrease (resp. increase) the value of the prediction.…

Machine Learning · Computer Science 2021-06-02 Joao Marques-Silva , Thomas Gerspacher , Martin Cooper , Alexey Ignatiev , Nina Narodytska

The equivalence of the characteristic function approach and the probabilistic approach to monotone and boolean convolutions is proven for non-compactly supported probability measures. A probabilistically motivated definition of the…

Functional Analysis · Mathematics 2021-04-21 Uwe Franz

We present the first parameterized analysis of a standard (1+1) Evolutionary Algorithm on a distribution of vertex cover problems. We show that if the planted cover is at most logarithmic, restarting the (1+1) EA every $O(n \log n)$ steps…

Neural and Evolutionary Computing · Computer Science 2024-09-17 Jack Kearney , Frank Neumann , Andrew M. Sutton

In many real-world optimization problems, the objective function evaluation is subject to noise, and we cannot obtain the exact objective value. Evolutionary algorithms (EAs), a type of general-purpose randomized optimization algorithm,…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Chao Bian , Wu Jiang , Ke Tang

We prove a lower bound of $\tilde{\Omega}(n^{1/3})$ for the query complexity of any two-sided and adaptive algorithm that tests whether an unknown Boolean function $f:\{0,1\}^n\rightarrow \{0,1\}$ is monotone or far from monotone. This…

Computational Complexity · Computer Science 2017-08-22 Xi Chen , Erik Waingarten , Jinyu Xie

While most theoretical run time analyses of discrete randomized search heuristics provide bounds on the expected number of evaluations to find the global optimum, we consider the anytime performance of evolutionary and…

Neural and Evolutionary Computing · Computer Science 2026-04-09 Timo Kötzing , Jurek Sander

We establish global convergence of the (1+1) evolution strategy, i.e., convergence to a critical point independent of the initial state. More precisely, we show the existence of a critical limit point, using a suitable extension of the…

Neural and Evolutionary Computing · Computer Science 2020-11-20 Tobias Glasmachers

A probability distribution over the Boolean cube is monotone if flipping the value of a coordinate from zero to one can only increase the probability of an element. Given samples of an unknown monotone distribution over the Boolean cube, we…

Data Structures and Algorithms · Computer Science 2020-02-11 Ronitt Rubinfeld , Arsen Vasilyan

We consider the problem of sequentially maximising an unknown function over a set of actions while ensuring that every sampled point has a function value below a given safety threshold. We model the function using kernel-based and Gaussian…

Machine Learning · Statistics 2023-06-21 Arpan Losalka , Jonathan Scarlett

We argue that results produced by a heuristic optimisation algorithm cannot be considered reproducible unless the algorithm fully specifies what should be done with solutions generated outside the domain, even in the case of simple box…

Neural and Evolutionary Computing · Computer Science 2023-05-18 Anna V. Kononova , Diederick Vermetten , Fabio Caraffini , Madalina-A. Mitran , Daniela Zaharie

Most evolutionary algorithms (EAs) used in practice employ crossover. In contrast, only for few and mostly artificial examples a runtime advantage from crossover could be proven with mathematical means. The most convincing such result shows…

Neural and Evolutionary Computing · Computer Science 2023-02-27 Benjamin Doerr , Aymen Echarghaoui , Mohammed Jamal , Martin S. Krejca

The mutation process in evolution strategies has been interlinked with the normal distribution since its inception. Many lines of reasoning have been given for this strong dependency, ranging from maximum entropy arguments to the need for…

Neural and Evolutionary Computing · Computer Science 2025-04-11 Jacob de Nobel , Diederick Vermetten , Hao Wang , Anna V. Kononova , Günter Rudolph , Thomas Bäck

Constrained submodular maximization problems have long been studied, with near-optimal results known under a variety of constraints when the submodular function is monotone. The case of non-monotone submodular maximization is less…

Data Structures and Algorithms · Computer Science 2010-10-07 Anupam Gupta , Aaron Roth , Grant Schoenebeck , Kunal Talwar

Suppose that a target function is monotonic, namely, weakly increasing, and an available original estimate of this target function is not weakly increasing. Rearrangements, univariate and multivariate, transform the original estimate to a…

Statistics Theory · Mathematics 2018-01-08 Victor Chernozhukov , Ivan Fernandez-Val , Alfred Galichon

Not all generate-and-test search algorithms are created equal. Bayesian Optimization (BO) invests a lot of computation time to generate the candidate solution that best balances the predicted value and the uncertainty given all previous…

Neural and Evolutionary Computing · Computer Science 2020-05-11 Gongjin Lan , Jakub M. Tomczak , Diederik M. Roijers , A. E. Eiben

A fundamental issue in real-world systems, such as sensor networks, is the selection of observations which most effectively reduce uncertainty. More specifically, we address the long standing problem of nonmyopically selecting the most…

Artificial Intelligence · Computer Science 2012-07-09 Andreas Krause , Carlos E. Guestrin

The JUMP$_k$ benchmark was the first problem for which crossover was proven to give a speed-up over mutation-only evolutionary algorithms. Jansen and Wegener (2002) proved an upper bound of $O(\text{poly}(n) + 4^k/p_c)$ for the ($\mu$+1)…

Neural and Evolutionary Computing · Computer Science 2025-04-22 Andre Opris , Johannes Lengler , Dirk Sudholt

Under Frequency Fitness Assignment (FFA), the fitness corresponding to an objective value is its encounter frequency in fitness assignment steps and is subject to minimization. FFA renders optimization processes invariant under bijective…

Neural and Evolutionary Computing · Computer Science 2020-10-19 Thomas Weise , Zhize Wu , Xinlu Li , Yan Chen

Open-pit mine scheduling is a complex real world optimization problem that involves uncertain economic values and dynamically changing resource capacities. Evolutionary algorithms are particularly effective in these scenarios, as they can…

Neural and Evolutionary Computing · Computer Science 2026-04-16 Ishara Hewa Pathiranage , Aneta Neumann