English
Related papers

Related papers: When Does Hillclimbing Fail on Monotone Functions:…

200 papers

In recent work, Lissovoi, Oliveto, and Warwicker (Artificial Intelligence (2023)) proved that the Move Acceptance Hyper-Heuristic (MAHH) leaves the local optimum of the multimodal cliff benchmark with remarkable efficiency. With its…

Neural and Evolutionary Computing · Computer Science 2024-07-22 Benjamin Doerr , Arthur Dremaux , Johannes Lutzeyer , Aurélien Stumpf

It was recently observed that the $(1+(\lambda,\lambda))$ genetic algorithm can comparably easily escape the local optimum of the jump functions benchmark. Consequently, this algorithm can optimize the jump function with jump size $k$ in an…

Neural and Evolutionary Computing · Computer Science 2020-06-08 Denis Antipov , Benjamin Doerr

Leveraging the coherent exploration of Hamiltonian flow, Hamiltonian Monte Carlo produces computationally efficient Monte Carlo estimators, even with respect to complex and high-dimensional target distributions. When confronted with…

Methodology · Statistics 2015-02-06 M. J. Betancourt

A decent number of lower bounds for non-elitist population-based evolutionary algorithms has been shown by now. Most of them are technically demanding due to the (hard to avoid) use of negative drift theorems -- general results which…

Neural and Evolutionary Computing · Computer Science 2021-07-27 Benjamin Doerr

A hybrid evolutionary algorithm with importance sampling method is proposed for multi-dimensional optimization problems in this paper. In order to make use of the information provided in the search process, a set of visited solutions is…

Neural and Evolutionary Computing · Computer Science 2013-08-26 Guanghui Huang , Zhifeng Pan

In most sampling algorithms, including Hamiltonian Monte Carlo, transition rates between states correspond to the probability of making a transition in a single time step, and are constrained to be less than or equal to 1. We derive a…

Machine Learning · Statistics 2015-10-13 Andrew B. Berger , Mayur Mudigonda , Michael R. DeWeese , Jascha Sohl-Dickstein

In this paper, we introduce a novel technique for constrained submodular maximization, inspired by barrier functions in continuous optimization. This connection not only improves the running time for constrained submodular maximization but…

Machine Learning · Computer Science 2020-02-11 Ashwinkumar Badanidiyuru , Amin Karbasi , Ehsan Kazemi , Jan Vondrak

In many classification tasks there is a requirement of monotonicity. Concretely, if all else remains constant, increasing (resp. decreasing) the value of one or more features must not decrease (resp. increase) the value of the prediction.…

Machine Learning · Computer Science 2021-06-02 Joao Marques-Silva , Thomas Gerspacher , Martin Cooper , Alexey Ignatiev , Nina Narodytska

Hamilton and Moitra (2021) showed that, in certain regimes, it is not possible to accelerate Riemannian gradient descent in the hyperbolic plane if we restrict ourselves to algorithms which make queries in a (large) bounded domain and which…

Optimization and Control · Mathematics 2023-06-12 Christopher Criscitiello , Nicolas Boumal

Drift analysis aims at translating the expected progress of an evolutionary algorithm (or more generally, a random process) into a probabilistic guarantee on its run time (hitting time). So far, drift arguments have been successfully…

Neural and Evolutionary Computing · Computer Science 2021-11-01 Benjamin Doerr , Timo Kötzing

In this tutorial, which contains some original results, we bridge the fields of quantum computing algorithms, conservation laws, and many-body quantum systems by examining three algorithms for searching an unordered database of size $N$…

Quantum Physics · Physics 2025-08-29 David A. Meyer , Thomas G. Wong

Machine learning techniques can be useful in applications such as credit approval and college admission. However, to be classified more favorably in such contexts, an agent may decide to strategically withhold some of her features, such as…

Machine Learning · Computer Science 2021-01-15 Anilesh K. Krishnaswamy , Haoming Li , David Rein , Hanrui Zhang , Vincent Conitzer

This short note investigates convergence of adaptive MCMC algorithms, i.e.\ algorithms which modify the Markov chain update probabilities on the fly. We focus on the Containment condition introduced in \cite{roberts2007coupling}. We show…

Computation · Statistics 2013-12-31 Krzysztof Latuszynski , Jeffrey S. Rosenthal

In this work, we present a new algorithm for maximizing a non-monotone submodular function subject to a general constraint. Our algorithm finds an approximate fractional solution for maximizing the multilinear extension of the function over…

Data Structures and Algorithms · Computer Science 2016-08-15 Alina Ene , Huy L. Nguyen

Maximizing submodular functions under cardinality constraints lies at the core of numerous data mining and machine learning applications, including data diversification, data summarization, and coverage problems. In this work, we study this…

Data Structures and Algorithms · Computer Science 2016-11-01 Alessandro Epasto , Silvio Lattanzi , Sergei Vassilvitskii , Morteza Zadimoghaddam

In this paper we combine the k-means and/or k-means type algorithms with a hill climbing algorithm in stages to solve the joint stratification and sample allocation problem. This is a combinatorial optimisation problem in which we search…

Machine Learning · Statistics 2021-08-19 Mervyn O'Luing , Steven Prestwich , S. Armagan Tarim

We study the simple genetic algorithm with a ranking selection mechanism (linear ranking or tournament). We denote by $\ell$ the length of the chromosomes, by $m$ the population size, by $p_C$ the crossover probability and by $p_M$ the…

Probability · Mathematics 2014-03-24 Raphaël Cerf

We present an efficient quantum algorithm for simulating the evolution of a sparse Hamiltonian H for a given time t in terms of a procedure for computing the matrix entries of H. In particular, when H acts on n qubits, has at most a…

Quantum Physics · Physics 2007-05-23 Dominic W. Berry , Graeme Ahokas , Richard Cleve , Barry C. Sanders

We study the recurrence to mistake dynamical balls, that is, dynamical balls that admit some errors and whose proportion of errors decrease tends to zero with the length of the dynamical ball. We prove, under mild assumptions, that the…

Dynamical Systems · Mathematics 2010-11-05 Jerome Rousseau , Paulo Varandas , Yun Zhao

Multi-objective evolutionary algorithms (MOEAs) have become essential tools for solving multi-objective optimization problems (MOPs), making their running time analysis crucial for assessing algorithmic efficiency and guiding practical…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Han Huang , Tianyu Wang , Chaoda Peng , Tongli He , Zhifeng Hao