English
Related papers

Related papers: Already Moderate Population Sizes Provably Yield S…

200 papers

We study the convergence properties of the conditional (Kullback-Leibler) entropy in stochastic systems. We have proved very general results showing that asymptotic stability is a necessary and sufficient condition for the monotone…

Statistical Mechanics · Physics 2008-04-15 Michael C. Mackey , Marta Tyran-Kaminska

The population recovery problem is a basic problem in noisy unsupervised learning that has attracted significant research attention in recent years [WY12,DRWY12, MS13, BIMP13, LZ15,DST16]. A number of different variants of this problem have…

Data Structures and Algorithms · Computer Science 2017-03-07 Anindya De , Ryan O'Donnell , Rocco Servedio

Extending previous analyses on function classes like linear functions, we analyze how the simple (1+1) evolutionary algorithm optimizes pseudo-Boolean functions that are strictly monotone. Contrary to what one would expect, not all of these…

Neural and Evolutionary Computing · Computer Science 2015-03-17 Benjamin Doerr , Thomas Jansen , Dirk Sudholt , Carola Winzen , Christine Zarges

Stochastic first-order methods are standard for training large-scale machine learning models. Random behavior may cause a particular run of an algorithm to result in a highly suboptimal objective value, whereas theoretical guarantees are…

Optimization and Control · Mathematics 2024-09-02 Eduard Gorbunov , Marina Danilova , Innokentiy Shibaev , Pavel Dvurechensky , Alexander Gasnikov

Symmetry is a unifying concept in physics. In quantum information and beyond, it is known that quantum states possessing symmetry are not useful for certain information-processing tasks. For example, states that commute with a Hamiltonian…

Quantum Physics · Physics 2023-09-27 Margarite L. LaBorde , Soorya Rethinasamy , Mark M. Wilde

In this paper, we explore the impact of noise on quantum computing, particularly focusing on the challenges when sampling bit strings from noisy quantum computers as well as the implications for optimization and machine learning…

Today's experimental noisy quantum processors can compete with and surpass all known algorithms on state-of-the-art supercomputers for the computational benchmark task of Random Circuit Sampling [1-5]. Additionally, a circuit-based quantum…

Quantum Physics · Physics 2024-01-22 K. Kechedzhi , S. V. Isakov , S. Mandrà , B. Villalonga , X. Mi , S. Boixo , V. Smelyanskiy

It is known that the evolutionary algorithm $(1+1)$-EA with mutation rate $c/n$ optimises every monotone function efficiently if $c<1$, and needs exponential time on some monotone functions (HotTopic functions) if $c\geq 2.2$. We study the…

Neural and Evolutionary Computing · Computer Science 2018-03-29 Johannes Lengler

The practice of evolutionary algorithms involves the tuning of many parameters. How big should the population be? How many generations should the algorithm run? What is the (tournament selection) tournament size? What probabilities should…

Neural and Evolutionary Computing · Computer Science 2018-06-08 Moshe Sipper , Weixuan Fu , Karuna Ahuja , Jason H. Moore

We consider the problem of detecting a small subset of defective items from a large set via non-adaptive "random pooling" group tests. We consider both the case when the measurements are noiseless, and the case when the measurements are…

Information Theory · Computer Science 2011-07-25 Chun Lam Chan , Pak Hou Che , Sidharth Jaggi , Venkatesh Saligrama

In most practical problems of classifier learning, the training data suffers from the label noise. Hence, it is important to understand how robust is a learning algorithm to such label noise. This paper presents some theoretical analysis to…

Machine Learning · Computer Science 2016-08-29 Aritra Ghosh , Naresh Manwani , P. S. Sastry

It was recently observed that the $(1+(\lambda,\lambda))$ genetic algorithm can comparably easily escape the local optimum of the jump functions benchmark. Consequently, this algorithm can optimize the jump function with jump size $k$ in an…

Neural and Evolutionary Computing · Computer Science 2020-06-08 Denis Antipov , Benjamin Doerr

This paper establishes theoretical bonafides for implicit concurrent multivariate effect evaluation--implicit concurrency for short---a broad and versatile computational learning efficiency thought to underlie general-purpose, non-local,…

Neural and Evolutionary Computing · Computer Science 2013-07-16 Keki M. Burjorjee

The OneMax problem is a standard benchmark optimisation problem for a binary search space. Recent work on applying a Bandit-Based Random Mutation Hill-Climbing algorithm to the noisy OneMax Problem showed that it is important to choose a…

Neural and Evolutionary Computing · Computer Science 2017-06-13 Jialin Liu , Michael Fairbank , Diego Pérez-Liébana , Simon M. Lucas

Fault-tolerant quantum computation traditionally incurs substantial resource overhead, with both qubit and time overheads scaling polylogarithmically with the size of the computation. While prior work by Gottesman showed that constant qubit…

Quantum Physics · Physics 2025-12-03 Matthias Christandl , Omar Fawzi , Ashutosh Goswami

The development of fault-tolerant quantum processors relies on the ability to control noise. A particularly insidious form of noise is temporally correlated or non-Markovian noise. By combining randomized benchmarking with supervised…

The heavy-tailed mutation operator proposed in Doerr, Le, Makhmara, and Nguyen (GECCO 2017), called \emph{fast mutation} to agree with the previously used language, so far was proven to be advantageous only in mutation-based algorithms.…

Neural and Evolutionary Computing · Computer Science 2022-06-09 Denis Antipov , Maxim Buzdalov , Benjamin Doerr

Evolutionary Algorithms (EAs) and other randomized search heuristics are often considered as unbiased algorithms that are invariant with respect to different transformations of the underlying search space. However, if a certain amount of…

Neural and Evolutionary Computing · Computer Science 2020-10-26 Amirhossein Rajabi , Carsten Witt

Linear functions play a key role in the runtime analysis of evolutionary algorithms and studies have provided a wide range of new insights and techniques for analyzing evolutionary computation methods. Motivated by studies on separable…

Neural and Evolutionary Computing · Computer Science 2022-08-12 Frank Neumann , Carsten Witt

Test-time scaling has emerged as a promising direction for enhancing the reasoning capabilities of Large Language Models in last few years. In this work, we propose Population-Evolve, a training-free method inspired by Genetic Algorithms to…

Artificial Intelligence · Computer Science 2025-12-23 Yanzhi Zhang , Yitong Duan , Zhaoxi Zhang , Jiyan He , Shuxin Zheng