English
Related papers

Related papers: Stagnation in Evolutionary Algorithms: Convergence…

200 papers

Evolutionary algorithms (EAs) are general-purpose optimisers that come with several parameters like the sizes of parent and offspring populations or the mutation rate. It is well known that the performance of EAs may depend drastically on…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Mario Alejandro Hevia Fajardo , Dirk Sudholt

A recent line of ground-breaking results for permutation-based SGD has corroborated a widely observed phenomenon: random permutations offer faster convergence than with-replacement sampling. However, is random optimal? We show that this…

Machine Learning · Computer Science 2021-11-29 Shashank Rajput , Kangwook Lee , Dimitris Papailiopoulos

Dynamic optimisation occurs in a variety of real-world problems. To tackle these problems, evolutionary algorithms have been extensively used due to their effectiveness and minimum design effort. However, for dynamic problems, extra…

Neural and Evolutionary Computing · Computer Science 2020-08-11 Maryam Hasani Shoreh , Renato Hermoza Aragonés , Frank Neumann

Cooperation is a difficult proposition in the face of Darwinian selection. Those that defect have an evolutionary advantage over cooperators who should therefore die out. However, spatial structure enables cooperators to survive through the…

Physics and Society · Physics 2018-02-02 Attila Szolnoki , Matjaz Perc

Self-adaptation is used in all main paradigms of evolutionary computation to increase efficiency. We claim that the basis of self-adaptation is the use of neutrality. In the absence of external control neutrality allows a variation of the…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Marc Toussaint , Christian Igel

We employ an evolutionary algorithm to automatically optimize different stages of a cold atom experiment without human intervention. This approach closes the loop between computer based experimental control systems and automatic real time…

This paper shows how to evolve numerically the maximum entropy probability distributions for a given set of constraints, which is a variational calculus problem. An evolutionary algorithm can obtain approximations to some well-known…

Methodology · Statistics 2020-02-07 Raul Rojas

Evolution is the process of optimal adaptation of biological populations to their living environments. This is expressed via the concept of fitness, defined as relative reproductive success. However, it has been pointed out that this…

Populations and Evolution · Quantitative Biology 2025-04-17 Luís MA Bettencourt , Brandon J Grandison , Jordan T Kemp

This paper studies the asymptotic behavior of several continuous-time dynamical systems which are analogs of ant colony optimization algorithms that solve shortest path problems. Local asymptotic stability of the equilibrium corresponding…

Dynamical Systems · Mathematics 2014-08-26 Pierre-Alexandre Bliman , Amit Bhaya , Eugenius Kaszkurewicz , Jayadeva

The importance of an adequate inner loop starting point (as opposed to a sufficient inner loop stopping rule) is discussed in the context of a numerical optimization algorithm consisting of nested primal-dual proximal-gradient iterations.…

Optimization and Control · Mathematics 2018-06-21 Jixin Chen , Ignace Loris

Stochastic difference-of-convex (DC) optimization is prevalent in numerous machine learning applications, yet its convergence properties under small batch sizes remain poorly understood. Existing methods typically require large batches or…

Machine Learning · Computer Science 2025-10-21 El Mahdi Chayti , Martin Jaggi

The overall performance or expected excess risk of an iterative machine learning algorithm can be decomposed into training error and generalization error. While the former is controlled by its convergence analysis, the latter can be tightly…

Machine Learning · Statistics 2018-04-06 Yuansi Chen , Chi Jin , Bin Yu

We study sorting in the evolving data model, introduced by [AKMU11], where the true total order changes while the sorting algorithm is processing the input. More precisely, each comparison operation of the algorithm is followed by a…

Data Structures and Algorithms · Computer Science 2024-09-24 George Giakkoupis , Marcos Kiwi , Dimitrios Los

Evolution occurs in populations of reproducing individuals. The structure of a biological population affects which traits evolve. Understanding evolutionary game dynamics in structured populations is difficult. Precise results have been…

Populations and Evolution · Quantitative Biology 2017-08-16 Benjamin Allen , Gabor Lippner , Yu-Ting Chen , Babak Fotouhi , Naghmeh Momeni , Martin A. Nowak , Shing-Tung Yau

Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little…

Optimization and Control · Mathematics 2010-09-28 Y. Censor , R. Davidi , G. T. Herman

Evolutionary and bioinspired computation are crucial for efficiently addressing complex optimization problems across diverse application domains. By mimicking processes observed in nature, like evolution itself, these algorithms offer…

Neural and Evolutionary Computing · Computer Science 2025-01-14 Daniel Molina , Javier Del Ser , Javier Poyatos , Francisco Herrera

The use of algorithmic predictions in decision-making leads to a feedback loop where the models we deploy actively influence the data distributions we see, and later use to retrain on. This dynamic was formalized by Perdomo et al. 2020 in…

Machine Learning · Computer Science 2026-03-02 Gabriele Farina , Juan Carlos Perdomo

A key aspect of the design of evolutionary and swarm intelligence algorithms is studying their performance. Statistical comparisons are also a crucial part which allows for reliable conclusions to be drawn. In the present paper we gather…

Neural and Evolutionary Computing · Computer Science 2020-02-26 J. Carrasco , S. García , M. M. Rueda , S. Das , F. Herrera

We say that an algorithm is stable if small changes in the input result in small changes in the output. This kind of algorithm stability is particularly relevant when analyzing and visualizing time-varying data. Stability in general plays…

Data Structures and Algorithms · Computer Science 2025-03-10 Wouter Meulemans , Bettina Speckmann , Kevin Verbeek , Jules Wulms

We bound the time it takes for a group of birds to reach steady state in a standard flocking model. We prove that (i) within single exponential time fragmentation ceases and each bird settles on a fixed flying direction; (ii) the flocking…

Computational Geometry · Computer Science 2009-05-27 Bernard Chazelle