English
Related papers

Related papers: Momentum Accelerates Evolutionary Dynamics

200 papers

The environment has a strong influence on a population's evolutionary dynamics. Driven by both intrinsic and external factors, the environment is subject to continual change in nature. To capture an ever-changing environment, we consider a…

Populations and Evolution · Quantitative Biology 2022-02-18 Qi Su , Alex McAvoy , Long Wang , Martin A. Nowak

Convergence detection of iterative stochastic optimization methods is of great practical interest. This paper considers stochastic gradient descent (SGD) with a constant learning rate and momentum. We show that there exists a transient…

Machine Learning · Computer Science 2020-08-28 Jerry Chee , Ping Li

Natural selection explains how life has evolved over millions of years from more primitive forms. The speed at which this happens, however, has sometimes defied formal explanations when based on random (uniformly distributed) mutations.…

Neural and Evolutionary Computing · Computer Science 2018-06-22 Santiago Hernández-Orozco , Narsis A. Kiani , Hector Zenil

In the paper the memory effect in the system consisting from a trajectory of process and an environment is considered. The environment is presented by scalar potential and noise. The evolution of system is interpreted as process of the…

General Physics · Physics 2008-01-28 Maxim Budaev

Empirically, it has been observed that adding momentum to Stochastic Gradient Descent (SGD) accelerates the convergence of the algorithm. However, the literature has been rather pessimistic, even in the case of convex functions, about the…

Optimization and Control · Mathematics 2025-01-27 Julien Hermant , Marien Renaud , Jean-François Aujol , Charles Dossal , Aude Rondepierre

It is known that evolution strategies in continuous domains might not converge in the presence of noise. It is also known that, under mild assumptions, and using an increasing number of resamplings, one can mitigate the effect of additive…

Optimization and Control · Mathematics 2014-04-10 Marie-Liesse Cauwet

We consider a fixed size population that undergoes an evolutionary adaptation in the weak mutuation rate limit, which we model as a biased Langevin process in the genotype space. We show analytically and numerically that, if the fitness…

Populations and Evolution · Quantitative Biology 2014-02-04 Jakub Otwinowski , Sorin Tanase-Nicola , Ilya Nemenman

Due to the conventional distinction between ecological (rapid) and evolutionary (slow)timescales, ecological and population models to date have typically ignored the effects of evolution. Yet the potential for rapid evolutionary change has…

Populations and Evolution · Quantitative Biology 2012-11-20 Laura E. Jones , Stephen P. Ellner

Natural selection is general and powerful concept not only to explain evolutionary processes of biological organisms but also to design engineering systems such as genetic algorithms and particle filters. There is a surge of interest, both…

Populations and Evolution · Quantitative Biology 2021-06-09 So Nakashima , Tetsuya J. Kobayashi

We integrate dual-process theories of human cognition with evolutionary game theory to study the evolution of automatic and controlled decision-making processes. We introduce a model where agents who make decisions using either automatic or…

Dynamical Systems · Mathematics 2015-07-07 Danielle F. P. Toupo , Steven H. Strogatz , Jonathan D. Cohen , David G. Rand

As Evolutionary Dynamics moves from the realm of theory into application, algorithms are needed to move beyond simple models. Yet few such methods exist in the literature. Ecological and physiological factors are known to be central to…

Populations and Evolution · Quantitative Biology 2025-05-20 Bryce Allen Bagley , Navin Khoshnan , Claudia K Petritsch

We study the role of recombination, as practiced by genetically-competent bacteria, in speeding up Darwinian evolution. This is done by adding a new process to a previously-studied Markov model of evolution on a smooth fitness landscape;…

Populations and Evolution · Quantitative Biology 2009-11-10 Elisheva Cohen , David A. Kessler , Herbert Levine

Evolution is the fundamental physical process that gives rise to biological phenomena. Yet it is widely treated as a subset of population genetics, and thus its scope is artificially limited. As a result, the key issues of how rapidly…

Populations and Evolution · Quantitative Biology 2017-08-23 Nigel Goldenfeld , Carl Woese

Population expansions trigger many biomedical and ecological transitions, from tumor growth to invasions of non-native species. Although population spreading often selects for more invasive phenotypes, we show that this outcome is far from…

Populations and Evolution · Quantitative Biology 2015-12-14 Kirill S. Korolev

In this letter, we deal with evolutionary game theoretic learning processes for population games on networks with dynamically evolving communities. Specifically, we propose a novel mathematical framework in which a deterministic,…

Social and Information Networks · Computer Science 2022-03-02 Alain Govaert , Lorenzo Zino , Emma Tegling

Biodiversity widely observed in ecological systems is attributed to the dynamical balance among the competing species. The time-varying populations of the interacting species are often captured rather well by a set of deterministic…

Populations and Evolution · Quantitative Biology 2010-05-25 Yen-Chih Lin , Tzay-Ming Hong , Hsiu-Hau Lin

In the evolutionary computation community, it is widely believed that stagnation impedes convergence in evolutionary algorithms, and that convergence inherently indicates optimality. However, this perspective is misleading. In this study,…

Machine Learning · Computer Science 2026-02-06 Xiaojun Zhou

In this paper, we wish to investigate the dynamics of information transfer in evolutionary dynamics. We use information theoretic tools to track how much information an evolving population has obtained and managed to retain about different…

Populations and Evolution · Quantitative Biology 2021-04-09 Nicholas Guttenberg

Existing theoretical models of evolution focus on the relative fitness advantages of different mutants in a population while the dynamic behavior of the population size is mostly left unconsidered. We here present a generic stochastic model…

Populations and Evolution · Quantitative Biology 2010-10-20 Anna Melbinger , Jonas Cremer , Erwin Frey

The parallel mutation-selection evolutionary dynamics, in which mutation and replication are independent events, is solved exactly in the case that the Malthusian fitnesses associated to the genomes are described by the Random Energy Model…

Biological Physics · Physics 2009-10-14 David B. Saakian , José F. Fontanari