English
Related papers

Related papers: Stochastic Replicator Dynamics Subject to Markovia…

200 papers

We study the asymptotic behavior of deterministic, continuous-time imitation dynamics for population games over networks. The basic assumption of this learning mechanism -- encompassing the replicator dynamics -- is that players belonging…

Systems and Control · Electrical Eng. & Systems 2020-10-23 Giacomo Como , Fabio Fagnani , Lorenzo Zino

We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then…

Probability · Mathematics 2014-12-04 Shaun McKinlay , Konstantin Borovkov

In an adaptive population which models financial markets and distributed control, we consider how the dynamics depends on the diversity of the agents' initial preferences of strategies. When the diversity decreases, more agents tend to…

Physics and Society · Physics 2008-12-02 H. M. Yang , Y. S. Ting , K. Y. Michael Wong

We consider a stochastic process which is (a) described by a continuous-time Markov chain on only short time-scales and (b) constrained to conserve a number of hidden quantities on long time-scales. We assume that the transition matrix of…

Statistical Mechanics · Physics 2020-10-27 Vitaly Vanchurin

This contribution is concerned with mathematical models for the dynamics of the genetic composition of populations evolving under recombination. Recombination is the genetic mechanism by which two parent individuals create the mixed type of…

Populations and Evolution · Quantitative Biology 2011-01-12 Ellen Baake

In this paper, we study four-strategy conservative replicator dynamics induced by constant payoff matrices. We establish necessary and sufficient conditions for permanence to occur by associating the payoff matrix with its digraph,…

Dynamical Systems · Mathematics 2026-04-08 Haoyu Yin , Xudong Chen , Bruno Sinopoli

When describing the effective dynamics of an observable in a many-body system, the repeated randomness assumption, which states that the system returns in a short time to a maximum entropy state, is a crucial hypothesis to guarantee that…

Quantum Physics · Physics 2024-09-25 Philipp Strasberg , Andreas Winter , Jochen Gemmer , Jiaozi Wang

We study adaptive dynamics in games where players abandon the population at a given rate, and are replaced by naive players characterized by a prior distribution over the admitted strategies. We demonstrate how such process leads…

Computer Science and Game Theory · Computer Science 2013-08-13 Jeppe Juul , Ardeshir Kianercy , Sebastian Bernhardsson , Simone Pigolotti

Many psychological experiments have subjects repeat a task to gain the statistical precision required to test quantitative theories of psychological performance. In such experiments, time-on-task can have sizable effects on performance,…

Applications · Statistics 2021-11-05 David Gunawan , Guy E. Hawkins , Robert Kohn , Minh-Ngoc Tran , Scott D. Brown

We investigate multivariate regular variation in the context of time-homogeneous Markov chains on general vector spaces and in random coefficient linear models. In the first part, we show that the regular variation of the stationary…

Probability · Mathematics 2025-10-23 Piotr Dyszewski , Tamara Mika

We study the synchronization behavior of discrete-time Markov chains on countable state spaces. Representing a Markov chain in terms of a random dynamical system, which describes the collective dynamics of trajectories driven by the same…

Dynamical Systems · Mathematics 2025-08-14 Robin Chemnitz , Maximilian Engel , Guillermo Olicón-Mendez

We consider stochastic descriptions of chemical reaction networks in which there are both fast and slow reactions, and for which the time scales are widely separated. We develop a computational algorithm that produces the generator of the…

Dynamical Systems · Mathematics 2015-12-11 Xingye Kan , Chang Hyeong Lee , Hans G. Othmer

This article is concerned with stability analysis and stabilization of randomly switched systems under a class of switching signals. The switching signal is modeled as a jump stochastic (not necessarily Markovian) process independent of the…

Optimization and Control · Mathematics 2011-10-04 Debasish Chatterjee , Daniel Liberzon

We consider a class of stochastic dynamical systems, called piecewise deterministic Markov processes, with states $(x, \s)\in \O\times \G$, $\O$ being a region in $\bbR^d$ or the $d$--dimensional torus, $\G$ being a finite set. The…

Statistical Mechanics · Physics 2009-02-25 Alessandra Faggionato , Davide Gabrielli , Marco Ribezzi Crivellari

We consider a dynamic social network model in which agents play repeated games in pairings determined by a stochastically evolving social network. Individual agents begin to interact at random, with the interactions modeled as games. The…

Probability · Mathematics 2007-05-23 Brian Skyrms , Robin Pemantle

It is known that state-dependent, multi-step Lyapunov bounds lead to greatly simplified verification theorems for stability for large classes of Markov chain models. This is one component of the "fluid model" approach to stability of…

Optimization and Control · Mathematics 2012-05-18 Serdar Yüksel , Sean P. Meyn

The recent interest in human dynamics has led researchers to investigate the stochastic processes that explain human behaviour in various contexts. Here we propose a generative model to capture the dynamics of survival analysis,…

Physics and Society · Physics 2015-09-30 Trevor Fenner , Mark Levene , George Loizou

In this work, we develop a mathematical framework to model a quantum system whose Hamiltonian may depend on the state of changing environment, that evolves according to a Markovian process. When the environment changes its state, the…

Quantum Physics · Physics 2023-08-17 Henryk Gzyl

This work advances the theoretical foundations of reservoir computing (RC) by providing a unified treatment of fading memory and the echo state property (ESP) in both deterministic and stochastic settings. We investigate state-space…

Machine Learning · Statistics 2026-05-15 Juan-Pablo Ortega , Florian Rossmannek

Stochastic dynamics of chemical reactions in a mutually repressing two-gene circuit is numerically simulated. The circuit has a rich variety of different states when the kinetic change of DNA status is slow. The stochastic switching…

Disordered Systems and Neural Networks · Physics 2009-11-11 Tomohiro Ushikubo , Wataru Inoue , Mitsumasa Yoda , Masaki Sasai