English
Related papers

Related papers: Fundamental Markov systems

200 papers

We consider random perturbations of discrete-time dynamical systems. We give sufficient conditions for the stochastic stability of certain classes of maps, in a strong sense. This improves the main result in J. F. Alves, V. Araujo, Random…

Dynamical Systems · Mathematics 2010-03-01 Jose F. Alves , Helder Vilarinho

The problem of p-th moment stability for time-varying stochastic time-delay systems with Markovian switching is investigated in this paper. Some novel stability criteria are obtained by applying the generalized Razumikhin and Krasovskii…

Dynamical Systems · Mathematics 2016-07-11 Bin Zhou , Weiwei Luo

Drawing on some recent results that provide the formalism necessary to definite stationarity for infinite random graphs, this paper initiates the study of statistical and learning questions pertaining to these objects. Specifically, a…

Machine Learning · Computer Science 2017-08-11 Daniil Ryabko

One of the proposed solutions to the equilibrium selection problem for agents learning in repeated games is obtained via the notion of stochastic stability. Learning algorithms are perturbed so that the Markov chain underlying the learning…

Computer Science and Game Theory · Computer Science 2012-07-09 John Wicks , Amy Greenwald

We introduce a statistical mechanics formalism for the study of constrained graph evolution as a Markovian stochastic process, in analogy with that available for spin systems, deriving its basic properties and highlighting the role of the…

Disordered Systems and Neural Networks · Physics 2015-05-13 A. C. C. Coolen , A. De Martino , A. Annibale

Stochastic dynamical systems consisting of non-invertible continuous maps on an interval are studied. It is proved that if they satisfy the recently introduced so-called $\mu$-injectivity and some mild assumptions, then proximality,…

Dynamical Systems · Mathematics 2025-12-11 Sander C. Hille , Katarzyna Horbacz , Hanna Oppelmayer , Tomasz Szarek

We show how random unitary dynamics arise from the coupling of an open quantum system to a static environment. Subsequently, we derive a master equation for the reduced system random unitary dynamics and study three specific cases:…

Quantum Physics · Physics 2018-01-17 Chahan M. Kropf , Vyacheslav N. Shatokhin , Andreas Buchleitner

We investigate stability of linear delay differential systems. Stability criteria of the systems are derived based on integrals of the fundamental matrix. They are necessary and sufficient conditions for delay-dependent stability of the…

Optimization and Control · Mathematics 2024-10-30 Guang-Da Hu

Many economic models feature monotone Markov dynamics on state spaces that may be noncompact. Establishing existence, uniqueness, and stability of stationary distributions in such settings has required a patchwork of sufficient conditions,…

Probability · Mathematics 2026-04-07 Takashi Kamihigashi , John Stachurski

This article is concerned with stability analysis and stabilization of randomly switched systems under a class of switching signals. The switching signal is modeled as a jump stochastic (not necessarily Markovian) process independent of the…

Optimization and Control · Mathematics 2011-10-04 Debasish Chatterjee , Daniel Liberzon

We study dynamical systems forced by a combination of random and deterministic noise and provide criteria, in terms of Lyapunov exponents, for the existence of random attractors with continuous structure in the fibres. For this purpose, we…

Dynamical Systems · Mathematics 2017-01-16 Tobias Jäger , Gerhard Keller

We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then…

Probability · Mathematics 2014-12-04 Shaun McKinlay , Konstantin Borovkov

Random dynamical systems (RDS) evolve by a dynamical rule chosen independently with a certain probability, from a given set of deterministic rules. These dynamical systems in an interval reach a steady state with a unique well-defined…

Statistical Mechanics · Physics 2020-09-21 M. S. Shesha Gopal , Soumitro Banerjee , P. K. Mohanty

We consider non-i.i.d. random holomorphic dynamical systems whose choice of maps depends on Markovian rules. We show that generically, such a system is mean stable or chaotic with full Julia set. If a system is mean stable, then the…

Dynamical Systems · Mathematics 2022-04-25 Hiroki Sumi , Takayuki Watanabe

We study notions of robustness of Markov kernels and probability distribution of a system that is described by $n$ input random variables and one output random variable. Markov kernels can be expanded in a series of potentials that allow to…

Commutative Algebra · Mathematics 2011-10-07 Johannes Rauh , Nihat Ay

Metastability is a physical phenomenon ubiquitous in first order phase transitions. A fruitful mathematical way to approach this phenomenon is the study of rare transitions Markov chains. For Metropolis chains associated with Statistical…

Probability · Mathematics 2015-09-30 Emilio Cirillo , Francesca Nardi , Julien Sohier

A particular type of random dynamical processes is considered, in which the stochasticity is introduced through randomly fluctuating parameters. A method of local multipliers is developed for treating the local stability of such dynamical…

Disordered Systems and Neural Networks · Physics 2015-06-25 V. I. Yukalov

We present a general framework to study the metastability of random perturbations of dynamical systems. It integrates techniques from the theory of Markov processes, in particular the resolvent approach to metastability, with the spectral…

Dynamical Systems · Mathematics 2026-02-16 Diego Marcondes , Sandro Vaienti

In this paper we revisit the notion of the "minus logarithm of stationary probability" as a generalized potential in nonequilibrium systems and attempt to illustrate its central role in an axiomatic approach to stochastic nonequilibrium…

Statistical Mechanics · Physics 2016-08-30 Lowell F. Thompson , Hong Qian

In this work, we introduce an information-theoretic approach for considering changes in dynamics of finitely dimensional open quantum systems governed by master equations. This experimentally motivated approach arises from considering how…

Quantum Physics · Physics 2021-05-03 Katarzyna Macieszczak