English
Related papers

Related papers: Markov Chains and Dynamical Systems: The Open Syst…

200 papers

Rate processes are simple and analytically tractable models for many dynamical systems which switch stochastically between a discrete set of quasi stationary states but they may also approximate continuous processes by coarse grained,…

Statistical Mechanics · Physics 2013-03-11 R. Toenjes , H. Kori

In the present paper, we give some examples of stochastic differential equations which have delicateness in the Markov and strong Markov properties, the uniqueness locally in time and globally in time, and initial conditions. Moreover, we…

Probability · Mathematics 2022-09-14 Seiichiro Kusuoka

Master equations describing open quantum dynamics are typically first order differential equations. When such dynamics brings the trajectories in state space of more than one initial state to the same point at finite instants in time, the…

Quantum Physics · Physics 2021-12-03 Abhaya S. Hegde , K. P. Athulya , Vijay Pathak , Jyrki Piilo , Anil Shaji

Data-based inference of directed interactions in complex dynamical systems is a problem common to many disciplines of science. In this work, we study networks of spatially separate dynamical entities, which could represent physical systems…

Statistical Mechanics · Physics 2024-03-15 Tim Hempel , Sarah A. M. Loos

A general theory is developed to study individual based models which are discrete in time. We begin by constructing a Markov chain model that converges to a one-dimensional map in the infinite population limit. Stochastic fluctuations are…

Statistical Mechanics · Physics 2014-06-03 Joseph D. Challenger , Duccio Fanelli , Alan J. McKane

Dynamical processes can be classified in various ways as deterministic or stochastic, and continuous or discrete time. All these types can be studied by the path-spaces they generate, and stationary measures on that path-space. Such…

Dynamical Systems · Mathematics 2026-03-19 Suddhasattwa Das

Decision making in modern stochastic systems, including e-commerce platforms, financial markets and healthcare systems, has evolved into a multifaceted process that combines information acquisition and adaptive information sources. This…

Optimization and Control · Mathematics 2026-01-07 Renyuan Xu , Thaleia Zariphopoulou , Luhao Zhang

The usual setting for learning the structure and parameters of a graphical model assumes the availability of independent samples produced from the corresponding multivariate probability distribution. However, for many models the mixing time…

Machine Learning · Computer Science 2022-10-13 Arkopal Dutt , Andrey Y. Lokhov , Marc Vuffray , Sidhant Misra

We establish an abstract, effective, exponential large deviations type estimate for Markov systems satisfying a weaker form of mixing. We employ this result to derive such estimates, as well as a central limit theorem, for the skew product…

Dynamical Systems · Mathematics 2025-07-17 Ao Cai , Pedro Duarte , Silvius Klein

We consider a simple discrete-time Markov chain with values in $[0,\infty)^{Z^d}$. The Markov chain describes various interesting examples such as oriented percolation, directed polymers in random environment, time discretizations of binary…

Probability · Mathematics 2009-06-26 Nobuo Yoshida

We study the synchronization behavior of discrete-time Markov chains on countable state spaces. Representing a Markov chain in terms of a random dynamical system, which describes the collective dynamics of trajectories driven by the same…

Dynamical Systems · Mathematics 2025-08-14 Robin Chemnitz , Maximilian Engel , Guillermo Olicón-Mendez

The parameters of a discrete stationary Markov model are transition probabilities between states. Traditionally, data consist in sequences of observed states for a given number of individuals over the whole observation period. In such a…

Computation · Statistics 2012-04-30 Alberto Pasanisi , Shuai Fu , Nicolas Bousquet

A theory of systems with long-range correlations based on the consideration of binary N-step Markov chains is developed. In the model, the conditional probability that the i-th symbol in the chain equals zero (or unity) is a linear function…

Data Analysis, Statistics and Probability · Physics 2016-09-08 O. V. Usatenko , V. A. Yampol'skii , K. E. Kechedzhy , S. S. Mel'nyk

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

We consider an ordinary differential equation with a unique hyperbolic attractor at the origin, to which we add a small random perturbation. It is known that under general conditions, the solution of this stochastic differential equation…

Probability · Mathematics 2023-05-05 Gerardo Barrera , Milton Jara

We study finite state random dynamical systems (RDS) and their induced Markov chains (MC) as stochastic models for complex dynamics. The linear representation of deterministic maps in RDS are matrix-valued random variables whose…

Dynamical Systems · Mathematics 2020-03-23 Felix X. -F. Ye , Hong Qian

A central challenge in quantum physics is to understand the structural properties of many-body systems, both in equilibrium and out of equilibrium. For classical systems, we have a unified perspective which connects structural properties of…

Quantum Physics · Physics 2025-10-10 Ainesh Bakshi , Allen Liu , Ankur Moitra , Ewin Tang

A dynamical network, a graph whose nodes are dynamical systems, is usually characterized by a large dimensional space which is not always accesible due to the impossibility of measuring all the variables spanning the state space. Therefore,…

Chaotic Dynamics · Physics 2019-07-25 Irene Sendiña-Nadal , Christophe Letellier

The dynamical behavior of open quantum systems plays a key role in many applications of quantum mechanics, examples ranging from fundamental problems, such as the environment-induced decay of quantum coherence and relaxation in many-body…

Quantum Physics · Physics 2016-05-04 Heinz-Peter Breuer , Elsi-Mari Laine , Jyrki Piilo , Bassano Vacchini

Motivated by a model presented by S. Gudder, we study a quantum generalization of Markov chains and discuss the relation between these maps and open quantum random walks, a class of quantum channels described by S. Attal et al. We consider…

Quantum Physics · Physics 2016-08-10 Carlos F. Lardizabal , Rafael R. Souza