Related papers: Deterministic chaos for Markov chains
We consider continuous-space, discrete-time Markov chains on $\mathbb{R}^d$, that admit a finite number $N$ of metastable states. Our main motivation for investigating these processes is to analyse random Poincar\'e maps, which describe…
We analyze the notions of monotonicity and complete monotonicity for Markov Chains in continuous-time, taking values in a finite partially ordered set. Similarly to what happens in discrete-time, the two notions are not equivalent. However,…
We consider qualitative and quantitative verification problems for infinite-state Markov chains. We call a Markov chain decisive w.r.t. a given set of target states F if it almost certainly eventually reaches either F or a state from which…
The truly chaotic finite machines introduced by authors in previous research papers are presented here. A state of the art in this discipline, encompassing all previous mathematical investigations, is provided, explaining how finite state…
Consider a finite number of balls initially placed in $L$ bins. At each time step a ball is taken from each non-empty bin. Then all the balls are uniformly reassigned into bins. This finite Markov chain is called Repeated Balls-into-Bins…
The results of this study are continuation of the research of Poincar\'e chaos initiated in papers (Akhmet M, Fen MO. Commun Nonlinear Sci Numer Simulat 2016;40:1-5; Akhmet M, Fen MO. Turk J Math, doi:10.3906/mat-1603-51, accepted). We…
We formalize and analyze the notions of stochastic monotonicity and realizable mono-tonicity for Markov Chains in continuous-time, taking values in a finite partially ordered set. Similarly to what happens in discrete-time, the two notions…
We show that the convergence of finite state space Markov chains to stationarity can often be considerably speeded up by alternating every step of the chain with a deterministic move. Under fairly general conditions, we show that not only…
We consider a class of continuous time Markov chains on $\Z^d$. These chains are the discrete space analogue of Markov processes with jumps. Under some conditions, we show that harmonic functions associated with these Markov chains are…
We analyze the dynamics of a deterministic model of inhibitory neuronal networks proving that the discontinuities of the Poincare map produce a never empty chaotic set, while its continuity pieces produce stable orbits. We classify the…
To make research of chaos more friendly with discrete equations, we introduce the concept of an unpredictable sequence as a specific unpredictable function on the set of integers. It is convenient to be verified as a solution of a discrete…
Nonlinear Markov chains with finite state space have been introduced in Kolokoltsov (2010). The characteristic property of these processes is that the transition probabilities do not only depend on the state, but also on the distribution of…
Many-site Bose-Hubbard lattices display complex semiclassical dynamics, with both chaotic and regular features. We have characterised chaos in the semiclassical dynamics of short Bose-Hubbard chains using both stroboscopic phase space…
Spatiotemporally chaotic dynamics of a Kuramoto-Sivashinsky system is described by means of an infinite hierarchy of its unstable spatiotemporally periodic solutions. An intrinsic parametrization of the corresponding invariant set serves as…
Dynamical chaos is a fundamental manifestation of gravity in astrophysical, many-body systems. The spectrum of Lyapunov exponents quantifies the associated exponential response to small perturbations. Analytical derivations of these…
For a Markov chain both the detailed balance condition and the cycle Kolmogorov condition are algebraic binomials. This remark suggests to study reversible Markov chains with the tool of Algebraic Statistics, such as toric statistical…
We analyze frustrated states of the one-dimensional dilute Ising chain with charged interacting impurities of two types with mapping of the system to some Markov chain. We perform classification and reveal two types of Markov chains:…
Perturbation analysis of Markov chains provides bounds on the effect that a change in a Markov transition matrix has on the corresponding stationary distribution. This paper compares and analyzes bounds found in the literature for finite…
In this work, we characterise the statistics of Markov chains by constructing an associated sequence of periodic differential operators. Studying the density of states of these operators reveals the absolutely continuous invariant measure…
We consider Markov chains which are polynomially mixing, in a weak sense expressed in terms of the space of functions on which the mixing speed is controlled. In this context, we prove polynomial large and moderate deviations inequalities.…