Related papers: Contractive Markov systems II
We employ an extension of ergodic theory to the random setting to investigate the existence of random periodic solutions of random dynamical systems. Given that a random dynamical system has a dissipative structure, we proved that a random…
A discrete time stochastic model for a multiagent system given in terms of a large collection of interacting Markov chains is studied. The evolution of the interacting particles is described through a time inhomogeneous transition…
There is studied an invariant measure structure of a class of ergodicl discrete dynamical systems by means of the measure generating function method
Ergodicity of random dynamical systems with a periodic measure is obtained on a Polish space. In the Markovian case, the idea of Poincar\'e sections is introduced. It is proved that if the periodic measure is PS-ergodic, then it is ergodic.…
We conduct a systematic study of asynchronous models of distributed computing consisting of identical finite-state devices that cooperate in a network to decide if the network satisfies a given graph-theoretical property. Models discussed…
We study ergodic properties of a family of traffic maps acting in the space of bi-infinite sequences of real numbers. The corresponding dynamics mimics the motion of vehicles in a simple traffic flow, which explains the name. Using…
We comment on some conceptual and and technical problems related to computational mechanics, point out some errors in several papers, and straighten out some wrong priority claims. We present explicitly the correct algorithm for…
We construct relativistic quantum Markov semigroups from covariant completely positive maps. We proceed by generalizing a step in Stinespring's dilation to a general system of imprimitivity and basing it on Poincar\'e group. The resulting…
It is easy to verify the equivalence of the quantum Markov property and the strong additivity of entropy for graded quantum systems as well. However, the structure of Markov states for graded systems is different from that for tensor…
Predictive constructions are a powerful way of characterizing the probability law of stochastic processes with certain forms of invariance, such as exchangeability or Markov exchangeability. When de Finetti-like representation theorems are…
We consider topological Markov chains (also called Markov shifts) on countable graphs. We show that a transient graph can be extended to a recurrent graph of equal entropy which is either positive recurrent of null recurrent, and we give an…
We introduce the notion of combinatorial encoding of continuous dynamical systems and suggest the first examples, which are the most interesting and important, namely, the combinatorial encoding of a Bernoulli process with continuous state…
It is shown how to model any automorphism of a totally disconnected, locally compact group by a symbolic dynamical system. The model is an inverse limit of a product of a full-shift, on a finite number of symbols, with one of two types of…
Ergodic properties and asymptotic stationarity are investigated in this paper for the pseudo-covariance matrix (PCM) of a recursive state estimator which is robust against parametric uncertainties and is based on plant output measurements…
Given a finite irreducible set of real $d \times d$ matrices $A_1,\ldots,A_M$ and a real parameter $s>0$, there exists a unique shift-invariant equilibrium state associated to $(A_1,\ldots,A_M,s)$. In this article we characterise the…
We study a fairly general class of time-homogeneous stochastic evolutions driven by noises that are not white in time. As a consequence, the resulting processes do not have the Markov property. In this setting, we obtain constructive…
This paper studies continuous-time Markov decision processes under the risk-sensitive average cost criterion. The state space is a finite set, the action space is a Borel space, the cost and transition rates are bounded, and the…
We provide an example of a discrete-time Markov process on the three-dimensional infinite integer lattice with Z_q-invariant Bernoulli-increments which has as local state space the cyclic group Z_q. We show that the system has a unique…
We consider piecewise deterministic Markov processes with degenerate transition kernels of the "house-of-cards"-type. We use a splitting scheme based on jump times to prove the absolute continuity, as well as some regularity, of the…
A problem from thermodynamic formalism for countable symbolic Markov chains is considered. It concerns asymptotic behavior of the equilibrium measures corresponding to increasing sequences of finite sub-matrices of an infinite nonnegative…