Related papers: On Markov--up processes and their recurrence prope…
We revisit processes generated by iterated random functions driven by a stationary and ergodic sequence. Such a process is called strongly stable if a random initialization exists, for which the process is stationary and ergodic, and for…
We provide a full characterization of the set of value functions of Markov decision processes.
The problem of estimating the probability of a random process reaching a certain level is well known. In this article, two-sided estimates are established for the probability that a regenerative process reaches a high level. Two auxiliary…
Riesz space (non-pointwise) generalizations for iterative processes are given for the concepts of recurrence, first recurrence and conditional ergodicity. Riesz space conditional versions of the Poincar\'{e} Recurrence Theorem and the Kac…
We study a class of quantum Markov processes that, on the one hand, is inspired by the micromaser experiment in quantum optics and, on the other hand, by classical birth and death processes. We prove some general geometric properties and…
Coarse-graining is a standard method of extracting a simple Markov process from a more complicated one by identifying states. Here we extend coarse-graining to open Markov processes. An "open" Markov process is one where probability can…
In this article we show that any ergodic rigid system can be topologically realized by a uniformly rigid and (topologically) weak mixing topological dynamical system.
We consider a process on $\mathbb{T}^2$, which consists of fast motion along the stream lines of an incompressible periodic vector field perturbed by white noise. It gives rise to a process on the graph naturally associated to the structure…
In this article, we introduce \textit{Mallows processes}, defined to be continuous-time c\`adl\`ag processes with Mallows distributed marginals. We show that such processes exist and that they can be restricted to have certain natural…
The question of recurrence and transience of branching Markov chains is more subtle than for ordinary Markov chains; they can be classified in transience, weak recurrence, and strong recurrence. We review criteria for transience and weak…
The collective properties of small material systems considered as semidynamical systems revealing the Markov-type irreversible evolution, are investigated. It is shown that these material systems admit their treatment as thermodynamic…
The Oseledets Multiplicative Ergodic theorem is a basic result with numerous applications throughout dynamical systems. These notes provide an introduction to this theorem, as well as subsequent generalizations. They are based on lectures…
We study different pointwise recurrence notions for linear dynamical systems from the Ergodic Theory point of view. We show that from any reiteratively recurrent vector $x_0$, for an adjoint operator $T$ on a separable dual Banach space…
We propose a very efficient method for pricing various types of lookback options under Markov models. We utilize the model-free representations of lookback option prices as integrals of first passage probabilities. We combine efficient…
This study explores a Gaussian quasi-likelihood approach for estimating parameters of diffusion processes with Markovian regime switching. Assuming the ergodicity under high-frequency sampling, we will show the asymptotic normality of the…
A stable-like Markov chain is a time-homogeneous Markov chain on the real line with the transition kernel $p(x,dy)=f_x(y-x)dy$, where the density functions $f_x(y)$, for large $|y|$, have a power-law decay with exponent $\alpha(x)+1$, where…
We study a crystal growth Markov model proposed by Gates and Westcott (\cite{Kinetics1}, \cite{Kinetics2}). This is an aggregation process where particles are packed in a square lattice accordingly to prescribed deposition rates. This model…
A concept of emergence was recently introduced in the paper [Berger] in order to quantify the richness of possible statistical behaviors of orbits of a given dynamical system. In this paper, we develop this concept and provide several new…
After relating the notion of $\omega$-recurrence in skew products to the range of values taken by partial ergodic sums and Lyapunov exponents, ergodic $\mathbb{Z}$-valued cocycles over an irrational rotation are presented in detail. First,…
We study time-changed Markov processes to speed up the convergence of Markov chain Monte Carlo (MCMC) algorithms. The time-changed process is defined by adjusting the speed of time of a base process via a user-chosen, state-dependent…