Related papers: A note on R\'enyi's "record" problem and Engel's s…
Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…
Linear processes are defined as a discrete-time convolution between a kernel and an infinite sequence of i.i.d. random variables. We modify this convolution by introducing decimation, that is, by stretching time accordingly. We then…
Suppose that $\{X_t,\,t\ge0\}$ is a non-stationary Markov process, taking values in a Polish metric space $E$. We prove the law of large numbers and central limit theorem for an additive functional of the form $\int_0^T\psi(X_s)ds$,…
The paper deals with the fast-slow motions setups in the discrete time $X^\epsilon((n+1)\epsilon)=X^\epsilon(n\epsilon)+\epsilon B(X^\epsilon(n\epsilon),\xi(n))$, $n=0,1,...,[T/\epsilon]$ and the continuous time $\frac…
Two time scale stochastic approximation algorithms emulate singularly perturbed deterministic differential equations in a certain limiting sense, i.e., the interpolated iterates on each time scale approach certain differential equations in…
We review recent advances on the record statistics of strongly correlated time series, whose entries denote the positions of a random walk or a L\'evy flight on a line. After a brief survey of the theory of records for independent and…
We investigate the cutoff phenomenon for Markov processes under information divergences such as $f$-divergences and R\'enyi divergences. We classify most common divergences into four types, namely $L^2$-type, $\mathrm{TV}$-type,…
The aim of this note is to prove a law of large numbers for local patterns in discrete point processes. We investigate two different situations: a class of point processes on the one dimensional lattice including certain Schur measures, and…
In this paper, we introduce the notion of Bi-entangled hidden Markov processes. These are hidden quantum processes where the hidden processes themselves exhibit entangled Markov process, and the observable processes also exhibit…
The Marcus-Lushnikov process is a finite stochastic particle system, in which each particle is entirely characterized by its mass. Each pair of particles with masses $x$ and $y$ merges into a single particle at a given rate $K(x,y)$. Under…
Quantum trajectories are Markov processes modeling the evolution of a quantum system subjected to repeated independent measurements. Under purification and irreducibility assumptions, these Markov processes admit a unique invariant measure…
The typical values and fluctuations of time-integrated observables of nonequilibrium processes driven in steady states are known to be characterized by large deviation functions, generalizing the entropy and free energy to nonequilibrium…
We give necessary and sufficient conditions for laws of large numbers to hold in $L^2$ for the empirical measure of a large class of branching Markov processes, including $\lambda$-positive systems but also some $\lambda$-transient ones,…
Suppose $ E$ is a space with a null-recurrent Markov kernel $ P$. Furthermore, suppose there are infinite particles with variable weights on $ E$ performing a random walk following $ P$. Let $ X_{t}$ be a weighted functional of the position…
In a paper from 1995, Wormald gave general criteria for certain parameters in a family of discrete random processes to converge to the solution of a system of differential equations. Based on this method, we show that if some further…
We address the problem of detecting an anomalous process among a large number of processes. At each time t, normal processes are in state zero (normal state), while the abnormal process may be in either state zero (normal state) or state…
We study continuous time Markov processes on graphs. The notion of frequency is introduced, which serves well as a scaling factor between any Markov time of a continuous time Markov process and that of its jump chain. As an application, we…
We investigate a new symmetry of the large deviation function of certain time-integrated currents in non-equilibrium systems. The symmetry is similar to the well-known Gallavotti-Cohen-Evans-Morriss-symmetry for the entropy production, but…
Particle splitting methods are considered for the estimation of rare events. The probability of interest is that a Markov process first enters a set $B$ before another set $A$, and it is assumed that this probability satisfies a large…
We study a precise large deviation principle for a stationary regularly varying sequence of random variables. This principle extends the classical results of A.V. Nagaev (1969) and S.V. Nagaev (1979) for iid regularly varying sequences. The…