Related papers: First passage process of a Markov additive process…

We consider the problem of finding the transition rates of a continuous-time homogeneous Markov chain under the empirical condition that the state changes at most once during a time interval of unit length. It is proven that this…

We study the large deviations of current-type observables defined for Markov diffusion processes evolving in smooth bounded regions of $\mathbb{R}^d$ with reflections at the boundaries. We derive for these the correct boundary conditions…

In this work we define a stochastic adding machine associated to the Fibonacci base and to a probabilities sequence $\overline{p}=(p_i)_{i\geq 1}$. We obtain a Markov chain whose states are the set of nonnegative integers. We study…

A fluctuation theorem is examined for the first-passage time of a biomolecular machine (e.g., a motor protein or an enzyme) in a nonequilibrium steady-state. For such machines in which the driven, observable process is coupled to a hidden…

Iteration of randomly chosen quadratic maps defines a Markov process: X_{n+1}=\epsilon_{n+1}X_n(1-X_n), where \epsilon_n are i.i.d. with values in the parameter space [0,4] of quadratic maps F_{\theta}(x)=\theta x(1-x). Its study is of…

First passage distributions of semi-Markov processes are of interest in fields such as reliability, survival analysis, and many others. The problem of finding or computing first passage distributions is, in general, quite challenging. We…

Questions are posed regarding the influence that the column sums of the transition probabilities of a stochastic matrix (with row sums all one) have on the stationary distribution, the mean first passage times and the Kemeny constant of the…

We obtain the first passage time density for a L\'{e}vy flight random process from a subordination scheme. By this method, we infer the asymptotic behavior directly from the Brownian solution and the Sparre Andersen theorem, avoiding…

We establish non-asymptotic error bounds for the classical Maximal Likelihood Estimation of the transition matrix of a given Markov chain. Meanwhile, in the reversible case, we propose a new reversibility-preserving online Symmetric…

We analyze the absolute spectral gap of Markov chains on graphs obtained from a cycle of $n$ vertices and perturbed only at approximately $n^{1/\rho}$ random locations with an appropriate, possibly sparse, interconnection structure.…

Random acceleration is a fundamental stochastic process encountered in many applications. In the one-dimensional version of the process a particle is randomly accelerated according to the Langevin equation $\ddot{x}(t) = \sqrt{2D} \xi(t)$,…

We uncover a duality between relaxation and first passage processes in ergodic reversible Markovian dynamics in both discrete and continuous state-space. The duality exists in the form of a spectral interlacing -- the respective time scales…

This is a survey paper about reciprocal processes. The bridges of a Markov process are also Markov. But an arbitrary mixture of these bridges fails to be Markov in general. However, it still enjoys the interesting properties of a reciprocal…

We develop direct and inverse scattering theory for Jacobi operators with steplike quasi-periodic finite-gap background in the same isospectral class. We derive the corresponding Gel'fand-Levitan-Marchenko equation and find minimal…

A new model that maps a quantum random walk described by a Hadamard operator to a particular case of a random walk is presented. The model is represented by a Markov chain with a stochastic matrix, i.e., all the transition rates are…

A spectrally positive additive L\'evy field is a multidimensional field obtained as the sum $\mathbf{X}_{\rm t}={\rm X}^{(1)}_{t_1}+{\rm X}^{(2)}_{t_2}+\dots+{\rm X}^{(d)}_{t_d}$, ${\rm t}=(t_1,\dots,t_d)\in\mathbb{R}_+^d$, where ${\rm…

We propose an exact technique to calculate lower bounds of spectral gaps of discrete time reversible Markov chains on finite state sets. Spectral gaps are a common tool for evaluating convergence rates of Markov chains. As an illustration,…

We develop novel numerical methods and perturbation approaches to determine the mean first passage time (MFPT) for a Brownian particle to be captured by either small stationary or mobile traps inside a bounded 2-D confining domain. Of…

The distribution of the first-passage time (FPT)$T_a$ for a Brownian particle with drift $\mu$ subject to hitting an absorber at a level $a>0$ is well-known and given by its density $\gamma(t) = \frac{a}{\sqrt{2 \pi t^3} } e^{-\frac{(a-\mu…

We present a method to sample Markov-chain trajectories constrained to both the initial and final conditions, which we term Markov bridges. The trajectories are conditioned to end in a specific state at a given time. We derive the master…