Related papers: On the Expectation of the First Exit Time of a Non…

A Markov assumption considers a physical system memoryless to simplify its dynamics. Whereas memory effect or the non-Markovian phenomenon is more general in nature. In the quantum regime, it is challenging to define or quantify the…

We introduce a general method, based on a mapping onto quantum mechanics, for investigating the large-T limit of the distribution P(r,T) of the nonlinear functional r[V] = (1/T)\int_0^T dT' V[X(T')], where V(X) is an arbitrary function of…

Let $\{X_n\}$ be a stationary and ergodic time series taking values from a finite or countably infinite set ${\cal X}$. Assume that the distribution of the process is otherwise unknown. We propose a sequence of stopping times $\lambda_n$…

A common assumption when modeling queuing systems is that arrivals behave like a Poisson process with constant parameter. In practice, however, call arrivals are often observed to be significantly overdispersed. This motivates that in this…

Motivated by recent developments of quasi-stationary Monte Carlo methods, we investigate the stability of quasi-stationary distributions of killed Markov processes under perturbations of the generator. We first consider a general bounded…

In this paper, we study a birth and death process $\{N_t\}_{t\ge0}$ on positive half lattice, which at each discontinuity jumps at most a distance $R\ge 1$ to the right or exactly a distance $1$ to the left. The transitional probabilities…

This paper presents a nonparametric method for estimating the conditional density associated to the jump rate of a piecewise-deterministic Markov process. In our framework, the estimation needs only one observation of the process within a…

The stationary asymptotic properties of the diffusion limit of a multi-type branching process with neutral mutations are studied. For the critical and subcritical processes the interesting limits are those of quasi-stationary distributions…

The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete-time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the…

This paper investigates tail asymptotics of stationary distributions and quasi-stationary distributions (QSDs) of continuous-time Markov chains on subsets of the non-negative integers. Based on the so-called flux-balance equation, we…

We introduce the notion of Quasi-Stationary State (QSS) in the context of quantum Markov semigroups that generalizes the one of quasi-stationary distribution in the case of classical Markov chains. We provide an operational interpretation…

This paper contributes an in-depth study of properties of continuous time Markov chains (CTMCs) on non-negative integer lattices $\N_0^d$, with particular interest in one-dimensional CTMCs with polynomial transitions rates. Such stochastic…

Semi-Markov processes are Markovian processes in which the firing time of the transitions is modelled by probabilistic distributions over positive reals interpreted as the probability of firing a transition at a certain moment in time. In…

We obtain a closed-form formula for the quasi-stationary distribution of the classical Shiryaev martingale diffusion considered on the positive half-line $[A,+\infty)$ with $A>0$ fixed; the state space's left endpoint is assumed to be the…

We consider a Markov chain $(M_{n})_{n\ge 0}$ on the set $\mathbb{N}_{0}$ of nonnegative integers which is eventually decreasing, i.e. $\mathbb{P}\{M_{n+1}<M_{n}|M_{n}\ge a\}=1$ for some $a\in\mathbb{N}$ and all $n\ge 0$. We are interested…

For a skip-free Markov process on non-negative integers with generator matrix Q, we evaluate the joint Laplace transform of the occupation times before hitting the state n (starting at 0). This Laplace transform has a very straightforward…

There exist a large literature on the application of $q$-statistics to the out-of-equilibrium non-ergodic systems in which some degree of strong correlations exists. Here we study the distribution of first return times to zero, $P_R(0,t)$,…

This paper considers the subexponential asymptotics of the stationary distributions of GI/G/1-type Markov chains in two cases: (i) the phase transition matrix in non-boundary levels is stochastic; and (ii) it is strictly substochastic. For…

We consider the first exit point distribution from a bounded domain $\Omega$ of the stochastic process $(X_t)_{t\ge 0}$ solution to the overdamped Langevin dynamics $$d X_t = -\nabla f(X_t) d t + \sqrt{h} \ d B_t$$ starting from the…

We propose a method to define quasiprobability distributions for general spin-$j$ systems of dimension $n=2j+1$, where $n$ is a prime or power of prime. The method is based on a complete set of orthonormal commuting operators related to…