Related papers: Markov Processes with Restart
Recently, in ["The coin-turning walk and its scaling limit", Electronic Journal of Probability, 25 (2020)], the ``coin-turning walk'' was introduced on ${\mathbb Z}$. It is a non-Markovian process where the steps form a (possibly)…
We study the hitting times of Markov processes to target set $G$, starting from a reference configuration $x_0$ or its basin of attraction. The configuration $x_0$ can correspond to the bottom of a (meta)stable well, while the target $G$…
Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…
Many integrable stochastic particle systems in one space dimension (such as TASEP - Totally Asymmetric Simple Exclusion Process - and its $q$-deformation, the $q$-TASEP) remain integrable if we equip each particle with its own speed…
We develop a model for credit rating migration that accounts for the impact of economic state fluctuations on default probabilities. The joint process for the economic state and the rating is modelled as a time-homogeneous Markov chain.…
We provide a probabilistic description of the stationary measures for the open KPZ on the spatial interval $[0,1]$ in terms of a Markov process $Y$, which is a Doob's $h$ transform of the Brownian motion killed at an exponential rate. Our…
We study a continuous-time random walk, $X$, on $\mathbb{Z}^d$ in an environment of dynamic random conductances taking values in $(0, \infty)$. We assume that the law of the conductances is ergodic with respect to space-time shifts. We…
In this article, we analyze three classes of time-reversal of a Markov process with Gaussian noise on a manifold. We first unveil a commutativity constraint for the most general of these time-reversals to be well defined. Then we give a…
We consider a one-dimensional piecewise deterministic Markov process (PDMP) on $[0,1]$ with resetting at $0$ and depending on a small parameter $\varepsilon>0$. In the singular vanishing limit $\varepsilon \to 0$ we prove that the ``…
First-passage properties are central to the kinetics of target-search processes. Theoretical approaches so far primarily focused on predicting first-passage statistics for a given process or model. In practice, however, one faces the…
We register a random sequence which has the following properties: it has three segments being the homogeneous Markov processes. Each segment has his own one step transition probability law and the length of the segment is unknown and…
Renewal processes are zero-dimensional processes defined by independent intervals of time between zero crossings of a random walker. We subject renewal processes them to stochastic resetting by setting the position of the random walker to…
We consider a random walk on a homogeneous Poisson point process with energy marks. The jump rates decay exponentially in the A-power of the jump length and depend on the energy marks via a Boltzmann--like factor. The case A=1 corresponds…
We present a unified approach to those observables of stochastic processes under reset that take the form of averages of functionals depending on the most recent renewal period. We derive solutions for the observables, and determine the…
We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…
For continuous-time ergodic Markov processes, the Kemeny time $\tau_*$ is the characteristic time needed to converge towards the steady state $P_*(x)$ : in real-space, the Kemeny time $\tau_*$ corresponds to the average of the…
Stochastic resetting is a powerful strategy known to accelerate the first-passage time statistics of stochastic processes. While its effects on Markovian systems are well understood, a general framework for non-Markovian dynamics is still…
Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (or minimize…
The dynamics of the solutions to a class of conservative SPDEs are analysed from two perspectives: Firstly, a probabilistic construction of a corresponding random dynamical system is given for the first time. Secondly, the existence and…
Reinforced processes are known to provide a stochastic representation for the quasi-stationary distribution of a given killed Markov process - describing the killed Markov process at fixed time instants. In this paper we shall adapt the…