Related papers: Fluctuation theory and exit systems for positive s…
This work focuses on time-inhomogeneous Markov chains with two time scales. Our motivations stem from applications in reliability and dependability, queueing networks, financial engineering and manufacturing systems, where two-time-scale…
Consider a Markov chain $\{X_n\}_{n\ge 0}$ with an ergodic probability measure $\pi$. Let $\Psi$ a function on the state space of the chain, with $\alpha$-tails with respect to $\pi$, $\alpha\in (0,2)$. We find sufficient conditions on the…
We study scaling limits of non-increasing Markov chains with values in the set of non-negative integers, under the assumption that the large jump events are rare and happen at rates that behave like a negative power of the current state. We…
The subject of this paper is a fragmentation equation with nonconservative solutions, some mass being lost to a dust of zero-mass particles as a consequence of an intensive splitting. Under some assumptions of regular variation on the…
Let \xi_t, t\in[0,T], be a strong Markov process with values in a complete separable metric space (X,\rho) and with transition probability function P_{s,t}(x,dy), 0\le s\le t\le T, x\in X. For any h\in[0,T] and a>0, consider the function…
For a spectrally negative positive self-similar Markov process with an a.s. finite overall supremum we provide, in tractable detail, a kind of conditional Wiener-Hopf factorization at the maximum of the absorption time at zero, the…
The fluctuation-dissipation theorem (FDT) is a central result in statistical physics, both for classical and quantum systems. It establishes a relationship between the linear response of a system under a time-dependent perturbation and time…
We present a physically inspired generalization of equilibrium response formulae, the fluctuation-dissipation theorem, to Markov jump processes possibly describing interacting particle systems out-of-equilibrium. Here, the time-dependent…
Semi-Markov processes are Markovian processes in which the firing time of the transitions is modelled by probabilistic distributions over positive reals interpreted as the probability of firing a transition at a certain moment in time. In…
We develop a model for credit rating migration that accounts for the impact of economic state fluctuations on default probabilities. The joint process for the economic state and the rating is modelled as a time-homogeneous Markov chain.…
For a given Markov process $X$ and survival function $\overline{H}$ on $\mathbb{R}^+$, the inverse first-passage time problem (IFPT) is to find a barrier function $b:\mathbb{R}^+\to[-\infty,+\infty]$ such that the survival function of the…
We derive the equations governing the protocols minimizing the heat released by a continuous-time Markov jump process on a one-dimensional countable state space during a transition between assigned initial and final probability…
Motivated by discrete kinetic models for non-cooperative molecular motors on periodic tracks, we consider random walks (also not Markov) on quasi one dimensional (1d) lattices, obtained by gluing several copies of a fundamental graph in a…
We give an interpretation of the bilateral exit problem for L\'{e}vy processes via the study of an elementary Markov chain. We exhibit a strong connection between this problem and Krein's theory on strings. For instance, for symmetric…
We characterise the convergence of a certain class of discrete time Markov processes toward locally Feller processes in terms of convergence of associated operators. The theory of locally Feller processes is applied to L\'evy-type processes…
The recurrence features of persistent random walks built from variable length Markov chains are investigated. We observe that these stochastic processes can be seen as L{\'e}vy walks for which the persistence times depend on some internal…
Given a spectrally negative L\'evy process $X$ drifting to infinity, (inspired on the early ideas of Shiryaev (2002)) we are interested in finding a stopping time that minimises the $L^p$ distance ($p>1$) with $g$, the last time $X$ is…
A fluctuation theory and, in particular, a theory of scale functions is developed for upwards skip-free L\'evy chains, i.e. for right-continuous random walks embedded into continuous time as compound Poisson processes. This is done by…
This paper is concerned with the small time behaviour of a L\'{e}vy process $X$. In particular, we investigate the {\it stabilities} of the times, $\Tstarb(r)$ and $\Tbarb(r)$, at which $X$, started with $X_0=0$, first leaves the space-time…
In this paper, we consider convergence properties of a second order Markov chain. Similar to a column stochastic matrix is associated to a Markov chain, a so called {\em transition probability tensor} $P$ of order 3 and dimension $n$ is…