Related papers: First passage process of a Markov additive process…
As well known, all functionals of a Markov process may be expressed in terms of the generator operator, modulo some analytic work. In the case of spectrally negative Markov processes however, it is conjectured that everything can be…
This paper studies the workload distribution of a finite-capacity queue driven by a spectrally one-sided Markov additive process (MAP). Our main result provides the Laplace-Stieltjes transform of the workload at an exponentially distributed…
Consider a one-sided Markov additive process with an upper and a lower barrier, where each can be either reflecting or terminating. For both defective and non-defective processes and all possible scenarios we identify the corresponding…
This paper solves exit problems for spectrally negative Markov additive processes and their reflections. A so-called scale matrix, which is a generalization of the scale function of a spectrally negative \levy process, plays a central role…
We consider a Markov-modulated Brownian motion reflected to stay in a strip [0,B]. The stationary distribution of this process is known to have a simple form under some assumptions. We provide a short probabilistic argument leading to this…
In this paper we solve the exit problems for an one-sided Markov additive process (MAP) which is exponentially killed with a bivariate killing intensity $\omega(\cdot,\cdot)$ dependent on the present level of the process and the present…
This paper explicitly computes the transition densities of a spectrally negative stable process with index greater than one, reflected at its infimum. First we derive the forward equation using the theory of sun-dual semigroups. The…
We prove precise stability results for overshoots of Markov additive processes (MAPs) with finite modulating space. Our approach is based on the Markovian nature of overshoots of MAPs whose mixing and ergodic properties are investigated in…
In this work, we focus on the stationary analysis of a specific class of continuous time Markov-modulated reflected random walks in the quarter plane with applications in the modelling of two-node Markov-modulated queueing networks with…
In this paper we study a reflected Markov-modulated Brownian motion with a two sided reflection in which the drift, diffusion coefficient and the two boundaries are (jointly) modulated by a finite state space irreducible continuous time…
Model reduction of Markov processes is a basic problem in modeling state-transition systems. Motivated by the state aggregation approach rooted in control theory, we study the statistical state compression of a discrete-state Markov chain…
In this paper, we develop a new mathematical technique which allows us to express the joint distribution of a Markov process and its running maximum (or minimum) through the marginal distribution of the process itself. This technique is an…
We investigate one of the simplest multi-species generalizations of the one dimensional exclusion process with reflective boundaries. The Markov matrix governing the dynamics of the system splits into blocks (sectors) specified by the…
We describe an exact approach for calculating transition probabilities and waiting times in finite-state discrete-time Markov processes. All the states and the rules for transitions between them must be known in advance. We can then…
We determine the asymptotic speed of the first-passage percolation process on some ladder-like graphs (or width-2 stretches) when the times associated with different edges are independent and exponentially distributed but not necessarily…
First passage of stochastic processes under resetting has recently been an active research topic in the field of statistical physics. However, most of previous studies mainly focused on the systems with continuous time and space. In this…
Computational procedures for the stationary probability distribution, the group inverse of the Markovian kernel and the mean first passage times of an irreducible Markov chain, are developed using perturbations. The derivation of these…
Recent fluctuation identities for $\alpha$-stable L\'evy processes have decomposed paths using generalised spherical polar coordinates revealing an underlying Markov Additive Process (MAP) for which a more advanced form of excursion theory…
We introduce a perturbative method to calculate all moments of the first-passage time distribution in stochastic one-dimensional processes which are subject to both white and coloured noise. This class of non-Markovian processes is at the…
A reflection map, induced by the deterministic Skorohod problem on the nonnegative orthant, is applied to an $\mathbb{R}^n$ valued function $X$ on $[0,\infty)$ and then to $a+X$, where $a$ is a nonnegative constant vector. A question that…