Related papers: On Occupation Time for On-Off Processes with Multi…
A semi-Markov process is one that changes states in accordance with a Markov chain but takes a random amount of time between changes. We consider the generalisation to semi-Markov processes of the classical Lamperti law for the occupation…
This study of occupation time densities for continuous-time Markov processes was inspired by the work of E.Nir et al (2006) in the field of Single Molecule FRET spectroscopy. There, a single molecule fluctuates between two or more states,…
Our aim is to unify and extend the large deviation upper and lower bounds for the occupation times of a Markov process with $L_2$ semigroups under minimal conditions on the state space and the process trajectories; for example, no strong…
In a recent paper, Shah [arXiv:2502.03073] derived an explicit expression for the distribution of occupancy times for a two-state Markov chain, using a method based on enumerating sample paths. We consider here the more general problem of…
For an arbitrary L\'evy process $X$ which is not a compound Poisson process, we are interested in its occupation times. We use a quite novel and useful approach to derive formulas for the Laplace transform of the joint distribution of $X$…
We present a systematic study of the statistics of the occupation time and related random variables for stochastic processes with independent intervals of time. According to the nature of the distribution of time intervals, the probability…
For a skip-free Markov process on non-negative integers with generator matrix Q, we evaluate the joint Laplace transform of the occupation times before hitting the state n (starting at 0). This Laplace transform has a very straightforward…
This paper presents a set of results relating to the occupation time $\alpha(t)$ of a process $X(\cdot)$. The first set of results concerns exact characterizations of $\alpha(t)$ for $t\geq0$, e.g., in terms of its transform up to an…
A Markov process fluctuating away from its typical behavior can be represented in the long-time limit by another Markov process, called the effective or driven process, having the same stationary states as the original process conditioned…
Renewal process is a point process where an inter-event time between successive renewals is an independent and identically distributed random variable. Alternating renewal process is a dichotomous process and a slight generalization of the…
Markov processes restarted or reset at random times to a fixed state or region in space have been actively studied recently in connection with random searches, foraging, and population dynamics. Here we study the large deviations of…
In this paper, we obtain analytical expression for the distribution of the occupation time in the red (below level $0$) up to an (independent) exponential horizon for spectrally negative L\'{e}vy risk processes and refracted spectrally…
We develop an Onsager-Machlup-type theory for nonequilibrium semi-Markov processes. Our main result is an exact large time asymptotics for the joint probability of the occupation times and the currents in the system, establishing some…
During their lifetimes, individuals in populations pass through different states, and the notion of an occupancy time describes the amount of time an individual spends in a given set of states. Questions related to this idea were studied in…
We consider exchangeable Markov multi-state survival processes -- temporal processes taking values over a state-space$\mathcal{S}$ with at least one absorbing failure state $\flat \in \mathcal{S}$ that satisfy natural invariance properties…
Markov-modulated L\'evy processes with two different regimes of restarting are studied. These regimes correspond to the completely renewed process and to the process of Markov modulation, accompanied by jumps. We give explicit expressions…
For an Ornstein-Uhlenbeck process driven by a double exponential jump diffusion process, we obtain formulas for the joint Laplace transform of it and its occupation times. The approach used is remarkable and can be extended to investigate…
While the classic off-policy evaluation (OPE) literature commonly assumes decision time points to be evenly spaced for simplicity, in many real-world scenarios, such as those involving user-initiated visits, decisions are made at…
Markov automata combine non-determinism, probabilistic branching, and exponentially distributed delays. This compositional variant of continuous-time Markov decision processes is used in reliability engineering, performance evaluation and…
We investigate a refracted Levy process driven by a jump diffusion process, whose jumps have rational Laplace transforms. For such a stochastic process, formulas for the Laplace transform of its occupation times are deduced. To derive the…