Related papers: Occupation Times for Jump Processes

We show two-sided bounds of heat kernel for anisotropic non-singular symmetric pure jump Markov process whose jump kernel $J(x,y)$ is comparable to $\frac{{\bf 1}_{\mathcal{V}}(x-y)}{|x-y|^{d+\alpha}}$, where $\mathcal{V}$ is a union of…

Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…

Within the framework of probably approximately correct Markov decision processes (PAC-MDP), much theoretical work has focused on methods to attain near optimality after a relatively long period of learning and exploration. However,…

Piecewise-deterministic Markov processes (PDMPs) offer a powerful stochastic modeling framework that combines deterministic trajectories with random perturbations at random times. Estimating their local characteristics (particularly the…

A short proof is given of a necessary and sufficient condition for the normalized occupation measure of a L\'evy process in a metrizable compact group to be asymptotically uniform with probability one.

We consider an absorbing Markov decision process with Borel state and action spaces. We study conditions under which the MDP is uniformly absorbing and the set of occupation measures of the MDP is compact in the usual weak topology. These…

The estimation of absorption time distributions of Markov jump processes is an important task in various branches of statistics and applied probability. While the time-homogeneous case is classic, the time-inhomogeneous case has recently…

In the presence of quantum measurements with direct photon detection the evolution of open quantum systems is usually described by stochastic master equations with jumps. Heuristically, from these equations one can obtain diffusion models…

We consider a piecewise-deterministic Markov process governed by a jump intensity function, a rate function that determines the behaviour between jumps, and a stochastic kernel describing the conditional distribution of jump sizes. We study…

We consider Markov processes in continuous time with state space $\posint^N$ and provide two sufficient conditions and one necessary condition for the existence of moments $E(\|X(t)\|^r)$ of all orders $r \in \nat$ for all $t \geq 0$. The…

For any two-sided jumping $\alpha$-stable process, where $1 < \alpha < 2$, we find an explicit identity for the law of the first hitting time of the origin. This complements existing work in the symmetric case and the spectrally one-sided…

Bayesian analysis for Markov jump processes is a non-trivial and challenging problem. Although exact inference is theoretically possible, it is computationally demanding thus its applicability is limited to a small class of problems. In…

We consider a reflected process in the positive orthant driven by an exogenous jump process. For a given input process, we show that there exists a unique minimal strong solution to the given particle system up until a certain maximal…

This paper demonstrates that the space of piecewise smooth functions can be well approximated by the space of functions defined by a set of simple (non-linear) operations on smooth uniform splines. The examples include bivariate functions…

The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial…

We study heat kernel estimates for symmetric pure jump processes on general metric measure spaces. Building on recent progress in the local setting due to S.~Eriksson-Bique, we develop a non-local version of the Whitney blending technique…

We address a class of Markov jump linear systems that are characterized by the underlying Markov process being time-inhomogeneous with a priori unknown transition probabilities. Necessary and sufficient conditions for uniform stochastic…

We prove that the class of discrete time stationary max-stable process satisfying the Markov property is equal, up to time reversal, to the class of stationary max-autoregressive processes of order $1$. A similar statement is also proved…

In this paper, we establish sharp two-sided heat kernel estimates for a large class of symmetric Markov processes in exterior $C^{1,\eta}$ open sets for all $t> 0$. The processes are symmetric pure jump Markov processes with jumping kernel…

For an Ornstein-Uhlenbeck process driven by a double exponential jump diffusion process, we obtain formulas for the joint Laplace transform of it and its occupation times. The approach used is remarkable and can be extended to investigate…