Related papers: On the Poisson equation for nonreversible Markov j…
We investigate the Poisson regression method for Markov and semi-Markov jump processes from a nonparametric angle, allowing the lengths of the time and duration intervals in the partition to vary with the number of observations. Imposing no…
In this paper, we employ Markov process theory to prove asymptotic results for a class of stochastic processes which arise as solutions of a stochastic evolution inclusion and are given by the representation formula \begin{align*}…
The aim of this paper is to establish the existence and uniqueness of the solution to a system of nonlinear fully coupled forward-backward doubly stochastic differential equations with Poisson jumps. Our system is Markovian in the sense…
We show the variational convergence of an irreversible Markov jump process describing a finite stochastic particle system to the solution of a countable infinite system of deterministic time-inhomogeneous quadratic differential equations…
This paper considers the Poisson equation for general state-space Markov chains in continuous time. The main purpose of this paper is to present specific bounds for the solutions of the Poisson equation for general state-space Markov…
In this paper, we study the averaging principle and central limit theorem for multi-scale stochastic differential equations with state-dependent switching. To accomplish this, we first study the Poisson equation associated with a Markov…
Poisson's equation plays a fundamental role as a tool for performance evaluation and optimization of Markov chains. For continuous-time birth-death chains with possibly unbounded transition and cost rates as addressed herein, when…
In this study, we address the central issue of statistical inference for Markov jump processes using discrete time observations. The primary problem at hand is to accurately estimate the infinitesimal generator of a Markov jump process, a…
Inspired by a duration-dependent life insurance model, we consider continuous-time semi-Markov jump processes, initially assumed to have a finite state-space. We develop approximations using jump processes that are time-homogeneous Markov,…
We consider the almost semi-continuous processes defined on a finite Markov chain. The representation of the moment generating functions for the absolute maximum after achievement positive level and for the recovery time are obtained.…
Generalizing response theory of open systems far from equilibrium is a central quest of nonequilibrium statistical physics. Using stochastic thermodynamics, we develop an algebraic method to study the response of nonequilibrium steady state…
The solution to Poisson's equation arise in many Markov chain and Markov jump process settings, including that of the central limit theorem, value functions for average reward Markov decision processes, and within the gradient formula for…
A jumping process, defined in terms of jump size distribution and waiting time distribution, is presented. The jumping rate depends on the process value. The process, which is Markovian and stationary, relaxes to an equilibrium and is…
Several two-boundary problems are solved for a special L\'{e}vy process: the Poisson process with an exponential component. The jumps of this process are controlled by a homogeneous Poisson process, the positive jump size distribution is…
The purpose of this paper is to extend the investigation of Poisson-type deviation inequalities started by Joulin (Bernoulli 13 (2007) 782--798) to the empirical mean of positively curved Markov jump processes. In particular, our main…
Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…
We are concerned with the asymptotics of the Markov chain given by the post-jump locations of a certain piecewise-deterministic Markov process with a state-dependent jump intensity. We provide sufficient conditions for such a model to…
We consider a stochastic functional delay differential equation, namely an equation whose evolution depends on its past history as well as on its present state, driven by a pure diffusive component plus a pure jump Poisson compensated…
In this paper we study the existence of Green measures for Markov processes with a nonlocal jump generator. The jump generator has no second moment and satisfies a suitable condition on its Fourier transform. We also study the same problem…
The solution of Poisson's equation plays a key role in constructing the martingale through which sums of Markov correlated random variables can be analyzed. In this paper, we study two different representations for the solution in countable…