Related papers: Hunt's Hypothesis (H) for Markov Processes: Survey…

This article is a lecture note on the potential theory of (possibly non-reversible) Markov processes and on the connection of this theory with quantitative analysis of the metastability of stochastic processes.

We give upper and lower estimates of densities of convolution semigroups of probability measures under explicit assumptions on the corresponding Levy measure and the Levy--Khinchin exponent. We obtain also estimates of derivatives of…

We present a general framework for applying learning algorithms and heuristical guidance to the verification of Markov decision processes (MDPs). The primary goal of our techniques is to improve performance by avoiding an exhaustive…

The aim of this note is to construct a probability measure on the space of trajectories in a continuous time Markov chain having a finite state diagram, or more generally which admits a global bound on its degree and rates. Our approach is…

The infinitesimal transition probability operator for a continuous-time discrete-state Markov process, $\mathcal{Q}$, can be decomposed into a symmetric and a skew-symmetric parts. As recently shown for the case of diffusion processes,…

The paper considers the integration theory for $G$-L\'evy processes with finite activity. We introduce the It\^o-L\'evy integrals, give the It\^o formula for them and establish SDE's, BSDE's and decoupled FBSDE's driven by $G$-L\'evy…

This paper specifies a notation for Markov decision processes.

In this paper, we study two types of purely discontinuous symmetric Markov processes $X$ in bounded smooth subsets of $\mathbb R^d$: conservative processes and processes killed either upon approaching the boundary of the set or by a killing…

We characterize the value function and the optimal stopping time for a large class of optimal stopping problems where the underlying process to be stopped is a fairly general Markov process. The main result is inspired by recent findings…

The program of studying general nonlinear Markov processes was put forward in V. N. Kolokoltsov "Nonlinear Markov Semigroups and Interacting L\'evy Type Processes" (Journ. Stat. Physics 126:3 (2007), 585-642), and was developed by the…

This paper is devoted to the problem of sample path large deviations for the Markov processes on R_+^N having a constant but different transition mechanism on each boundary set {x:x_i=0 for i\notin\Lambda, x_i>0 for i\in\Lambda}. The global…

We present an alternative construction of the infinite dimensional It\^{o} integral with respect to a Hilbert space valued L\'{e}vy process. This approach is based on the well-known theory of real-valued stochastic integration, and the…

In this paper we present the classical results of Kolmogorov's backward and forward equations to the case of a two-parameter Markov process. These equations relates the infinitesimal transition matrix of the two-parameter Markov process.…

Lecture notes (in French) of a master 2 level course in applied mathematics. Contents: Part I. Markov chains on a countable space. 1. Examples 2. Summary of basic properties. 3. Spectral theory and speed of convergence. 4. Lyapunov…

Although introduced in the case of Poisson random measures, the lent particle method applies as well in other situations. We study here the case of marked point processes. In this case the Malliavin calculus (here in the sense of Dirichlet…

We provide probabilistic and computational results on Markovian multivariate Hawkes processes and induced population processes. By applying the Markov property, we characterize in closed form a joint transform, bijective to the probability…

Given a sample from a discretely observed L\'evy process $X=(X_t)_{t\geq 0}$ of the finite jump activity, the problem of nonparametric estimation of the L\'evy density $\rho$ corresponding to the process $X$ is studied. An estimator of…

Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…

The large deviations at various levels that are explicit for Markov jump processes satisfying detailed-balance are revisited in terms of the supersymmetric quantum Hamiltonian $H$ that can be obtained from the Markov generator via a…

The study of QCD processes at the LHC will serve two main goals. First the predictions of QCD will be tested and precision measurements will be performed. Second QCD processes represent a major part of the background to other Standard Model…