English
Related papers

Related papers: Approximating a Diffusion by a Hidden Markov Model

200 papers

A continuous-time Markov process $X$ can be conditioned to be in a given state at a fixed time $T > 0$ using Doob's $h$-transform. This transform requires the typically intractable transition density of $X$. The effect of the $h$-transform…

Probability · Mathematics 2024-09-16 Marc Corstanje , Frank van der Meulen , Moritz Schauer

We continue the investigation of the spectral theory and exponential asymptotics of Markov processes, following Kontoyiannis and Meyn (2003). We introduce a new family of nonlinear Lyapunov drift criteria, characterizing distinct subclasses…

Probability · Mathematics 2007-05-23 Ioannis Kontoyiannis , S. P. Meyn

We consider the task of filtering a dynamic parameter evolving as a diffusion process, given data collected at discrete times from a likelihood which is conjugate to the marginal law of the diffusion, when a generic dual process on a…

Probability · Mathematics 2023-11-29 Guillaume Kon Kam King , Andrea Pandolfi , Marco Piretto , Matteo Ruggiero

A quantum Markov semigroup can be represented via classical diffusion processes solving a stochastic Schr\"odinger equation. In this paper we first prove that a quantum Markov semigroup is irreducible if and only if classical diffusion…

Probability · Mathematics 2016-03-18 Franco Fagnola , Carlos Mora

We present a Markov approximation for jump-diffusions whose jump part consists in a Hawkes process with intensity driven by a general (possibly non-monotone) kernel. Under minimal integrability conditions, the kernel can be approximated by…

Probability · Mathematics 2025-07-16 Mahmoud Khabou , Mehdi Talbi

The main result of this paper is that determinantal point processes on the real line corresponding to projection operators with integrable kernels are quasi-invariant, in the continuous case, under the group of diffeomorphisms with compact…

Probability · Mathematics 2016-12-01 Alexander I. Bufetov

In the presence of quantum measurements with direct photon detection the evolution of open quantum systems is usually described by stochastic master equations with jumps. Heuristically, from these equations one can obtain diffusion models…

Mathematical Physics · Physics 2015-05-13 Clement Pellegrini , Francesco Petruccione

In this short paper, we consider discrete-time Markov chains on lattices as approximations to continuous-time diffusion processes. The approximations can be interpreted as finite difference schemes for the generator of the process. We…

Probability · Mathematics 2016-11-08 Christoph Reisinger

The paper presents a generalization of the local limit theorem on the convergence of inhomogeneous Markov chains to the diffusion limit for the case where the corresponding process coefficients satisfy weak regularity conditions and…

Probability · Mathematics 2025-06-02 I. Bitter , V. Konakov

This paper introduces Discrete Markov Probabilistic Models (DMPMs), a novel discrete diffusion algorithm for discrete data generation. The algorithm operates in discrete bit space, where the noising process is a continuous-time Markov chain…

Machine Learning · Statistics 2025-10-09 Le-Tuyet-Nhi Pham , Dario Shariatian , Antonio Ocello , Giovanni Conforti , Alain Durmus

Studying the subexponential convergence towards equilibrium of a strong Markov process, we exhibit an intermediate Lyapunov condition equivalent to the control of some moment of a hitting time. This provides a link, similar (although more…

Probability · Mathematics 2021-08-03 Armand Bernou

We provide a condition for f-ergodicity of strong Markov processes at a subgeometric rate. This condition is couched in terms of a supermartingale property for a functional of the Markov process. Equivalent formulations in terms of a drift…

Statistics Theory · Mathematics 2007-06-13 Randal Douc , Gersende Fort , Arnaud Guillin

When is it possible to interpret a given Markov process as a L\'evy-like process? Since the class of L\'evy processes can be defined by the relation between transition probabilities and convolutions, the answer to this question lies in the…

Probability · Mathematics 2020-09-08 Rúben Sousa , Manuel Guerra , Semyon Yakubovich

We present limit theorems for a sequence of Piecewise Deterministic Markov Processes (PDMPs) taking values in a separable Hilbert space. This class of processes provides a rigorous framework for stochastic spatial models in which discrete…

Probability · Mathematics 2012-04-13 Martin G. Riedler , Michèle Thieullen , Gilles Wainrib

We review some recent results of quantitative long-time convergence for the law of a killed Markov process conditioned to survival toward a quasi-stationary distribution, and on the analogous question for the particle systems used in…

Probability · Mathematics 2023-05-26 Bertrand Cloez , Lucas Journel , Pierre Monmarché , Boris Nectoux , Mouad Ramil

We propose a new classification scheme for diffusion processes for which the backward Kolmogorov equation is solvable in analytically closed form by reduction to hypergeometric equations of the Gaussian or confluent type. The construction…

Probability · Mathematics 2009-09-29 Claudio Albanese , Alexey Kuznetsov

We exhibit conditions under which the flow of marginal distributions of a discontinuous semimartingale $\xi$ can be matched by a Markov process, whose infinitesimal generator is expressed in terms of the local characteristics of $\xi$. Our…

Probability · Mathematics 2012-05-17 Amel Bentata , Rama Cont

We develop a Markov process viewpoint for discrete circular distributions motivated by directional-statistics settings where angles are observed on a finite grid and evolve over time. On the $m$-point discrete circle, the cycle graph, we…

Statistics Theory · Mathematics 2026-03-04 Sourav Majumdar

This paper demonstrates a lower and upper solution method to investigate the asymptotic behaviour of the conservative reaction-diffusion systems associated with Markovian process algebra models. In particular, we have proved the uniform…

Performance · Computer Science 2022-11-18 Jie Ding , Ruiming Ma , Zhigui Lin , Zhi Ling

We consider $\mathbb{R}^d$-valued diffusion processes of type \begin{align*} dX_t\ =\ b(X_t)dt\, +\, dB_t. \end{align*} Assuming a geometric drift condition, we establish contractions of the transitions kernels in Kantorovich ($L^1$…

Probability · Mathematics 2017-10-10 Andreas Eberle , Arnaud Guillin , Raphael Zimmer