English
Related papers

Related papers: Stein's method and duality of Markov processes

200 papers

The framework of Stein's method for Poisson process approximation is presented from the point of view of Palm theory, which is used to construct Stein identities and define local dependence. A general result (Theorem…

Probability · Mathematics 2016-09-07 Louis H. Y. Chen , Aihua Xia

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact…

Probability · Mathematics 2017-11-15 Michel Benaim , Bertrand Cloez , Fabien Panloup

We obtain rates of convergence in limit theorems of partial sums $S_n$ for certain sequences of dependent, identically distributed random variables, which arise naturally in statistical mechanics, in particular, in the context of the…

Probability · Mathematics 2009-08-14 Peter Eichelsbacher , Matthias Löwe

Gradient flow in the 2-Wasserstein space is widely used to optimize functionals over probability distributions and is typically implemented using an interacting particle system with $n$ particles. Analyzing these algorithms requires showing…

Machine Learning · Computer Science 2026-03-27 Chandan Tankala , Dheeraj M. Nagaraj , Anant Raj

This survey article gives an elementary introduction to the algebraic approach to Markov process duality, as opposed to the pathwise approach. In the algebraic approach, a Markov generator is written as the sum of products of simpler…

Probability · Mathematics 2018-02-21 Anja Sturm , Jan M. Swart , Florian Völlering

($k_1,k_2$)-runs have received a special attention in the literature and its distribution can be obtained using combinatorial method (Huang and Tsai) and Markov chain approach (Dafnis et al). But the formulae are difficult to use when the…

Probability · Mathematics 2020-07-16 A. N. Kumar , N. S. Upadhye

We prove that the solution of certain linear stochastic differential equations in Hilbert spaces, namely those with bounded operators as well as the conservative stochastic Schr\"odinger equations, can be obtained - along the lines of the…

Probability · Mathematics 2010-08-17 Günter Hinrichs

The main goal of this paper is to define and study new methods for the computation of effective coefficients in the homogenization of divergence-form operators with random coefficients. The methods introduced here are proved to have optimal…

Numerical Analysis · Mathematics 2017-11-01 Jean-Christophe Mourrat

Aim of this note is to analyse branching Brownian motion within the class of models introduced in the recent paper [4] and called chemical diffusion master equations. These models provide a description for the probabilistic evolution of…

Probability · Mathematics 2024-01-23 Alberto Lanconelli , Berk Tan Perçin

Via a Bismut-Elworthy-Li formula from [KPP23], we derive uniform gradient estimates for transition semigroups associated with stochastic differential equations driven by a large class of cylindrical L\'{e}vy processes which includes the…

Probability · Mathematics 2025-09-09 Thanh Dang , Lingjiong Zhu

The application of Stein's method for distributional approximation often involves so called Stein factors (also called 'magic factors') in the bound of the solutions to Stein equations. However, in some cases these factors contain…

Probability · Mathematics 2013-06-13 Adrian Röllin

Random events in space and time often exhibit a locally dependent structure. When the events are very rare and dependent structure is not too complicated, various studies in the literature have shown that Poisson and compound Poisson…

Probability · Mathematics 2011-02-22 Aihua Xia , Fuxi Zhang

Introduced by Bean and O'Reilly (2014), a stochastic fluid-fluid process is a Markov processes $\{X_t, Y_t, \varphi_t\}_{t \geq 0}$, where the first fluid $X_t$ is driven by the Markov chain $\varphi_t$, and the second fluid $Y_t$ is driven…

Probability · Mathematics 2019-01-31 Nigel Bean , Giang T. Nguyen , Malgorzata M. O'Reilly , Vikram Sunkara

Discrete-time discrete-state finite Markov chains are versatile mathematical models for a wide range of real-life stochastic processes. One of most common tasks in studies of Markov chains is computation of the stationary distribution.…

Numerical Analysis · Mathematics 2022-09-07 Konstantin Avrachenkov , Patrick Brown , Nelly Litvak

Estimation of a dynamical system's latent state subject to sensor noise and model inaccuracies remains a critical yet difficult problem in robotics. While Kalman filters provide the optimal solution in the least squared sense for linear and…

Robotics · Computer Science 2022-02-10 Fahira Afzal Maken , Fabio Ramos , Lionel Ott

We study three classes of continuous time Markov processes (inclusion process, exclusion process, independent walkers) and a family of interacting diffusions (Brownian energy process). For each model we define a boundary driven process…

Mathematical Physics · Physics 2015-06-12 Gioia Carinci , Cristian Giardina' , Claudio Giberti , Frank Redig

The method of potential solutions of Fokker-Planck equations is used to develop a transport equation for the joint probability of N coupled stochastic variables with the Dirichlet distribution as its asymptotic solution. To ensure a bounded…

Mathematical Physics · Physics 2013-03-05 J. Bakosi , J. R. Ristorcelli

In the context of nonparametric Bayesian estimation a Markov chain Monte Carlo algorithm is devised and implemented to sample from the posterior distribution of the drift function of a continuously or discretely observed one-dimensional…

Computation · Statistics 2017-06-08 Frank van der Meulen , Moritz Schauer , Harry van Zanten

Rare event simulation and rare event probability estimation are important tasks within the analysis of systems subject to uncertainty and randomness. Simultaneously, accurately estimating rare event probabilities is an inherently difficult…

Methodology · Statistics 2024-07-18 Max Ehre , Iason Papaioannou , Daniel Straub