English
Related papers

Related papers: Measuring Sample Quality with Diffusions

200 papers

This monograph provides a rigorous overview of theoretical and methodological aspects of probabilistic inference and learning with Stein's method. Recipes are provided for constructing Stein discrepancies from Stein operators and Stein…

Machine Learning · Statistics 2026-03-10 Qiang Liu , Lester Mackey , Chris Oates

In this article we consider static Bayesian parameter estimation for partially observed diffusions that are discretely observed. We work under the assumption that one must resort to discretizing the underlying diffusion process, for…

Computation · Statistics 2017-01-23 Ajay Jasra , Kengo Kamatani , Kody J. H. Law , Yan Zhou

Score-based methods have recently seen increasing popularity in modeling and generation. Methods have been constructed to perform hypothesis testing and change-point detection with score functions, but these methods are in general not as…

Machine Learning · Statistics 2025-06-23 Sean Moushegian , Taposh Banerjee , Vahid Tarokh

We develop connections between Stein's approximation method, logarithmic Sobolev and transport inequalities by introducing a new class of functional inequalities involving the relative entropy, the Stein kernel, the relative Fisher…

Probability · Mathematics 2014-07-24 Michel Ledoux , Ivan Nourdin , Giovanni Peccati

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

Machine Learning · Statistics 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

In this paper, a new method based on probability generating functions is used to obtain multiple Stein operators for various random variables closely related to Poisson, binomial and negative binomial distributions. Also, Stein operators…

Probability · Mathematics 2016-05-10 N. S. Upadhye , V. Cekanavicius , P. Vellaisamy

Let F ($\nu$) be the centered Gamma law with parameter $\nu$ > 0 and let us denote by P Y the probability distribution of a random vector Y. We develop a multidimensional variant of the Stein's method for Gamma approximation that allows to…

Probability · Mathematics 2023-05-10 Ciprian A Tudor , Jérémy Zurcher

Markov chain Monte Carlo (MCMC) methods generate samples that are asymptotically distributed from a target distribution of interest as the number of iterations goes to infinity. Various theoretical results provide upper bounds on the…

Computation · Statistics 2019-10-30 Niloy Biswas , Pierre E. Jacob , Paul Vanetti

Computable Stein discrepancies have been deployed for a variety of applications, ranging from sampler selection in posterior inference to approximate Bayesian inference to goodness-of-fit testing. Existing convergence-determining Stein…

Machine Learning · Statistics 2021-10-12 Jonathan H. Huggins , Lester Mackey

We consider $M/Ph/n+M$ queueing systems in steady state. We prove that the Wasserstein distance between the stationary distribution of the normalized system size process and that of a piecewise Ornstein-Uhlenbeck (OU) process is bounded by…

Probability · Mathematics 2015-12-01 Anton Braverman , J. G. Dai

We provide a new perspective on Stein's so-called density approach by introducing a new operator and characterizing class which are valid for a much wider family of probability distributions on the real line. We prove an elementary…

Probability · Mathematics 2013-04-05 Christophe Ley , Yvik Swan

Two popular classes of methods for approximate inference are Markov chain Monte Carlo (MCMC) and variational inference. MCMC tends to be accurate if run for a long enough time, while variational inference tends to give better approximations…

Machine Learning · Computer Science 2017-06-21 Justin Domke

This paper is concerned with the Stein's method associated with a (possibly) asymmetric $\alpha$-stable distribution $Z$, in dimension one. More precisely, its goal is twofold. In the first part, we exhibit a genuine bound for the…

Probability · Mathematics 2018-09-12 Peng Chen , Ivan Nourdin , Lihu Xu

In this paper, we focus on non-asymptotic bounds related to the Euler scheme of an ergodic diffusion with a possibly multiplicative diffusion term (non-constant diffusion coefficient). More precisely, the objective of this paper is to…

Probability · Mathematics 2022-09-23 Gilles Pages , Fabien Panloup

This work develops effective distributed strategies for the solution of constrained multi-agent stochastic optimization problems with coupled parameters across the agents. In this formulation, each agent is influenced by only a subset of…

Optimization and Control · Mathematics 2019-03-15 Sulaiman A. Alghunaim , Ali H. Sayed

A new (unadjusted) Langevin Monte Carlo (LMC) algorithm with improved rates in total variation and in Wasserstein distance is presented. All these are obtained in the context of sampling from a target distribution $\pi$ that has a density…

Statistics Theory · Mathematics 2019-10-18 Sotirios Sabanis , Ying Zhang

Importance sampling is a widely used technique to reduce the variance of a Monte Carlo estimator by an appropriate change of measure. In this work, we study importance sam- pling in the framework of diffusion process and consider the change…

Probability · Mathematics 2018-03-28 Carsten Hartmann , Christof Schütte , Marcus Weber , Wei Zhang

Continuous Time Markov Chains, Hawkes processes and many other interesting processes can be described as solution of stochastic differential equations driven by Poisson measures. Previous works, using the Stein's method, give the…

Probability · Mathematics 2026-04-02 Eustache Besançon , Laure Coutin , Laurent Decreusefond , Pascal Moyal

Mean-field variational inference (MFVI) is a widely used method for approximating high-dimensional probability distributions by product measures. This paper studies the stability properties of the mean-field approximation when the target…

Probability · Mathematics 2025-06-10 Shunan Sheng , Bohan Wu , Alberto González-Sanz , Marcel Nutz

Poincar{\'e} inequalities are ubiquitous in probability and analysis and have various applications in statistics (concentration of measure, rate of convergence of Markov chains). The Poincar{\'e} constant, for which the inequality is tight,…

Probability · Mathematics 2019-11-25 Loucas Pillaud-Vivien , Francis Bach , Tony Lelièvre , Alessandro Rudi , Gabriel Stoltz