English
Related papers

Related papers: An algebra of Stein operators

200 papers

Stein's method compares probability distributions through the study of a class of linear operators called Stein operators. While mainly studied in probability and used to underpin theoretical statistics, Stein's method has led to…

Over the last 80 years there has been much interest in the problem of finding an explicit formula for the probability density function of two zero mean correlated normal random variables. Motivated by this historical interest, we use a…

Statistics Theory · Mathematics 2021-04-13 Robert E. Gaunt

We propose a new version of Stein's method of exchangeable pairs, which, given a suitable exchangeable pair $(W,W')$ of real-valued random variables, suggests the approximation of the law of $W$ by a suitable absolutely continuous…

Probability · Mathematics 2015-10-21 Christian Döbler

We outline a general procedure on how to apply random positive linear operators in nonparametric estimation. As a consequence, we give explicit confidence bands and intervals for a distribution function $F$ concentrated on $[0,1]$ by means…

Statistics Theory · Mathematics 2025-08-20 José A. Adell , J. T. Alcalá , C. Sangüesa

We build on the formalism developed in [arXiv:1906.08372v1] to propose new representations of solutions to Stein equations. We provide new uniform and non uniform bounds on these solutions (a.k.a.\ Stein factors). We use these…

Probability · Mathematics 2019-11-14 Marie Ernst , Yvik Swan

We derive Stein approximation bounds for functionals of uniform random variables, using chaos expansions and the Clark-Ocone representation formula combined with derivation and finite difference operators. This approach covers sums and…

Probability · Mathematics 2018-02-28 Nicolas Privault , Grzegorz Serafin

Stein's method (Stein, 1973; 1981) is a powerful tool for statistical applications and has significantly impacted machine learning. Stein's lemma plays an essential role in Stein's method. Previous applications of Stein's lemma either…

Machine Learning · Statistics 2025-02-04 Wu Lin , Mohammad Emtiyaz Khan , Mark Schmidt

Let $Z$ be a standard normal random variable and let $H_n$ denote the $n$-th Hermite polynomial. In this note, we obtain Stein equations for the random variables $H_3(Z)$ and $H_4(Z)$, which represents a first step towards developing…

Probability · Mathematics 2018-09-28 Robert E. Gaunt

Stein's method is used to approximate sums of discrete and locally dependent random variables by a centered and symmetric Binomial distribution. Under appropriate smoothness properties of the summands, the same order of accuracy as in the…

Probability · Mathematics 2007-05-23 Adrian Röllin

This paper is concerned with the Stein's method associated with a (possibly) asymmetric $\alpha$-stable distribution $Z$, in dimension one. More precisely, its goal is twofold. In the first part, we exhibit a genuine bound for the…

Probability · Mathematics 2018-09-12 Peng Chen , Ivan Nourdin , Lihu Xu

Gradient-based approximate inference methods, such as Stein variational gradient descent (SVGD), provide simple and general-purpose inference engines for differentiable continuous distributions. However, existing forms of SVGD cannot be…

Machine Learning · Computer Science 2020-03-03 Jun Han , Fan Ding , Xianglong Liu , Lorenzo Torresani , Jian Peng , Qiang Liu

Motivated by the omnipresence of extreme value distributions in limit theorems involving extremes of random processes, we adapt Stein's method to include these laws as possible target distributions. We do so by using the generator approach…

Probability · Mathematics 2025-07-02 Bruno Costacèque , Laurent Decreusefond

We establish distributional estimates for noncommutative martingales, in the sense of decreasing rearrangements of the spectra of unbounded operators, which generalises the study of distributions of random variables. Our results include…

Functional Analysis · Mathematics 2021-03-17 Yong Jiao , Fedor Sukochev , Lian Wu , Dmitriy Zanin

We propose a general purpose variational inference algorithm that forms a natural counterpart of gradient descent for optimization. Our method iteratively transports a set of particles to match the target distribution, by applying a form of…

Machine Learning · Statistics 2019-09-10 Qiang Liu , Dilin Wang

This monograph provides a rigorous overview of theoretical and methodological aspects of probabilistic inference and learning with Stein's method. Recipes are provided for constructing Stein discrepancies from Stein operators and Stein…

Machine Learning · Statistics 2026-03-10 Qiang Liu , Lester Mackey , Chris Oates

We obtain a Stein characterisation of the distribution of the product of two correlated normal random variables with non-zero means, and more generally the distribution of the sum of independent copies of such random variables. Our Stein…

Probability · Mathematics 2024-09-11 Robert E. Gaunt , Siqi Li , Heather L. Sutcliffe

First-order differential operators arising from the representation-theoretic decomposition of the covariant derivative play a central role in Riemannian geometry. In this paper, we study Stein-Weiss $O(n)$-gradients acting on covariant…

Differential Geometry · Mathematics 2026-01-08 Sergey Stepanov , Irina Tsyganok

We propose two novel samplers to generate high-quality samples from a given (un-normalized) probability density. Motivated by the success of generative adversarial networks, we construct our samplers using deep neural networks that…

Machine Learning · Statistics 2021-02-10 Tianyang Hu , Zixiang Chen , Hanxi Sun , Jincheng Bai , Mao Ye , Guang Cheng

In this paper, we obtain Stein operator for sum of $n$ independent random variables (rvs) which is shown as perturbation of negative binomial (NB) operator. Comparing the operator with NB operator, we derive the error bounds for total…

Probability · Mathematics 2020-07-16 A. N. Kumar , N. S. Upadhye

By the continuous mapping theorem, if a sequence of $d$-dimensional random vectors $(\mathbf{W}_n)_{n\geq1}$ converges in distribution to a multivariate normal random variable $\Sigma^{1/2}\mathbf{Z}$, then the sequence of random variables…

Probability · Mathematics 2020-03-18 Robert E. Gaunt