English
Related papers

Related papers: Probabilistic Inference and Learning with Stein's …

200 papers

Particle-based approximate Bayesian inference approaches such as Stein Variational Gradient Descent (SVGD) combine the flexibility and convergence guarantees of sampling methods with the computational benefits of variational inference. In…

Machine Learning · Computer Science 2021-07-30 Lauro Langosco di Langosco , Vincent Fortuin , Heiko Strathmann

Stein importance sampling is a widely applicable technique based on kernelized Stein discrepancy, which corrects the output of approximate sampling algorithms by reweighting the empirical distribution of the samples. A general analysis of…

Statistics Theory · Mathematics 2021-09-14 Liam Hodgkinson , Robert Salomone , Fred Roosta

Particle based optimization algorithms have recently been developed as sampling methods that iteratively update a set of particles to approximate a target distribution. In particular Stein variational gradient descent has gained attention…

Machine Learning · Computer Science 2021-03-19 Francesco D'Angelo , Vincent Fortuin

Stein's method provides a way of bounding the distance of a probability distribution to a target distribution $\mu$. Here we develop Stein's method for the class of discrete Gibbs measures with a density $e^V$, where $V$ is the energy…

Probability · Mathematics 2008-08-22 Peter Eichelsbacher , Gesine Reinert

Motivated by the omnipresence of extreme value distributions in limit theorems involving extremes of random processes, we adapt Stein's method to include these laws as possible target distributions. We do so by using the generator approach…

Probability · Mathematics 2025-07-02 Bruno Costacèque , Laurent Decreusefond

Providing theoretical guarantees for parameter estimation in exponential random graph models is a largely open problem. While maximum likelihood estimation has theoretical guarantees in principle, verifying the assumptions for these…

Statistics Theory · Mathematics 2026-03-26 Adrian Fischer , Gesine Reinert , Wenkai Xu

As an application of Stein's method for Poisson approximation, we prove rates of convergence for the tail probabilities of two scan statistics that have been suggested for detecting local signals in sequences of independent random variables…

Probability · Mathematics 2015-05-29 Xiao Fang , David Siegmund

Stein variational gradient descent (SVGD) is a prominent particle-based variational inference method used for sampling a target distribution. SVGD has attracted interest for application in machine-learning techniques such as Bayesian…

Machine Learning · Computer Science 2024-02-26 Yuya Kawamura , Satoshi Takabe

Stein's method is applied to obtain a general Cramer-type moderate deviation result for dependent random variables whose dependence is defined in terms of a Stein identity. A corollary for zero-bias coupling is deduced. The result is also…

Probability · Mathematics 2013-02-06 Louis H. Y. Chen , Xiao Fang , Qi-Man Shao

Over the last 80 years there has been much interest in the problem of finding an explicit formula for the probability density function of two zero mean correlated normal random variables. Motivated by this historical interest, we use a…

Statistics Theory · Mathematics 2021-04-13 Robert E. Gaunt

Inspired by the seminal work on Stein Variational Inference and Stein Variational Policy Gradient, we derived a method to generate samples from the posterior variational parameter distribution by \textit{explicitly} minimizing the KL…

Machine Learning · Computer Science 2018-03-28 Tianbing Xu

A Stein operator for the runs is derived as a perturbation of an operator for discrete Gibbs measure. Due to this fact, using perturbation technique, the approximation results for runs arising from identical and non-identical Bernoulli…

Probability · Mathematics 2020-07-16 Amit N Kumar , Neelesh S Upadhye

We provide a general result for finding Stein operators for the product of two independent random variables whose Stein operators satisfy a certain assumption, extending a recent result of Gaunt, Mijoule and Swan \cite{gms18}. This…

Probability · Mathematics 2020-09-28 Robert E. Gaunt , Guillaume Mijoule , Yvik Swan

When maximum likelihood estimation is infeasible, one often turns to score matching, contrastive divergence, or minimum probability flow to obtain tractable parameter estimates. We provide a unifying perspective of these techniques as…

Statistics Theory · Mathematics 2022-10-07 Alessandro Barp , Francois-Xavier Briol , Andrew B. Duncan , Mark Girolami , Lester Mackey

This exposition explains the basic ideas of Stein's method for Poisson random variable approximation and Poisson process approximation from the point of view of the immigration-death process and Palm theory. The latter approach also enables…

Probability · Mathematics 2007-05-23 Louis H. Y. Chen , Aihua Xia

This work explores and develops elements of Stein's method of approximation, in the infinitely divisible setting, and its connections to functional analysis. It is mainly concerned with multivariate self-decomposable laws without finite…

Probability · Mathematics 2019-11-12 Benjamin Arras , Christian Houdré

We extend Stein's method to include dependence with respect to an auxiliary random variable, for conditional laws for which Stein's characterizations do exist.

Probability · Mathematics 2026-05-26 Aleksandar Balašev-Samarski , Abdol-Reza Mansouri

Let $h$ be a three times partially differentiable function on $R^n$, let $X=(X_1,\dots,X_n)$ be a collection of real-valued random variables and let $Z=(Z_1,\dots,Z_n)$ be a multivariate Gaussian vector. In this article, we develop Stein's…

Probability · Mathematics 2015-05-27 Adrian Röllin

We present a novel second-order trajectory optimization algorithm based on Stein Variational Newton's Method and Maximum Entropy Differential Dynamic Programming. The proposed algorithm, called Stein Variational Differential Dynamic…

Optimization and Control · Mathematics 2024-10-10 Yuichiro Aoyama , Peter Lehmamnn , Evangelos A. Theodorou

We provide the first finite-particle convergence rate for Stein variational gradient descent (SVGD), a popular algorithm for approximating a probability distribution with a collection of particles. Specifically, whenever the target…

Machine Learning · Computer Science 2023-11-03 Jiaxin Shi , Lester Mackey