English
Related papers

Related papers: Probabilistic Inference and Learning with Stein's …

200 papers

In this paper we give a historical account of the development of Poisson approximation using Stein's method and present some of the main results. We give two recent applications, one on maximal arithmetic progressions and the other on…

Probability · Mathematics 2013-10-09 Louis H. Y. Chen , Adrian Röllin

This paper reviews advances in Stein-type shrinkage estimation for spherically symmetric distributions. Some emphasis is placed on developing intuition as to why shrinkage should work in location problems whether the underlying population…

Methodology · Statistics 2012-03-22 Ann Cohen Brandwein , William E. Strawderman

Small subgraph counts can be used as summary statistics for large random graphs. We use the Stein-Chen method to derive Poisson approximations for the distribution of the number of subgraphs in the stochastic block model which are…

Probability · Mathematics 2017-03-21 Matthew Coulson , Robert E. Gaunt , Gesine Reinert

In this paper, we address the problem of estimating a covariance matrix of a multivariate Gaussian distribution, relative to a Stein loss function, from a decision theoretic point of view. We investigate the case where the covariance matrix…

Statistics Theory · Mathematics 2021-03-23 Anis M. Haddouche , Wei Lu

Computable Stein discrepancies have been deployed for a variety of applications, ranging from sampler selection in posterior inference to approximate Bayesian inference to goodness-of-fit testing. Existing convergence-determining Stein…

Machine Learning · Statistics 2021-10-12 Jonathan H. Huggins , Lester Mackey

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

In this paper we propose a new, simple and explicit mechanism allowing to derive Stein operators for random variables whose characteristic function satisfies a simple ODE. We apply this to study random variables which can be represented as…

Probability · Mathematics 2023-07-06 Benjamin Arras , Ehsan Azmoodeh , Guillaume Poly , Yvik Swan

In this paper, we revisit the original ideas of Stein and propose an estimator of the intensity parameter of a homogeneous Poisson point process defined in $\R^d$ and observed in a bounded window. The procedure is based on a new general…

Statistics Theory · Mathematics 2015-07-31 Marianne Clausel , Jean-François Coeurjolly , Jérôme Lelong

We consider the analysis of probability distributions through their associated covariance operators from reproducing kernel Hilbert spaces. We show that the von Neumann entropy and relative entropy of these operators are intimately related…

Information Theory · Computer Science 2022-08-29 Francis Bach

We extend Stein's method to include independence with respect to an auxiliary random variable, for any law for which a Stein characterization does exist. This extends the current literature on the problem. Using tools from the Malliavin…

Probability · Mathematics 2026-05-04 Aleksandar Balašev-Samarski , Abdol-Reza Mansouri

Rigorous error estimation is a fundamental topic in numerical analysis. With the increasing use of physics-informed neural networks (PINNs) for solving partial differential equations, several approaches have been developed to quantify the…

Numerical Analysis · Mathematics 2025-08-12 Birgit Hillebrecht , Benjamin Unger

We focus on the problem of efficient sampling and learning of probability densities by incorporating symmetries in probabilistic models. We first introduce Equivariant Stein Variational Gradient Descent algorithm -- an equivariant sampling…

Machine Learning · Computer Science 2021-07-30 Priyank Jaini , Lars Holdijk , Max Welling

Bayesian probabilistic numerical methods for numerical integration offer significant advantages over their non-Bayesian counterparts: they can encode prior information about the integrand, and can quantify uncertainty over estimates of an…

Machine Learning · Statistics 2023-09-12 Katharina Ott , Michael Tiemann , Philipp Hennig , François-Xavier Briol

We consider the problem of efficiently computing the maximum likelihood estimator in Generalized Linear Models (GLMs) when the number of observations is much larger than the number of coefficients ($n \gg p \gg 1$). In this regime,…

Machine Learning · Statistics 2015-12-01 Murat A. Erdogdu

The Reverse Stein Effect is identified and illustrated: A statistician who shrinks his/her data toward a point chosen without reliable knowledge about the underlying value of the parameter to be estimated but based instead upon the observed…

Methodology · Statistics 2012-03-27 Michael D. Perlman , Sanjay Chaudhuri

In this paper use the Stein method to characterize the $M$-Wright distribution $M_{\frac{1}{3}}$ and its symmetrization. The Stein operator is associated with the general Airy equation and the corresponding Stein equation is nothing but a…

Probability · Mathematics 2020-08-11 José Luís da Silva , Mohamed Erraoui

Stein's method has been widely used to achieve distributional approximations for probability distributions defined in Euclidean spaces. Recently, techniques to extend Stein's method to manifold-valued random variables with distributions…

Statistics Theory · Mathematics 2022-09-20 Xiaoda Qu , Baba C. Vemuri

Variational inference is a technique that approximates a target distribution by optimizing within the parameter space of variational families. On the other hand, Wasserstein gradient flows describe optimization within the space of…

Machine Learning · Statistics 2023-11-01 Mingxuan Yi , Song Liu

Methods of high-dimensional probability play a central role in applications for statistics, signal processing theoretical computer science and related fields. These lectures present a sample of particularly useful tools of high-dimensional…

Probability · Mathematics 2017-11-07 Roman Vershynin

We are interested in the statistical linear inverse problem $Y=Af+\epsilon\xi$, where $A$ denotes a compact operator and $\epsilon\xi$ a stochastic noise. In a first time, we investigate the link between some threshold estimators and the…

Statistics Theory · Mathematics 2008-07-15 Clément Marteau