English
Related papers

Related papers: On Stein's Method for Multivariate Self-Decomposab…

200 papers

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

Methodology · Statistics 2022-02-14 Ryo Okano , Masaaki Imaizumi

We provide a bound on a natural distance between finitely and infinitely supported elements of the unit sphere of $\ell^2(\mathbb{N}^*)$, the space of real valued sequences with finite $\ell^2$ norm. We use this bound to estimate the…

Probability · Mathematics 2019-08-20 Benjamin Arras , Ehsan Azmoodeh , Guillaume Poly , Yvik Swan

Ensembles of deep neural networks have achieved great success recently, but they do not offer a proper Bayesian justification. Moreover, while they allow for averaging of predictions over several hypotheses, they do not provide any…

Machine Learning · Computer Science 2021-06-23 Francesco D'Angelo , Vincent Fortuin , Florian Wenzel

We develop a theory of finite-dimensional polyhedral subsets over the Wasserstein space and optimization of functionals over them via first-order methods. Our main application is to the problem of mean-field variational inference, which…

Statistics Theory · Mathematics 2025-06-02 Yiheng Jiang , Sinho Chewi , Aram-Alexandre Pooladian

Stein Variational Gradient Descent (SVGD) is a popular variational inference algorithm which simulates an interacting particle system to approximately sample from a target distribution, with impressive empirical performance across various…

Machine Learning · Statistics 2023-10-09 Aniket Das , Dheeraj Nagaraj

We propose a goodness-of-fit measure for probability densities modeling observations with varying dimensionality, such as text documents of differing lengths or variable-length sequences. The proposed measure is an instance of the kernel…

Machine Learning · Statistics 2023-07-14 Jerome Baum , Heishiro Kanagawa , Arthur Gretton

The statistical finite element method (StatFEM) is an emerging probabilistic method that allows observations of a physical system to be synthesised with the numerical solution of a PDE intended to describe it in a coherent statistical…

Numerical Analysis · Mathematics 2022-02-21 Yanni Papandreou , Jon Cockayne , Mark Girolami , Andrew B. Duncan

We propose a fast and scalable variational method for Bayesian inference in high-dimensional parameter space, which we call projected Stein variational Newton (pSVN) method. We exploit the intrinsic low-dimensional geometric structure of…

Optimization and Control · Mathematics 2020-02-11 Peng Chen , Keyi Wu , Joshua Chen , Thomas O'Leary-Roseberry , Omar Ghattas

We consider additive functionals of systems of random measures whose initial configuration is given by a Poisson point process, and whose individual components evolve according to arbitrary Markovian or non-Markovian measure valued…

Probability · Mathematics 2025-12-03 Arturo Jaramillo , Antonio Murillo-Salas

A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution…

Probability · Mathematics 2016-08-24 Christian Soize , Roger Ghanem

Let $K$ be a convex body in $\mathbb{R}^d$. Let $X_K$ be a $d$-dimensional random vector distributed according to the Hadwiger-Wills density $\mu_K$ associated with $K$, defined as $\mu_K(x)=ce^{-\pi {\rm dist}^2(x,K)}$, $x\in…

Probability · Mathematics 2023-04-14 Valentin Garino , Ivan Nourdin

Learning a stationary diffusion amounts to estimating the parameters of a stochastic differential equation whose stationary distribution matches a target distribution. We build on the recently introduced kernel deviation from stationarity…

Machine Learning · Statistics 2026-01-30 Fabian Bleile , Sarah Lumpp , Mathias Drton

We study the Stein equation associated with the one-dimensional Gamma distribution, and provide novel bounds, allowing one to effectively deal with test functions supported by the whole real line. We apply our estimates to derive new…

Probability · Mathematics 2017-03-14 Christian Döbler , Giovanni Peccati

Stein variational gradient descent (SVGD) is a recently proposed particle-based Bayesian inference method, which has attracted a lot of interest due to its remarkable approximation ability and particle efficiency compared to traditional…

Machine Learning · Statistics 2018-06-11 Jingwei Zhuo , Chang Liu , Jiaxin Shi , Jun Zhu , Ning Chen , Bo Zhang

To accurately reproduce measurements from the real world, simulators need to have an adequate model of the physical system and require the parameters of the model be identified. We address the latter problem of estimating parameters through…

Robotics · Computer Science 2022-03-01 Eric Heiden , Christopher E. Denniston , David Millard , Fabio Ramos , Gaurav S. Sukhatme

Many spatial models exhibit locality structures that effectively reduce their intrinsic dimensionality, enabling efficient approximation and sampling of high-dimensional distributions. However, existing approximation techniques primarily…

Machine Learning · Statistics 2026-02-02 Tiangang Cui , Shuigen Liu , Xin T. Tong

We adapt Stein's method to isoperimetric and geometric inequalities. The main challenge is the treatment of boundary terms. We address this by using an elliptic PDE with an oblique boundary condition. We apply our geometric formulation of…

Analysis of PDEs · Mathematics 2024-12-02 Jordan Serres

This paper formally derives the asymptotic distribution of a goodness-of-fit test based on the Kernel Stein Discrepancy introduced in (Oscar Key et al., "Composite Goodness-of-fit Tests with Kernels", Journal of Machine Learning Research…

Statistics Theory · Mathematics 2026-02-24 Florian Brück , Veronika Reimoser , Fabian Baier

We introduce a new approach for estimating the invariant density of a multidimensional diffusion when dealing with high-frequency observations blurred by independent noises. We consider the intermediate regime, where observations occur at…

Statistics Theory · Mathematics 2024-04-19 Raphaël Maillet , Grégoire Szymanski

Let $\boldsymbol{\xi}=(\xi_1,\ldots,\xi_m)$ be a negatively associated mean zero random vector with components that obey the bound $|\xi_i| \le B, i=1,\ldots,m$, and whose sum $W = \sum_{i=1}^m \xi_i$ has variance 1, the bound \[…

Probability · Mathematics 2018-09-11 Nathakhun Wiroonsri