English
Related papers

Related papers: Gaussian random field approximation via Stein's me…

200 papers

The family of Mat\'ern kernels are often used in spatial statistics, function approximation and Gaussian process methods in machine learning. One reason for their popularity is the presence of a smoothness parameter that controls, for…

Statistics Theory · Mathematics 2025-06-06 Moritz Korte-Stapff , Toni Karvonen , Eric Moulines

In Bayesian inference, the posterior distributions are difficult to obtain analytically for complex models such as neural networks. Variational inference usually uses a parametric distribution for approximation, from which we can easily…

Machine Learning · Statistics 2019-02-01 Futoshi Futami , Zhenghang Cui , Issei Sato , Masashi Sugiyama

Stein operators are differential operators which arise within the so-called Stein's method for stochastic approximation. We propose a new mechanism for constructing such operators for arbitrary (continuous or discrete) parametric…

Probability · Mathematics 2013-05-23 Christophe Ley , Yvik Swan

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

Machine Learning · Computer Science 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

Gromov--Wasserstein (GW) distances compare graphs, shapes, and point clouds through internal distances, without requiring a common coordinate system. This invariance is powerful, but discrete GW is a nonconvex quadratic optimal transport…

Machine Learning · Computer Science 2026-05-15 Ao Xu , Tieru Wu

We study the efficacy and efficiency of deep generative networks for approximating probability distributions. We prove that neural networks can transform a low-dimensional source distribution to a distribution that is arbitrarily close to a…

Machine Learning · Computer Science 2023-12-05 Yunfei Yang , Zhen Li , Yang Wang

We establish new lower bounds for the normal approximation in the Wasserstein distance of random variables that are functionals of a Poisson measure. Our results generalize previous findings by Nourdin and Peccati (2012, 2015) and Bierm\'e,…

Probability · Mathematics 2015-05-13 Ehsan Azmoodeh , Giovanni Peccati

Variance-Gamma distributions are widely used in financial modelling and contain as special cases the normal, Gamma and Laplace distributions. In this paper we extend Stein's method to this class of distributions. In particular, we obtain a…

Probability · Mathematics 2014-04-01 Robert E. Gaunt

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

We derive explicit distance bounds for Stratonovich iterated integrals along two Gaussian processes (also known as signatures of Gaussian rough paths) based on the regularity assumption of their covariance functions. Similar estimates have…

Probability · Mathematics 2012-08-03 Sebastian Riedel , Weijun Xu

It is well-known that non-linear approximation has an advantage over linear schemes in the sense that it provides comparable approximation rates to those of the linear schemes, but to a larger class of approximands. This was established for…

Classical Analysis and ODEs · Mathematics 2010-04-28 Thomas Hangelbroek , Amos Ron

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

We introduce a carr\'e du champ operator for Banach-valued random elements, taking values in the projective tensor product, and use it to control the bounded Lipschitz distance between a Malliavin-smooth random element satisfying mild…

Probability · Mathematics 2026-04-03 Solesne Bourguin , Simon Campese

We derive Stein approximation bounds for functionals of uniform random variables, using chaos expansions and the Clark-Ocone representation formula combined with derivation and finite difference operators. This approach covers sums and…

Probability · Mathematics 2018-02-28 Nicolas Privault , Grzegorz Serafin

The increasing availability of network data has driven the development of advanced statistical models specifically designed for metric graphs, where Gaussian processes play a pivotal role. While models such as Whittle-Mat\'ern fields have…

Methodology · Statistics 2026-03-18 David Bolin , Lenin Riera-Segura , Alexandre B. Simas

Minimising upper bounds on the population risk or the generalisation gap has been widely used in structural risk minimisation (SRM) -- this is in particular at the core of PAC-Bayesian learning. Despite its successes and unfailing surge of…

Machine Learning · Statistics 2023-10-30 Paul Viallard , Maxime Haddouche , Umut Şimşekli , Benjamin Guedj

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

Machine Learning · Computer Science 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

Motivated by approximation Bayesian computation using mean-field variational approximation and the computation of equilibrium in multi-species systems with cross-interaction, this paper investigates the composite geodesically convex…

Optimization and Control · Mathematics 2024-09-18 Rentian Yao , Xiaohui Chen , Yun Yang

Random binning features, introduced in the seminal paper of Rahimi and Recht (2007), are an efficient method for approximating a kernel matrix using locality sensitive hashing. Random binning features provide a very simple and efficient way…

Machine Learning · Statistics 2020-03-24 Michael Kapralov , Navid Nouri , Ilya Razenshteyn , Ameya Velingker , Amir Zandieh