English
Related papers

Related papers: Bayesian Learning with Wasserstein Barycenters

200 papers

We study non-stationary linear contextual bandits through the lens of sequential Bayesian inference. Whereas existing algorithms typically rely on the Weighted Regularized Least-Squares (WRLS) objective, we study Weighted Sequential…

Machine Learning · Computer Science 2025-10-03 Nicklas Werge , Yi-Shan Wu , Abdullah Akgül , Melih Kandemir

The primary choice to summarize a finite collection of random objects is by using measures of central tendency, such as mean and median. In the field of optimal transport, the Wasserstein barycenter corresponds to the Fr\'{e}chet or…

Methodology · Statistics 2025-09-03 Kisung You , Dennis Shung , Mauro Giuffrè

Clustering is an important exploratory data analysis technique to group objects based on their similarity. The widely used $K$-means clustering method relies on some notion of distance to partition data into a fewer number of groups. In the…

Machine Learning · Statistics 2022-10-14 Yubo Zhuang , Xiaohui Chen , Yun Yang

Bayesian optimal experimental design (BOED) provides a powerful, decision-theoretic framework for selecting experiments so as to maximise the expected utility of the data to be collected. In practice, however, its applicability can be…

Machine Learning · Statistics 2026-03-13 Louis Sharrock

We introduce a novel Bayesian estimator for the class proportion in an unlabeled dataset, based on the targeted learning framework. Our procedure requires the specification of a prior (and outputs a posterior) only for the target of…

Methodology · Statistics 2019-11-26 Iván Díaz , Oleksander Savenkov , Hooman Kamel

In this paper, we study the learning rate of generalized Bayes estimators in a general setting where the hypothesis class can be uncountable and have an irregular shape, the loss function can have heavy tails, and the optimal hypothesis may…

Statistics Theory · Mathematics 2021-11-22 Lam Si Tung Ho , Binh T. Nguyen , Vu Dinh , Duy Nguyen

In this work we introduce the concept of Bures-Wasserstein barycenter $Q_*$, that is essentially a Fr\'echet mean of some distribution $\mathbb{P}$ supported on a subspace of positive semi-definite Hermitian operators $\mathbb{H}_{+}(d)$.…

Statistics Theory · Mathematics 2019-02-12 Alexey Kroshnin , Vladimir Spokoiny , Alexandra Suvorikova

Wasserstein gradient flow (WGF) is a common method to perform optimization over the space of probability measures. While WGF is guaranteed to converge to a first-order stationary point, for nonconvex functionals the converged solution does…

Optimization and Control · Mathematics 2025-09-23 Naoya Yamamoto , Juno Kim , Taiji Suzuki

We address the problem of efficiently computing Wasserstein distances for multiple pairs of distributions drawn from a meta-distribution. To this end, we propose a fast estimation method based on regressing Wasserstein distance on sliced…

Machine Learning · Statistics 2026-03-04 Khai Nguyen , Hai Nguyen , Nhat Ho

Generative Adversarial Networks (GANs) have been used to model the underlying probability distribution of sample based datasets. GANs are notoriuos for training difficulties and their dependence on arbitrary hyperparameters. One recent…

Machine Learning · Computer Science 2019-10-03 Thomas Pinetz , Daniel Soukup , Thomas Pock

Wasserstein barycenters and variance-like criteria based on the Wasserstein distance are used in many problems to analyze the homogeneity of collections of distributions and structural relationships between the observations. We propose the…

Statistics Theory · Mathematics 2018-10-31 Eustasio Del Barrio , Paula Gordaliza , Hélène Lescornel , Jean-Michel Loubes

Generating samples given a specific label requires estimating conditional distributions. We derive a tractable upper bound of the Wasserstein distance between conditional distributions to lay the theoretical groundwork to learn conditional…

Machine Learning · Statistics 2023-08-29 Young-geun Kim , Kyungbok Lee , Youngwon Choi , Joong-Ho Won , Myunghee Cho Paik

The Boltzmann machine provides a useful framework to learn highly complex, multimodal and multiscale data distributions that occur in the real world. The default method to learn its parameters consists of minimizing the Kullback-Leibler…

Machine Learning · Statistics 2015-07-09 Grégoire Montavon , Klaus-Robert Müller , Marco Cuturi

This paper studies the optimization of the KL functional on the Wasserstein space of probability measures, and develops a sampling framework based on Wasserstein gradient descent (WGD). We identify two important subclasses of the…

Computation · Statistics 2026-02-04 Van Chien Ta , Thi Mai Hong Chu , Minh-Ngoc Tran

Wasserstein barycentres represent average distributions between multiple probability measures for the Wasserstein distance. The numerical computation of Wasserstein barycentres is notoriously challenging. A common approach is to use…

Numerical Analysis · Mathematics 2026-03-30 Eloi Tanguy , Julie Delon , Nathaël Gozlan

We consider synthesis and analysis of probability measures using the entropy-regularized Wasserstein-2 cost and its unbiased version, the Sinkhorn divergence. The synthesis problem consists of computing the barycenter, with respect to these…

Machine Learning · Statistics 2025-03-25 Brendan Mallery , James M. Murphy , Shuchin Aeron

The two-sample homogeneity testing problem is fundamental in statistics and becomes particularly challenging in high dimensions, where classical tests can suffer substantial power loss. We develop a learning-assisted procedure based on the…

Methodology · Statistics 2026-01-30 Xiaoyu Hu , Zhenhua Lin

The Sliced-Wasserstein distance (SW) is being increasingly used in machine learning applications as an alternative to the Wasserstein distance and offers significant computational and statistical benefits. Since it is defined as an…

Machine Learning · Statistics 2022-01-05 Kimia Nadjahi , Alain Durmus , Pierre E. Jacob , Roland Badeau , Umut Şimşekli

We study the problem of the decentralized computation of entropy-regularized semi-discrete Wasserstein barycenters over a network. Building upon recent primal-dual approaches, we propose a sampling gradient quantization scheme that allows…

Optimization and Control · Mathematics 2020-10-28 Roman Krawtschenko , César A. Uribe , Alexander Gasnikov , Pavel Dvurechensky

Based on the concepts of Wasserstein barycenter (WB) and Gromov-Wasserstein barycenter (GWB), we propose a unified mathematical framework for neural network (NN) model fusion and utilize it to reveal new insights about the linear mode…

Machine Learning · Computer Science 2022-10-14 Aditya Kumar Akash , Sixu Li , Nicolás García Trillos