English
Related papers

Related papers: Efficient Distribution Learning with Error Bounds …

200 papers

Motivated by the Bures distance, we introduce a new family of distances, \emph{relative translation invariant Wasserstein distances}, denoted by $RW_p$, as an extension of the classical Wasserstein distances $W_p$ for $p \in [1, +\infty)$.…

Machine Learning · Computer Science 2026-05-26 Binshuai Wang , Qiwei Di , Ming Yin , Mengdi Wang , Quanquan Gu , Peng Wei

The discrete distribution is often used to describe complex instances in machine learning, such as images, sequences, and documents. Traditionally, clustering of discrete distributions (D2C) has been approached using Wasserstein barycenter…

Machine Learning · Computer Science 2024-08-19 Zixiao Wang , Dong Qiao , Jicong Fan

This paper presents a unified approach based on Wasserstein distance to derive concentration bounds for empirical estimates for two broad classes of risk measures defined in the paper. The classes of risk measures introduced include as…

Statistics Theory · Mathematics 2022-05-11 Prashanth L. A. , Sanjay P. Bhat

We present a novel $Q$-learning algorithm tailored to solve distributionally robust Markov decision problems where the corresponding ambiguity set of transition probabilities for the underlying Markov decision process is a Wasserstein ball…

Machine Learning · Computer Science 2024-06-21 Ariel Neufeld , Julian Sester

When propagating uncertainty in the data of differential equations, the probability laws describing the uncertainty are typically themselves subject to uncertainty. We present a sensitivity analysis of uncertainty propagation for…

Probability · Mathematics 2022-03-01 Oliver G. Ernst , Alois Pichler , Björn Sprungk

Compared with word embedding based on point representation, distribution-based word embedding shows more flexibility in expressing uncertainty and therefore embeds richer semantic information when representing words. The Wasserstein…

Computation and Language · Computer Science 2018-09-05 Chi Sun , Hang Yan , Xipeng Qiu , Xuanjing Huang

Given i.i.d.~samples from an unknown distribution $P$, the goal of distribution learning is to recover the parameters of a distribution that is close to $P$. When $P$ belongs to the class of product distributions on the Boolean hypercube…

Machine Learning · Computer Science 2025-11-14 Arnab Bhattacharyya , Davin Choo , Philips George John , Themis Gouleakis

A growing number of generative statistical models do not permit the numerical evaluation of their likelihood functions. Approximate Bayesian computation (ABC) has become a popular approach to overcome this issue, in which one simulates…

Methodology · Statistics 2019-05-10 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert

The Bayesian approach to clustering is often appreciated for its ability to provide uncertainty in the partition structure. However, summarizing the posterior distribution over the clustering structure can be challenging, due the discrete,…

Computation · Statistics 2026-01-26 Cecilia Balocchi , Sara Wade

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein…

Optimization and Control · Mathematics 2022-07-20 Jonathan Yu-Meng Li , Tiantian Mao

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

Machine Learning · Statistics 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

The sliced Wasserstein (SW) distance has been widely recognized as a statistically effective and computationally efficient metric between two probability measures. A key component of the SW distance is the slicing distribution. There are…

Machine Learning · Statistics 2024-01-02 Khai Nguyen , Nhat Ho

Wasserstein distributionally robust optimization (DRO) aims to find robust and generalizable solutions by hedging against data perturbations in Wasserstein distance. Despite its recent empirical success in operations research and machine…

Machine Learning · Computer Science 2022-05-03 Rui Gao

We introduce LOT Wassmap, a computationally feasible algorithm to uncover low-dimensional structures in the Wasserstein space. The algorithm is motivated by the observation that many datasets are naturally interpreted as probability…

Machine Learning · Computer Science 2023-02-16 Alexander Cloninger , Keaton Hamm , Varun Khurana , Caroline Moosmüller

We consider a distributionally robust second-order stochastic dominance constrained optimization problem. We require the dominance constraints hold with respect to all probability distributions in a Wasserstein ball centered at the…

Optimization and Control · Mathematics 2021-10-20 Yu Mei , Jia Liu , Zhiping Chen

Collections of probability distributions arise in a variety of applications ranging from user activity pattern analysis to brain connectomics. In practice these distributions can be defined over diverse domain types including finite…

Methodology · Statistics 2023-06-16 Raif Rustamov , Subhabrata Majumdar

The Wasserstein distance is a powerful metric based on the theory of optimal transport. It gives a natural measure of the distance between two distributions with a wide range of applications. In contrast to a number of the common…

Machine Learning · Computer Science 2021-02-16 Jung Hun Oh , Maryam Pouryahya , Aditi Iyer , Aditya P. Apte , Allen Tannenbaum , Joseph O. Deasy

In the context of kernel methods, the similarity between data points is encoded by the kernel function which is often defined thanks to the Euclidean distance, a common example being the squared exponential kernel. Recently, other distances…

Machine Learning · Computer Science 2020-02-06 Henri De Plaen , Michaël Fanuel , Johan A. K. Suykens

Detecting weak, systematic distribution shifts and quantitatively modeling individual, heterogeneous responses to policies or incentives have found increasing empirical applications in social and economic sciences. Given two probability…

Statistics Theory · Mathematics 2024-03-29 YoonHaeng Hur , Tengyuan Liang