English
Related papers

Related papers: Sharper Bounds for Chebyshev Moment Matching, with…

200 papers

Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance…

Statistics Theory · Mathematics 2021-03-04 Jose Blanchet , Karthyek Murthy , Nian Si

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

Machine Learning · Statistics 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

Computing the Wasserstein barycenter of a set of probability measures under the optimal transport metric can quickly become prohibitive for traditional second-order algorithms, such as interior-point methods, as the support size of the…

Optimization and Control · Mathematics 2020-01-22 Dongdong Ge , Haoyue Wang , Zikai Xiong , Yinyu Ye

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

Methodology · Statistics 2022-02-14 Ryo Okano , Masaaki Imaizumi

In this short note, we consider the worst case noise robustness of any phase retrieval algorithm which aims to reconstruct all nonvanishing vectors $\mathbf{x} \in \mathbb{C}^d$ (up to a single global phase multiple) from the magnitudes of…

Numerical Analysis · Mathematics 2018-06-22 Mark A. Iwen , Sami Merhi , Michael Perlmutter

In the noisy population recovery problem of Dvir et al., the goal is to learn an unknown distribution $f$ on binary strings of length $n$ from noisy samples. For some parameter $\mu \in [0,1]$, a noisy sample is generated by flipping each…

Computational Complexity · Computer Science 2016-02-25 Anindya De , Michael Saks , Sijian Tang

Bayesian inference typically requires the computation of an approximation to the posterior distribution. An important requirement for an approximate Bayesian inference algorithm is to output high-accuracy posterior mean and uncertainty…

Statistics Theory · Mathematics 2018-10-03 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

We extend Stein's celebrated Wasserstein bound for normal approximation via exchangeable pairs to the multi-dimensional setting. As an intermediate step, we exploit the symmetry of exchangeable pairs to obtain an error bound for smooth test…

Probability · Mathematics 2020-09-22 Xiao Fang , Yuta Koike

Let $X_1,X_2,...,X_n$ be a sequence of independent or locally dependent random variables taking values in $\mathbb{Z}_+$. In this paper, we derive sharp bounds, via a new probabilistic method, for the total variation distance between the…

Statistics Theory · Mathematics 2010-10-11 Michael V. Boutsikas , Eutichia Vaggelatou

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

We study a variety of Wasserstein distributionally robust optimization (WDRO) problems where the distributions in the ambiguity set are chosen by constraining their Wasserstein discrepancies to the empirical distribution. Using the notion…

Optimization and Control · Mathematics 2024-02-07 Hong T. M. Chu , Meixia Lin , Kim-Chuan Toh

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

We study efficient PAC learning of homogeneous halfspaces in $\mathbb{R}^d$ in the presence of malicious noise of Valiant (1985). This is a challenging noise model and only until recently has near-optimal noise tolerance bound been…

Machine Learning · Computer Science 2021-10-06 Jie Shen

We present a stochastic algorithm to compute the barycenter of a set of probability distributions under the Wasserstein metric from optimal transport. Unlike previous approaches, our method extends to continuous input distributions and…

Machine Learning · Computer Science 2018-06-08 Sebastian Claici , Edward Chien , Justin Solomon

Wasserstein distributionally robust optimization (DRO) aims to find robust and generalizable solutions by hedging against data perturbations in Wasserstein distance. Despite its recent empirical success in operations research and machine…

Machine Learning · Computer Science 2022-05-03 Rui Gao

We study the density estimation problem defined as follows: given $k$ distributions $p_1, \ldots, p_k$ over a discrete domain $[n]$, as well as a collection of samples chosen from a ``query'' distribution $q$ over $[n]$, output $p_i$ that…

Data Structures and Algorithms · Computer Science 2024-10-31 Anders Aamand , Alexandr Andoni , Justin Y. Chen , Piotr Indyk , Shyam Narayanan , Sandeep Silwal , Haike Xu

In the field of modern high-energy physics research, there is a growing emphasis on utilizing deep learning techniques to optimize event simulation, thereby expanding the statistical sample size for more accurate physical analysis.…

Computational Physics · Physics 2025-06-16 Chu-Cheng Pan , Xiang Dong , Yu-Chang Sun , Ao-Yan Cheng , Ao-Bo Wang , Yu-Xuan Hu , Hao Cai

When propagating uncertainty in the data of differential equations, the probability laws describing the uncertainty are typically themselves subject to uncertainty. We present a sensitivity analysis of uncertainty propagation for…

Probability · Mathematics 2022-03-01 Oliver G. Ernst , Alois Pichler , Björn Sprungk

We consider a distributionally robust second-order stochastic dominance constrained optimization problem. We require the dominance constraints hold with respect to all probability distributions in a Wasserstein ball centered at the…

Optimization and Control · Mathematics 2021-10-20 Yu Mei , Jia Liu , Zhiping Chen

Learning to predict multi-label outputs is challenging, but in many problems there is a natural metric on the outputs that can be used to improve predictions. In this paper we develop a loss function for multi-label learning, based on the…

Machine Learning · Computer Science 2015-12-31 Charlie Frogner , Chiyuan Zhang , Hossein Mobahi , Mauricio Araya-Polo , Tomaso Poggio