English
Related papers

Related papers: Neural Wasserstein Two-Sample Tests

200 papers

Testing heteroscedasticity of the errors is a major challenge in high-dimensional regressions where the number of covariates is large compared to the sample size. Traditional procedures such as the White and the Breusch-Pagan tests…

Methodology · Statistics 2017-10-16 Zhaoyuan Li , Jianfeng Yao

The proliferation of large data sets and Bayesian inference techniques motivates demand for better data sparsification. Coresets provide a principled way of summarizing a large dataset via a smaller one that is guaranteed to match the…

Machine Learning · Statistics 2020-03-04 Sebastian Claici , Aude Genevay , Justin Solomon

Let $M$ be a connected compact Riemannian manifold possibly with a boundary, let $V\in C^2(M)$ such that $\mu(\d x):=\e^{V(x)}\d x$ is a probability measure, where $\d x$ is the volume measure, and let $L=\Delta+\nabla V$. The exact…

Probability · Mathematics 2021-07-27 Feng-Yu Wang , Bingyao Wu

We use Stein's method to bound the Wasserstein distance of order $2$ between a measure $\nu$ and the Gaussian measure using a stochastic process $(X_t)_{t \geq 0}$ such that $X_t$ is drawn from $\nu$ for any $t > 0$. If the stochastic…

Probability · Mathematics 2020-05-12 Thomas Bonis

We introduce a distributionally robust minimium mean square error estimation model with a Wasserstein ambiguity set to recover an unknown signal from a noisy observation. The proposed model can be viewed as a zero-sum game between a…

Optimization and Control · Mathematics 2021-01-28 Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

Score-based generative modeling with probability flow ordinary differential equations (ODEs) has achieved remarkable success in a variety of applications. While various fast ODE-based samplers have been proposed in the literature and…

Machine Learning · Statistics 2025-08-12 Xuefeng Gao , Lingjiong Zhu

In order to adapt the Wasserstein distance to the large sample multivariate non-parametric two-sample problem, making its application computationally feasible, permutation tests based on the Sinkhorn divergence between probability vectors…

Statistics Theory · Mathematics 2022-09-30 E. del Barrio , J. S. Osorio , A. J. Quiroz

Despite of its importance for safe machine learning, uncertainty quantification for neural networks is far from being solved. State-of-the-art approaches to estimate neural uncertainties are often hybrid, combining parametric models with…

Machine Learning · Computer Science 2021-12-03 Joachim Sicking , Maram Akila , Maximilian Pintz , Tim Wirtz , Asja Fischer , Stefan Wrobel

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

In this paper we propose tight upper and lower bounds for the Wasserstein distance between any two {{univariate continuous distributions}} with probability densities $p_1$ and $p_2$ having nested supports. These explicit bounds are…

Probability · Mathematics 2015-10-21 Christophe Ley , Gesine Reinert , Yvik Swan

We study the machine learning task for models with operators mapping between the Wasserstein space of probability measures and a space of functions, like e.g. in mean-field games/control problems. Two classes of neural networks, based on…

Optimization and Control · Mathematics 2023-09-19 Huyên Pham , Xavier Warin

Construction of ambiguity set in robust optimization relies on the choice of divergences between probability distributions. In distribution learning, choosing appropriate probability distributions based on observed data is critical for…

Machine Learning · Statistics 2017-05-24 Xin Guo , Johnny Hong , Nan Yang

This paper is focused on the statistical analysis of probability measures $\nu_{1},\ldots,\nu_{n}$ on $\mathbb{R}$ that can be viewed as independent realizations of an underlying stochastic process. We consider the situation of practical…

Statistics Theory · Mathematics 2017-03-30 Jérémie Bigot , Raúl Gouet , Thierry Klein , Alfredo López

The unequal representation of different groups in a sample population can lead to discrimination of minority groups when machine learning models make automated decisions. To address these issues, fairness-aware machine learning jointly…

Machine Learning · Computer Science 2023-11-22 Xuan Zhao , Simone Fabbrizzi , Paula Reyero Lobo , Siamak Ghodsi , Klaus Broelemann , Steffen Staab , Gjergji Kasneci

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

Estimating the density of a distribution from samples is a fundamental problem in statistics. In many practical settings, the Wasserstein distance is an appropriate error metric for density estimation. For example, when estimating…

Machine Learning · Computer Science 2024-07-01 Vitaly Feldman , Audra McMillan , Satchit Sivakumar , Kunal Talwar

The squared Wasserstein distance is a natural quantity to compare probability distributions in a non-parametric setting. This quantity is usually estimated with the plug-in estimator, defined via a discrete optimal transport problem which…

Optimization and Control · Mathematics 2020-10-30 Lenaic Chizat , Pierre Roussillon , Flavien Léger , François-Xavier Vialard , Gabriel Peyré

The Wasserstein distance has been an attractive tool in many fields. But due to its high computational complexity and the phenomenon of the curse of dimensionality in empirical estimation, various extensions of the Wasserstein distance have…

Statistics Theory · Mathematics 2022-09-07 Xianliang Xu , Zhongyi Huang

Nowadays stochastic computer simulations with both numeral and distribution inputs are widely used to mimic complex systems which contain a great deal of uncertainty. This paper studies the design and analysis issues of such computer…

Methodology · Statistics 2022-04-26 Chunya Li , Xiaojun Cui , Shifeng Xiong

We propose optimal Bayesian two-sample tests for testing equality of high-dimensional mean vectors and covariance matrices between two populations. In many applications including genomics and medical imaging, it is natural to assume that…

Methodology · Statistics 2021-12-07 Kyoungjae Lee , Kisung You , Lizhen Lin