English
Related papers

Related papers: Estimating causal distances with non-causal ones

200 papers

Optimal transport has been very successful for various machine learning tasks; however, it is known to suffer from the curse of dimensionality. Hence, dimensionality reduction is desirable when applied to high-dimensional data with…

Machine Learning · Statistics 2025-07-21 Jie Wang , March Boedihardjo , Yao Xie

Using i.i.d. data to estimate a high-dimensional distribution in Wasserstein distance is a fundamental instance of the curse of dimensionality. We explore how structural knowledge about the data-generating process which gives rise to the…

Statistics Theory · Mathematics 2026-05-22 Daniel Bartl , Stephan Eckstein

Optimization over the space of probability measures endowed with the Wasserstein-2 geometry is central to modern machine learning and mean-field modeling. However, traditional methods relying on full Wasserstein gradients often suffer from…

Machine Learning · Statistics 2026-04-03 Yewei Xu , Qin Li

The smooth 1-Wasserstein distance (SWD) $W_1^\sigma$ was recently proposed as a means to mitigate the curse of dimensionality in empirical approximation while preserving the Wasserstein structure. Indeed, SWD exhibits parametric convergence…

Statistics Theory · Mathematics 2022-02-28 Ritwik Sadhu , Ziv Goldfeld , Kengo Kato

Learning to predict multi-label outputs is challenging, but in many problems there is a natural metric on the outputs that can be used to improve predictions. In this paper we develop a loss function for multi-label learning, based on the…

Machine Learning · Computer Science 2015-12-31 Charlie Frogner , Chiyuan Zhang , Hossein Mobahi , Mauricio Araya-Polo , Tomaso Poggio

In the machine learning and optimization community, there are two main approaches for the convex risk minimization problem, namely, the Stochastic Approximation (SA) and the Sample Average Approximation (SAA). In terms of oracle complexity…

Optimization and Control · Mathematics 2021-10-26 Darina Dvinskikh

The empirical Wasserstein projection (WP) distance quantifies the Wasserstein distance from the empirical distribution to a set of probability measures satisfying given expectation constraints. The WP is a powerful tool because it mitigates…

Statistics Theory · Mathematics 2024-08-22 Sirui Lin , Jose Blanchet , Peter Glynn , Viet Anh Nguyen

Several issues in machine learning and inverse problems require to generate discrete data, as if sampled from a model probability distribution. A common way to do so relies on the construction of a uniform probability distribution over a…

Optimization and Control · Mathematics 2021-06-16 Quentin Merigot , Filippo Santambrogio , Clément Sarrazin

This paper is a companion paper to [Lipman and Daubechies 2011]. We provide numerical procedures and algorithms for computing the alignment of and distance between two disk type surfaces. We provide a convergence analysis of the discrete…

Numerical Analysis · Mathematics 2014-02-18 Yaron Lipman , Jesus Puente , Ingrid Daubechies

Sliced-Wasserstein distance (SW) and its variant, Max Sliced-Wasserstein distance (Max-SW), have been used widely in the recent years due to their fast computation and scalability even when the probability measures lie in a very high…

Machine Learning · Statistics 2020-10-06 Khai Nguyen , Nhat Ho , Tung Pham , Hung Bui

We provide an implementation to compute the flat metric in any dimension. The flat metric, also called dual bounded Lipschitz distance, generalizes the well-known Wasserstein distance $W_1$ to the case that the distributions are of unequal…

Machine Learning · Computer Science 2025-06-17 Henri Schmidt , Christian Düll

In this paper, we consider the problem of propagating an uncertain distribution by a possibly non-linear function and quantifying the resulting uncertainty. We measure the uncertainty using the Wasserstein distance, and for a given input…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Eduardo Figueiredo , Steven Adams , Peyman Mohajerin Esfahani , Luca Laurenti

We study the behavior of the Wasserstein-$2$ distance between discrete measures $\mu$ and $\nu$ in $\mathbb{R}^d$ when both measures are smoothed by small amounts of Gaussian noise. This procedure, known as Gaussian-smoothed optimal…

Statistics Theory · Mathematics 2022-06-15 Yunzi Ding , Jonathan Niles-Weed

Recently, a Wasserstein-type distance for Gaussian mixture models has been proposed. However, that framework can only be generalized to identifiable mixtures of general elliptically contoured distributions whose components come from the…

Optimization and Control · Mathematics 2025-03-19 Keyu Chen , Zetian Wang , Yunxin Zhang

The Wasserstein probability metric has received much attention from the machine learning community. Unlike the Kullback-Leibler divergence, which strictly measures change in probability, the Wasserstein metric reflects the underlying…

Machine Learning · Computer Science 2017-06-01 Marc G. Bellemare , Ivo Danihelka , Will Dabney , Shakir Mohamed , Balaji Lakshminarayanan , Stephan Hoyer , Rémi Munos

Tree-Sliced methods have recently emerged as an alternative to the traditional Sliced Wasserstein (SW) distance, replacing one-dimensional lines with tree-based metric spaces and incorporating a splitting mechanism for projecting measures.…

Machine Learning · Computer Science 2025-06-10 Thanh Tran , Viet-Hoang Tran , Thanh Chu , Trang Pham , Laurent El Ghaoui , Tam Le , Tan M. Nguyen

We propose a fundamental metric for measuring the distance between two distributions. This metric, referred to as the decision-focused (DF) divergence, is tailored to stochastic linear optimization problems in which the objective…

Statistics Theory · Mathematics 2026-02-04 Suhan Liu , Mo Liu

We study rates of convergence for estimation of the Gromov-Wasserstein (GW) distance. For two marginals supported on compact subsets of $\R^{d_x}$ and $\R^{d_y}$, respectively, with $\min \{ d_x,d_y \} > 4$, prior work established the rate…

Statistics Theory · Mathematics 2025-09-03 Kengo Kato , Boyu Wang

Comparing spherical probability distributions is of great interest in various fields, including geology, medical domains, computer vision, and deep representation learning. The utility of optimal transport-based distances, such as the…

Machine Learning · Computer Science 2024-06-11 Huy Tran , Yikun Bai , Abihith Kothapalli , Ashkan Shahbazi , Xinran Liu , Rocio Diaz Martin , Soheil Kolouri

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

Optimization and Control · Mathematics 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang