English
Related papers

Related papers: On Projection Robust Optimal Transport: Sample Com…

200 papers

Optimal transport has recently proved to be a useful tool in various machine learning applications needing comparisons of probability measures. Among these, applications of distributionally robust optimization naturally involve Wasserstein…

Optimization and Control · Mathematics 2023-03-24 Waïss Azizian , Franck Iutzeler , Jérôme Malick

We show that several machine learning estimators, including square-root LASSO (Least Absolute Shrinkage and Selection) and regularized logistic regression can be represented as solutions to distributionally robust optimization (DRO)…

Statistics Theory · Mathematics 2020-10-22 Jose Blanchet , Yang Kang , Karthyek Murthy

The empirical optimal transport (OT) cost between two probability measures from random data is a fundamental quantity in transport based data analysis. In this work, we derive novel guarantees for its convergence rate when the involved…

Statistics Theory · Mathematics 2022-02-22 Shayan Hundrieser , Thomas Staudt , Axel Munk

Optimal Transport (OT) provides a useful geometric framework to estimate the permutation matrix under unsupervised cross-lingual word embedding (CLWE) models that pose the alignment task as a Wasserstein-Procrustes problem. However, linear…

Computation and Language · Computer Science 2022-12-06 Prince O Aboagye , Yan Zheng , Michael Yeh , Junpeng Wang , Zhongfang Zhuang , Huiyuan Chen , Liang Wang , Wei Zhang , Jeff Phillips

We consider learning in an adversarial environment, where an $\varepsilon$-fraction of samples from a distribution $P$ are arbitrarily modified (global corruptions) and the remaining perturbations have average magnitude bounded by $\rho$…

Machine Learning · Computer Science 2024-06-26 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

Optimal transport (OT) is a widely used technique for distribution alignment, with applications throughout the machine learning, graphics, and vision communities. Without any additional structural assumptions on trans-port, however, OT can…

Machine Learning · Computer Science 2021-07-20 Chi-Heng Lin , Mehdi Azabou , Eva L. Dyer

We introduce sliced optimal transport dataset distance (s-OTDD), a model-agnostic, embedding-agnostic approach for dataset comparison that requires no training, is robust to variations in the number of classes, and can handle disjoint label…

Machine Learning · Computer Science 2025-05-16 Khai Nguyen , Hai Nguyen , Tuan Pham , Nhat Ho

With the discovery of Wasserstein GANs, Optimal Transport (OT) has become a powerful tool for large-scale generative modeling tasks. In these tasks, OT cost is typically used as the loss for training GANs. In contrast to this approach, we…

Machine Learning · Computer Science 2022-03-08 Litu Rout , Alexander Korotin , Evgeny Burnaev

Discriminating between distributions is an important problem in a number of scientific fields. This motivated the introduction of Linear Optimal Transportation (LOT), which embeds the space of distributions into an $L^2$-space. The…

Machine Learning · Statistics 2021-05-27 Caroline Moosmüller , Alexander Cloninger

Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance…

Statistics Theory · Mathematics 2021-03-04 Jose Blanchet , Karthyek Murthy , Nian Si

We propose a new statistical model, the spiked transport model, which formalizes the assumption that two probability distributions differ only on a low-dimensional subspace. We study the minimax rate of estimation for the Wasserstein…

Statistics Theory · Mathematics 2019-09-18 Jonathan Niles-Weed , Philippe Rigollet

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

Optimal transport (OT) finds a least cost transport plan between two probability distributions using a cost matrix defined on pairs of points. Unlike standard OT, which infers unstructured pointwise mappings, low-rank optimal transport…

Machine Learning · Computer Science 2026-03-05 Henri Schmidt , Peter Halmos , Ben Raphael

Optimal transport (OT) and the related Wasserstein metric (W) are powerful and ubiquitous tools for comparing distributions. However, computing pairwise Wasserstein distances rapidly becomes intractable as cohort size grows. An attractive…

Machine Learning · Computer Science 2024-06-05 Doron Haviv , Russell Zhang Kunes , Thomas Dougherty , Cassandra Burdziak , Tal Nawy , Anna Gilbert , Dana Pe'er

Optimal transport (OT) is a popular tool in machine learning to compare probability measures geometrically, but it comes with substantial computational burden. Linear programming algorithms for computing OT distances scale cubically in the…

Machine Learning · Computer Science 2022-03-24 Gaspard Beugnot , Aude Genevay , Kristjan Greenewald , Justin Solomon

Optimal transport (OT) measures distances between distributions in a way that depends on the geometry of the sample space. In light of recent advances in computational OT, OT distances are widely used as loss functions in machine learning.…

Methodology · Statistics 2021-06-22 Debarghya Mukherjee , Aritra Guha , Justin Solomon , Yuekai Sun , Mikhail Yurochkin

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

The effects of treatments are often heterogeneous, depending on the observable characteristics, and it is necessary to exploit such heterogeneity to devise individualized treatment rules (ITRs). Existing estimation methods of such ITRs…

Econometrics · Economics 2022-08-09 Daido Kido

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

Optimization and Control · Mathematics 2020-10-01 Iman Shames , Farhad Farokhi