English
Related papers

Related papers: Unfolding with a Wasserstein Loss

200 papers

A wide array of machine learning problems are formulated as the minimization of the expectation of a convex loss function on some parameter space. Since the probability distribution of the data of interest is usually unknown, it is is often…

Optimization and Control · Mathematics 2019-05-27 Emilie Chouzenoux , Henri Gérard , Jean-Christophe Pesquet

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

Optimal Transport (OT) has attracted significant interest in the machine learning community, not only for its ability to define meaningful distances between probability distributions -- such as the Wasserstein distance -- but also for its…

Machine Learning · Computer Science 2025-11-04 Laetitia Chapel , Romain Tavenard , Samuel Vaiter

The Wasserstein metric is broadly used in optimal transport for comparing two probabilistic distributions, with successful applications in various fields such as machine learning, signal processing, seismic inversion, etc. Nevertheless, the…

Optimization and Control · Mathematics 2022-02-22 Qichen Liao , Jing Chen , Zihao Wang , Bo Bai , Shi Jin , Hao Wu

Quantitative evaluations of differences and/or similarities between data samples define and shape optimisation problems associated with learning data distributions. Current methods to compare data often suffer from limitations in capturing…

Machine Learning · Computer Science 2024-01-23 Deborah Pelacani Cruz , George Strong , Oscar Bates , Carlos Cueto , Jiashun Yao , Lluis Guasch

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

Entropy regularization in optimal transport (OT) has been the driver of many recent interests for Wasserstein metrics and barycenters in machine learning. It allows to keep the appealing geometrical properties of the unregularized…

Machine Learning · Statistics 2020-06-05 Hicham Janati , Marco Cuturi , Alexandre Gramfort

Hypothesis testing for small-sample scenarios is a practically important problem. In this paper, we investigate the robust hypothesis testing problem in a data-driven manner, where we seek the worst-case detector over distributional…

Machine Learning · Statistics 2022-05-17 Jie Wang , Yao Xie

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

Spatial resolution is one of the most important specifications of an imaging system. Recent results in quantum parameter estimation theory reveal that an arbitrarily small distance between two incoherent point sources can always be…

We present a new perspective on the celebrated Sinkhorn algorithm by showing that is a special case of incremental/stochastic mirror descent. In order to see this, one should simply plug Kullback-Leibler divergence in both mirror map and…

Machine Learning · Computer Science 2019-09-17 Konstantin Mishchenko

Wasserstein distributionally robust optimization (DRO) has recently achieved empirical success for various applications in operations research and machine learning, owing partly to its regularization effect. Although connection between…

Machine Learning · Computer Science 2020-11-02 Rui Gao , Xi Chen , Anton J. Kleywegt

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

This article introduces a new class of fast algorithms to approximate variational problems involving unbalanced optimal transport. While classical optimal transport considers only normalized probability distributions, it is important for…

Optimization and Control · Mathematics 2017-05-23 Lenaic Chizat , Gabriel Peyré , Bernhard Schmitzer , François-Xavier Vialard

We propose a variational approach to approximate measures with measures uniformly distributed over a 1 dimentional set. The problem consists in minimizing a Wasserstein distance as a data term with a regularization given by the length of…

Analysis of PDEs · Mathematics 2024-10-17 Antonin Chambolle , Vincent Duval , Joao Miguel Machado

In seismic exploration, sources and measurements of seismic waves on the surface are used to determine model parameters representing geophysical properties of the earth. Full-waveform inversion (FWI) is a nonlinear seismic inverse technique…

Numerical Analysis · Mathematics 2019-02-05 Yunan Yang

A new Wasserstein multi-element polynomial chaos expansion (WPCE) is proposed, which is inspired by recent advances in computational optimal transport for estimating Wasserstein distances. The developed method combines unsupervised learning…

Numerical Analysis · Mathematics 2024-10-17 Robert Gruhlke , Martin Eigel

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We present a Distributionally Robust Optimization (DRO) approach to estimate a robustified regression plane in a linear regression setting, when the observed samples are potentially contaminated with adversarially corrupted outliers. Our…

Machine Learning · Statistics 2018-05-14 Ruidi Chen , Ioannis Ch. Paschalidis