English
Related papers

Related papers: ADOPT: Additive Optimal Transport Regression

200 papers

In this paper, we study the problem of learning compact (low-dimensional) representations for sequential data that captures its implicit spatio-temporal cues. To maximize extraction of such informative cues from the data, we set the problem…

Machine Learning · Computer Science 2020-07-14 Anoop Cherian , Shuchin Aeron

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

We consider problems of minimizing functionals $\mathcal{F}$ of probability measures on the Euclidean space. To propose an accelerated gradient descent algorithm for such problems, we consider gradient flow of transport maps that give…

Optimization and Control · Mathematics 2023-09-06 Ken'ichiro Tanaka

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

What is the optimal way to deform a projective hypersurface into another one? In this paper we will answer this question adopting the point of view of measure theory, introducing the optimal transport problem between complex algebraic…

Differential Geometry · Mathematics 2023-07-18 Paolo Antonini , Fabio Cavalletti , Antonio Lerario

Computing optimal transport maps between high-dimensional and continuous distributions is a challenging problem in optimal transport (OT). Generative adversarial networks (GANs) are powerful generative models which have been successfully…

Machine Learning · Computer Science 2019-06-25 Jacob Leygonie , Jennifer She , Amjad Almahairi , Sai Rajeswar , Aaron Courville

We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the…

Machine Learning · Statistics 2024-01-17 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

This article presents a general approximation-theoretic framework to analyze measure transport algorithms for probabilistic modeling. A primary motivating application for such algorithms is sampling -- a central task in statistical…

Numerical Analysis · Mathematics 2024-09-19 Ricardo Baptista , Bamdad Hosseini , Nikola B. Kovachki , Youssef M. Marzouk , Amir Sagiv

Suppose we are given two metric spaces and a family of continuous transformations from one to the other. Given a probability distribution on each of these two spaces - namely the source and the target measures - the Wasserstein alignment…

Probability · Mathematics 2025-03-11 Soumik Pal , Bodhisattva Sen , Ting-Kam Leonard Wong

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

Statistics Theory · Mathematics 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

Recently, linear regression models incorporating an optimal transport (OT) loss have been explored for applications such as supervised unmixing of spectra, music transcription, and mass spectrometry. However, these task-specific approaches…

This work studies an explicit embedding of the set of probability measures into a Hilbert space, defined using optimal transport maps from a reference probability density. This embedding linearizes to some extent the 2-Wasserstein space,…

Machine Learning · Statistics 2022-05-05 Quentin Mérigot , Alex Delalande , Frédéric Chazal

We consider the optimal mass transportation problem in $\RR^d$ with measurably parameterized marginals, for general cost functions and under conditions ensuring the existence of a unique optimal transport map. We prove a joint measurability…

Probability · Mathematics 2008-09-09 Joaquin Fontbona , Helene Guerin , Sylvie Meleard

We introduce a new class of objectives for optimal transport computations of datasets in high-dimensional Euclidean spaces. The new objectives are parametrized by $\rho \geq 1$, and provide a metric space $\mathcal{R}_{\rho}(\cdot, \cdot)$…

Data Structures and Algorithms · Computer Science 2023-07-20 Moses Charikar , Beidi Chen , Christopher Re , Erik Waingarten

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

Statistics Theory · Mathematics 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

Optimization and Control · Mathematics 2024-08-20 Yifan Chen , Wuchen Li

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

Methodology · Statistics 2018-04-10 German A. Schnaidt Grez , Brani Vidakovic

Optimal transport has found widespread applications in signal processing and machine learning. Among its many equivalent formulations, optimal transport seeks to reconstruct a random variable/vector with a prescribed distribution at the…

Information Theory · Computer Science 2025-03-06 Jun Chen , Jia Wang , Ruibin Li , Han Zhou , Wei Dong , Huan Liu , Yuanhao Yu

Composite quantile regression has been used to obtain robust estimators of regression coefficients in linear models with good statistical efficiency. By revealing an intrinsic link between the composite quantile regression loss function and…

Statistics Theory · Mathematics 2024-02-15 Xuzhi Yang , Tengyao Wang

Learning useful representations is a key ingredient to the success of modern machine learning. Currently, representation learning mostly relies on embedding data into Euclidean space. However, recent work has shown that data in some domains…

Machine Learning · Computer Science 2019-10-17 Denis Mazur , Vage Egiazarian , Stanislav Morozov , Artem Babenko