English
Related papers

Related papers: Low-Rank Optimal Transport through Factor Relaxati…

200 papers

In this article we revisit the weak optimal transport (WOT) problem, introduced by Gozlan, Roberto, Samson and Tetali (2017). We work on the real line, with barycentric cost functions, and as our first result give the following…

Probability · Mathematics 2024-07-19 Erhan Bayraktar , Dominykas Norgilas

Aggregating data from multiple sources can be formalized as an Optimal Transport (OT) barycenter problem, which seeks to compute the average of probability distributions with respect to OT discrepancies. However, in real-world scenarios,…

Machine Learning · Statistics 2025-04-15 Milena Gazdieva , Jaemoo Choi , Alexander Kolesov , Jaewoong Choi , Petr Mokrov , Alexander Korotin

We propose a new method to estimate Wasserstein distances and optimal transport plans between two probability distributions from samples in high dimension. Unlike plug-in rules that simply replace the true distributions by their empirical…

Optimal transport (OT) is attracting increasing attention in machine learning. It aims to transport a source distribution to a target one at minimal cost. In its vanilla form, the source and target distributions are predetermined, which…

Machine Learning · Computer Science 2024-01-23 Liangliang Shi , Zhaoqi Shen , Junchi Yan

Optimal transport (OT)-based methods have a wide range of applications and have attracted a tremendous amount of attention in recent years. However, most of the computational approaches of OT do not learn the underlying transport map.…

Machine Learning · Statistics 2019-06-20 Andrés Hoyos-Idrobo

Optimal transport (OT) and Gromov-Wasserstein (GW) alignment provide interpretable geometric frameworks for comparing, transforming, and aggregating heterogeneous datasets -- tasks ubiquitous in data science and machine learning. Because…

Machine Learning · Computer Science 2025-12-04 Sanjit Dandapanthula , Aleksandr Podkopaev , Shiva Prasad Kasiviswanathan , Aaditya Ramdas , Ziv Goldfeld

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

Machine Learning · Computer Science 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

Optimal Transport (OT) distances such as Wasserstein have been used in several areas such as GANs and domain adaptation. OT, however, is very sensitive to outliers (samples with large noise) in the data since in its objective function,…

Machine Learning · Computer Science 2020-10-13 Yogesh Balaji , Rama Chellappa , Soheil Feizi

The ability to align points across two related yet incomparable point clouds (e.g. living in different spaces) plays an important role in machine learning. The Gromov-Wasserstein (GW) framework provides an increasingly popular answer to…

Machine Learning · Computer Science 2023-02-07 Meyer Scetbon , Gabriel Peyré , Marco Cuturi

The goal of this paper is to introduce a new theoretical framework for Optimal Transport (OT), using the terminology and techniques of Fully Probabilistic Design (FPD). Optimal Transport is the canonical method for comparing probability…

Artificial Intelligence · Computer Science 2022-12-29 Sarah Boufelja Y. , Anthony Quinn , Martin Corless , Robert Shorten

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

Machine Learning · Computer Science 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai

Computationally solving multi-marginal optimal transport (MOT) with squared Euclidean costs for $N$ discrete probability measures has recently attracted considerable attention, in part because of the correspondence of its solutions with…

Numerical Analysis · Mathematics 2022-02-03 Johannes von Lindheim

This paper addresses the problem of Unbalanced Optimal Transport (UOT) in which the marginal conditions are relaxed (using weighted penalties in lieu of equality) and no additional regularization is enforced on the OT plan. In this context,…

Optimization and Control · Mathematics 2021-06-09 Laetitia Chapel , Rémi Flamary , Haoran Wu , Cédric Févotte , Gilles Gasso

Selecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal is to jointly select and align text…

Machine Learning · Computer Science 2020-05-28 Kyle Swanson , Lili Yu , Tao Lei

Variational Auto-Encoders enforce their learned intermediate latent-space data distribution to be a simple distribution, such as an isotropic Gaussian. However, this causes the posterior collapse problem and loses manifold structure which…

Machine Learning · Computer Science 2018-09-18 Huidong Liu , Yang Guo , Na Lei , Zhixin Shu , Shing-Tung Yau , Dimitris Samaras , Xianfeng Gu

Speculative sampling reduces the latency of autoregressive decoding for target model LLMs without sacrificing inference quality, by using a cheap draft model to suggest a candidate token and a verification criterion to accept or resample…

Machine Learning · Computer Science 2025-11-21 Rahul Krishna Thomas , Arka Pal

We study the factor model problem, which aims to uncover low-dimensional structures in high-dimensional datasets. Adopting a robust data-driven approach, we formulate the problem as a saddle-point optimization. Our primary contribution is a…

Optimization and Control · Mathematics 2026-04-13 Shabnam Khodakaramzadeh , Soroosh Shafiee , Gabriel de Albuquerque Gleizer , Peyman Mohajerin Esfahani

Optimal transport (OT) and Gromov-Wasserstein (GW) alignment are powerful frameworks for geometrically driven matching of probability distributions, yet their large-scale usage is hampered by high statistical and computational costs.…

Statistics Theory · Mathematics 2026-02-04 Tao Wang , Ziv Goldfeld

The discrete optimal transport (OT) problem, which offers an effective computational tool for comparing two discrete probability distributions, has recently attracted much attention and played essential roles in many modern applications.…

Optimization and Control · Mathematics 2024-05-20 Di Hou , Ling Liang , Kim-Chuan Toh

Two common approaches in low-rank optimization problems are either working directly with a rank constraint on the matrix variable, or optimizing over a low-rank factorization so that the rank constraint is implicitly ensured. In this paper,…

Optimization and Control · Mathematics 2020-12-17 Wooseok Ha , Haoyang Liu , Rina Foygel Barber