English
Related papers

Related papers: Numerical Methods for Large-Scale Optimal Transpor…

200 papers

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

We consider robust variants of the standard optimal transport, named robust optimal transport, where marginal constraints are relaxed via Kullback-Leibler divergence. We show that Sinkhorn-based algorithms can approximate the optimal cost…

Machine Learning · Computer Science 2021-10-29 Khang Le , Huy Nguyen , Quang Nguyen , Tung Pham , Hung Bui , Nhat Ho

The optimal transport barycenter (a.k.a. Wasserstein barycenter) is a fundamental notion of averaging that extends from the Euclidean space to the Wasserstein space of probability distributions. Computation of the unregularized barycenter…

Machine Learning · Statistics 2025-05-27 Kaheon Kim , Rentian Yao , Changbo Zhu , Xiaohui Chen

To improve the performance of classical generative adversarial network (GAN), Wasserstein generative adversarial networks (W-GAN) was developed as a Kantorovich dual formulation of the optimal transport (OT) problem using Wasserstein-1…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Byeongsu Sim , Gyutaek Oh , Jeongsol Kim , Chanyong Jung , Jong Chul Ye

Selecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal is to jointly select and align text…

Machine Learning · Computer Science 2020-05-28 Kyle Swanson , Lili Yu , Tao Lei

In the realm of computer vision and graphics, accurately establishing correspondences between geometric 3D shapes is pivotal for applications like object tracking, registration, texture transfer, and statistical shape analysis. Moving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Tung Le , Khai Nguyen , Shanlin Sun , Nhat Ho , Xiaohui Xie

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

Sinkhorn's algorithm is a method of choice to solve large-scale optimal transport (OT) problems. In this context, it involves an inverse temperature parameter $\beta$ that determines the speed-accuracy trade-off. To improve this trade-off,…

Machine Learning · Computer Science 2024-08-22 Lénaïc Chizat

We introduce in this paper a novel strategy for efficiently approximating the Sinkhorn distance between two discrete measures. After identifying neglectable components of the dual solution of the regularized Sinkhorn problem, we propose to…

Machine Learning · Statistics 2020-01-22 Mokhtar Z. Alaya , Maxime Bérar , Gilles Gasso , Alain Rakotomamonjy

We investigate the problem of sampling from posterior distributions with intractable normalizing constants in Bayesian inference. Our solution is a new generative modeling approach based on optimal transport (OT) that learns a deterministic…

Computation · Statistics 2026-03-03 Ke Li , Wei Han , Yuexi Wang , Yun Yang

We study the optimal transport problem for $d>2$ discrete measures. This is a linear programming problem on $d$-tensors. It gives a way to compute a "distance" between two sets of discrete measures. We introduce an entropic regularization…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Shmuel Friedland

Optimal Transport (OT) problem aims to find a transport plan that bridges two distributions while minimizing a given cost function. OT theory has been widely utilized in generative modeling. In the beginning, OT distance has been used as a…

Machine Learning · Computer Science 2024-03-08 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

Optimal transport (OT) theory underlies many emerging machine learning (ML) methods nowadays solving a wide range of tasks such as generative modeling, transfer learning and information retrieval. These latter works, however, usually build…

Machine Learning · Statistics 2021-12-03 Quang Huy Tran , Hicham Janati , Ievgen Redko , Rémi Flamary , Nicolas Courty

We address the convergence problem in learning the Optimal Transport (OT) map, where the OT Map refers to a map from one distribution to another while minimizing the transport cost. Semi-dual Neural OT, a widely used approach for learning…

Machine Learning · Computer Science 2026-02-03 Jaemoo Choi , Jaewoong Choi , Dohyun Kwon

This paper studies the equitable and optimal transport (EOT) problem, which has many applications such as fair division problems and optimal transport with multiple agents etc. In the discrete distributions case, the EOT problem can be…

Optimization and Control · Mathematics 2021-10-04 Minhui Huang , Shiqian Ma , Lifeng Lai

Optimal transport (OT) formalizes the problem of finding an optimal coupling between probability measures given a cost matrix. The inverse problem of inferring the cost given a coupling is Inverse Optimal Transport (IOT). IOT is less well…

Machine Learning · Statistics 2022-06-22 Wei-Ting Chiu , Pei Wang , Patrick Shafto

Scaling algorithms for entropic transport-type problems have become a very popular numerical method, encompassing Wasserstein barycenters, multi-marginal problems, gradient flows and unbalanced transport. However, a standard implementation…

Optimization and Control · Mathematics 2019-02-12 Bernhard Schmitzer

This paper presents a novel two-step approach for the fundamental problem of learning an optimal map from one distribution to another. First, we learn an optimal transport (OT) plan, which can be thought as a one-to-many map between the two…

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

We develop a theory for image restoration with a learned regularizer that is analogous to that of Meyer's characterization of solutions of the classical variational method of Rudin-Osher-Fatemi (ROF). The learned regularizer we use is a…

Optimization and Control · Mathematics 2023-05-02 Tristan Milne , Adrian Nachman