中文
相关论文

相关论文: Regularized Optimal Transport is Ground Cost Adver…

200 篇论文

This paper presents a unified framework for smooth convex regularization of discrete optimal transport problems. In this context, the regularized optimal transport turns out to be equivalent to a matrix nearness problem with respect to…

机器学习 · 统计学 2018-07-17 Arnaud Dessein , Nicolas Papadakis , Jean-Luc Rouas

Despite the success of deep learning-based algorithms, it is widely known that neural networks may fail to be robust. A popular paradigm to enforce robustness is adversarial training (AT), however, this introduces many computational and…

机器学习 · 计算机科学 2024-01-18 Nicolas Garcia Trillos , Matt Jacobs , Jakwang Kim , Matthew Werenski

Distributionally robust optimization has been shown to offer a principled way to regularize learning models. In this paper, we find that Tikhonov regularization is distributionally robust in an optimal transport sense (i.e., if an adversary…

最优化与控制 · 数学 2022-10-05 Jiajin Li , Sirui Lin , Jose Blanchet , Viet Anh Nguyen

Entropic regularization provides a generalization of the original optimal transport problem. It introduces a penalty term defined by the Kullback-Leibler divergence, making the problem more tractable via the celebrated Sinkhorn algorithm.…

最优化与控制 · 数学 2023-01-04 Dávid Terjék , Diego González-Sánchez

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

机器学习 · 统计学 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

最优化与控制 · 数学 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

机器学习 · 计算机科学 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

We investigate the problem of efficiently computing optimal transport (OT) distances, which is equivalent to the node-capacitated minimum cost maximum flow problem in a bipartite graph. We compare runtimes in computing OT distances on data…

数据结构与算法 · 计算机科学 2020-07-07 Yihe Dong , Yu Gao , Richard Peng , Ilya Razenshteyn , Saurabh Sawlani

An optimal transport (OT) problem seeks to find the cheapest mapping between two distributions with equal total density, given the cost of transporting density from one place to another. Unbalanced OT allows for different total density in…

最优化与控制 · 数学 2025-07-28 Jacob J. M. Francis , Colin J. Cotter , Marion P. Mittermaier

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the…

最优化与控制 · 数学 2021-10-25 Vien V. Mai , Jacob Lindbäck , Mikael Johansson

Entropic regularization of policies in Reinforcement Learning (RL) is a commonly used heuristic to ensure that the learned policy explores the state-space sufficiently before overfitting to a local optimal policy. The primary motivation for…

机器学习 · 计算机科学 2021-01-19 Hisham Husain , Kamil Ciosek , Ryota Tomioka

We provide theoretical analyses for two algorithms that solve the regularized optimal transport (OT) problem between two discrete probability measures with at most $n$ atoms. We show that a greedy variant of the classical Sinkhorn…

数据结构与算法 · 计算机科学 2021-07-27 Tianyi Lin , Nhat Ho , Michael I. Jordan

Regularising the primal formulation of optimal transport (OT) with a strictly convex term leads to enhanced numerical complexity and a denser transport plan. Many formulations impose a global constraint on the transport plan, for instance…

机器学习 · 计算机科学 2023-10-05 Hugues Van Assel , Titouan Vayer , Remi Flamary , Nicolas Courty

Sinkhorn's algorithm is a method of choice to solve large-scale optimal transport (OT) problems. In this context, it involves an inverse temperature parameter $\beta$ that determines the speed-accuracy trade-off. To improve this trade-off,…

机器学习 · 计算机科学 2024-08-22 Lénaïc Chizat

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such…

机器学习 · 计算机科学 2025-05-20 Peter Chen , Yue Xie , Qingpeng Zhang

Optimal transport (OT) theory has been been used in machine learning to study and characterize maps that can push-forward efficiently a probability measure onto another. Recent works have drawn inspiration from Brenier's theorem, which…

机器学习 · 计算机科学 2023-02-13 Théo Uscidda , Marco Cuturi

We develop a novel theoretical framework for understating OT schemes respecting a class structure. For this purpose, we propose a convex OT program with a sum-of-norms regularization term, which provably recovers the underlying class…

机器学习 · 计算机科学 2023-05-23 Arman Rahbar , Ashkan Panahi , Morteza Haghir Chehreghani , Devdatt Dubhashi , Hamid Krim

Optimal Transport (OT) problem aims to find a transport plan that bridges two distributions while minimizing a given cost function. OT theory has been widely utilized in generative modeling. In the beginning, OT distance has been used as a…

机器学习 · 计算机科学 2024-03-08 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

We study the vanishing-regularization limit of entropically regularized optimal transport (EOT) for the Euclidean distance cost $c(x,y)=\|x-y\|$ in dimension $d>1$. We develop a comprehensive variational convergence framework that entails…

最优化与控制 · 数学 2026-04-29 Marcel Nutz , Chenyang Zhong

We introduce in this paper a novel strategy for efficiently approximating the Sinkhorn distance between two discrete measures. After identifying neglectable components of the dual solution of the regularized Sinkhorn problem, we propose to…

机器学习 · 统计学 2020-01-22 Mokhtar Z. Alaya , Maxime Bérar , Gilles Gasso , Alain Rakotomamonjy